Overview

Plain English

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Technical

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.

Technical scorecard

License AGPL 3.0

Commercial use No

OpenAI-compatible API No

REST API No

Fine-tuning support No

Quantization support No

Docker available No

GUI / no-code available No

Telemetry None

Offline after setup Yes

Data & Privacy

After setup, this listing is marked as usable offline. Confirm network behavior against the upstream project before regulated deployment.

Not verified in this directory yet. Review the upstream docs for persistence, logs, and workspace storage.

The listed license needs review before commercial use.

None

Last verified: May 17, 2026. Maintainer verification should be treated as directory guidance, not legal advice.

Setup & Installation

Low

GUI, low-resource, or simple install path likely available.

C++, Bare Metal

# Start with the official project documentation
# https://github.com/LostRuins/koboldcpp

Hardware Requirements

RAM8 GB minimum / 16 GB recommended

Hardware tagsCPU Only, NVIDIA GPU (CUDA), Apple Silicon (Metal), Low-resource (< 8GB RAM)

Model formatsNot specified

Primary languageC++

Works Well With

You might also evaluate

Ollama Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other mode... llama.cpp LLM inference in C/C++.... vLLM A high-throughput and memory-efficient inference and serving engine for LLMs.... LocalAI LocalAI is the open-source AI engine. Run any model - LLMs, vision, voice, image, video - on any...