🔌
New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
// INFERENCE RUNTIME
KoboldCpp
A single-file llama.cpp-based executable adding KoboldAI-compatible API, story mode, and character cards on top of llama.cpp performance. Popular in the creative writing community. Supports concurrent generation and remote backends.
- Platforms
- Windows, macOS, Linux
- Backends
- CUDA, Metal, ROCm, Vulkan, CPU
- Quant formats
- GGUF (all variants)
Videos about KoboldCpp
Installing KoboldCPP on Windows
Easiest Tutorial to Install koboldcpp on Windows to Run LLMs Locally
Local Character.ai Alternative! - KoboldCpp & SillyTavern In 2025
FAQ
What platforms does KoboldCpp support?▶
KoboldCpp runs on Windows, macOS, Linux with backends CUDA, Metal, ROCm, Vulkan, CPU.
What quant formats does KoboldCpp support?▶
KoboldCpp supports GGUF (all variants).