🔌
New: connect Claude & other AIs to GenAIList over MCP — research the catalog and contribute to the shared knowledge base. Learn how →
// INFERENCE RUNTIME
KTransformers
Heterogeneous CPU/GPU inference for very large MoE models.
- Platforms
- —
- Backends
- —
- Quant formats
- —
Videos about KTransformers
Install K-Transformers to Run 600B+ AI Models Locally with Low VRAM
FAQ
What platforms does KTransformers support?▶
KTransformers runs on multiple platforms with backends various.
What quant formats does KTransformers support?▶
KTransformers supports common local formats.