# gguf

Hundreds of models & providers. One command to find what runs on your hardware.

Find the local LLM that actually runs and performs best on your hardware. Ranked by real, recency-aware benchmarks, not parameter count. One command, run it instantly.

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

ggml speech-to-text inference for 16+ model families