llama-quantize command. Add --run to
execute it; Arka creates the output directory automatically. Install a
llama.cpp build exposing llama-quantize before running conversions.Models & inference
Local model quantization
Create smaller GGUF models with a safe preview-first workflow.
Was this page helpful?