Models & inference
In-engine speculative decoding
Configure draft models for faster local generation.
Was this page helpful?
Documentation Index
Fetch the complete documentation index at: /llms.txt
Use this file to discover all available pages before exploring further.
Configure draft models for faster local generation.
arka speculative vllm --draft-model qwen3:1.7b
arka speculative vllm --draft-model qwen3:1.7b --num-draft-tokens 6 --apply
Was this page helpful?