> ## Documentation Index
> Fetch the complete documentation index at: https://arka-agent-mintlify-f21cea86.mintlify.site/llms.txt
> Use this file to discover all available pages before exploring further.

# Easy AI model hosting setup

> Configure local or hosted model runtimes for Arka.

```bash theme={null}
arka model setup list
arka model setup ollama --model qwen3:8b
arka model setup apple-fm
arka model setup vllm --model Qwen/Qwen2.5-7B-Instruct --url http://127.0.0.1:8000/v1
arka model setup lmstudio --model local-model
arka model setup openai-compatible --url https://api.example.com/v1 --model my-model
arka model doctor
```

The setup command writes model preference and endpoint configuration through
Arka's protected `.env` handling. It does not download weights or store API
secrets; it prints launch commands and provider-specific next steps. Use
`arka integration setup <provider>` for API keys, then `arka model doctor` to
check runtime readiness. Combine local and hosted models with
`arka hybrid status` and `arka hybrid run --policy parallel`.

For a LAN inference cluster, configure Exo as a local OpenAI-compatible host:

```bash theme={null}
arka model setup exo --model your-model
arka hybrid status
arka hybrid run --policy local-only "summarize this code"
```

Exo can pool Macs, Linux workstations, and other trusted machines. Keep its
endpoint on a private network; Arka classifies it as local and never sends it
to hosted fallbacks under `local-only`.

The model advisor also annotates Apple Silicon/MLX opportunities, MoE model
hints, and speculative/MTP decoding hints. These are evidence labels, not
guarantees: verify runtime support and active-parameter metadata before
deployment.


## Related topics

- [Arka — AI terminal agent documentation](/index.md)
- [Apple Intelligence (on-device)](/guides/apple-intelligence.md)
- [AI agent guide — use Arka over MCP](/guides/ai-agents.md)
- [Quickstart: install Arka and run your first command](/quickstart.md)
- [Integrations](/guides/integrations.md)


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.