Why local
Local models mean prompts never leave your machine, every token is free and offline work is possible.
Setup
Install Ollama, pull a model and point the agent at it:
ollama pull llama3.1 remoteagent model add local --ollama llama3.1 remoteagent model use local
Same policy, same audit
Local inference changes nothing else: policies, grants, caps and the audit log work identically.
When to use APIs
For frontier-quality reasoning, fall back to an API model per task - mix and match freely.
Next
Try a RAG agent on top of your local model.
RemoteAgent Online - 100 solutions · Blog · mona.expert · Sign in free