Check in this order
- Is Ollama running?
ollama listshould print models, not an error. - Is the port reachable? The agent expects the default local endpoint; a firewall or a custom port breaks it.
- Is the model pulled? The agent can only use models
ollama pullhas downloaded. - Does the machine have the memory? Large models fail slowly or not at all under pressure.
The model name is exact
Names are case-sensitive and include tags: llama3.1:8b is not llama3.1. If the agent reports the model is missing, compare the name in the agent config with the ollama list output — this is the most common fix in the local setup guide.
When it still fails
- Restart Ollama and watch its own log for bind errors.
- Test the endpoint by hand with curl before blaming the agent.
- If the machine is a low-RAM device, drop to a smaller model or use a remote model for hard steps — the split in cheapest LLM for agents.
Why local is worth the trouble
Once it works, it is private and $0 per token — the reasons in the local AI agent guide. If the connection keeps dropping mid-run, check the timeout guide next.