The best Ollama alternatives
10 tools that do a similar job to Ollama, 9 of them open source. Each entry says what it does and who it suits, so you can pick the one that fits instead of the most famous.
You're replacing
OllamaRuns open AI models like Gemma, Qwen and DeepSeek on your own machine or in the cloud.
- 1
llama.cpp
Open source · MIT · ★ 133k
Runs large language models locally in plain C/C++, on CPUs and many kinds of GPUs.
Best for: Developers who want to run open-weight models locally without a cloud API; People with Apple silicon or other non-NVIDIA hardware who want GPU-accelerated inference
- 2
MindsHub
Open source · MIT · ★ 39.8k
An open-source agent workspace for knowledge work and software, with a choice of models.
Best for: Knowledge workers who want to automate reading and writing tasks like reports and recurring workflows; Developers who want to build and run the full MindsHub stack from source
- 3
Reasonix
Open source · MIT · ★ 36k
An open-source AI coding assistant that reads, edits and tests code in your project folder.
Best for: Developers who want an AI assistant to make multi-step changes in a local project; People who want to choose or switch their own model provider
- 4
magpie
Open source · MIT · ★ 28.2k
A local gateway that lets AI coding agents like Claude Code and Codex use models from other providers.
Best for: People who use more than one AI coding agent and want one place to manage their models; Users with several provider accounts or API keys who want automatic fallback when a quota runs out
- 5
LocalAI
Open source · MIT · ★ 50.1k
Open-source engine that runs AI models (text, vision, voice, image, video) locally behind an OpenAI-style API.
Best for: Developers who want an OpenAI-compatible endpoint running on their own machines or servers; Teams that need privacy and want data to stay inside their infrastructure
- 6
LlamaGPT
Open source · MIT · ★ 10.9k
A self-hosted chatbot that runs Llama 2 models locally, so your chats stay on your machine.
Best for: People who want a private chatbot and don't want to send prompts to a cloud provider; Users with a home server running umbrelOS who want a one-click install
- 7
CowAgent
Open source · MIT · ★ 47.8k
Open-source personal AI assistant that plans tasks, uses tools, and keeps memory across chat platforms.
Best for: People who want a self-hosted personal assistant reachable from their everyday chat apps; Developers who want an extensible agent framework with skills and MCP support
- 8
DB-GPT
Open source · MIT · ★ 20.2k
Open-source AI assistant that writes SQL and code to analyze your databases and files.
Best for: Analysts who want to ask questions of CSV or Excel files in plain language; Teams exploring a database without writing SQL by hand
- 9
Jan
AI tool · Open source
An open-source desktop assistant that runs models offline or connects to cloud APIs.
Best for: Open-source offline chat; Mixing local and cloud models
- 10
LM Studio
AI tool · Free
A desktop app for discovering, downloading and chatting with local open models, with a local server mode.
Best for: Non-developers running local models; Comparing quantised models
How we pick: tools in the same category that solve the same problem, projects that name each other as alternatives, and open-source projects that describe themselves as an alternative to Ollama. We don't take payment for placement.