The best LlamaGPT alternatives
8 tools that do a similar job to LlamaGPT, 8 of them open source. Each entry says what it does and who it suits, so you can pick the one that fits instead of the most famous.
You're replacing
LlamaGPTA self-hosted chatbot that runs Llama 2 models locally, so your chats stay on your machine.
- 1
Ollama
Open source · MIT · ★ 186k
Runs open AI models like Gemma, Qwen and DeepSeek on your own machine or in the cloud.
Best for: Developers who want a local model API for their own apps; People who want to chat with open models without sending prompts to a hosted service
- 2
GPT4All
Open source · MIT · ★ 77.3k
Desktop app and Python package for running open-source language models locally on your computer.
Best for: People who want to chat with a language model without sending their text to a cloud service; Developers who want to call local models from Python
- 3
llama.cpp
Open source · MIT · ★ 133k
Runs large language models locally in plain C/C++, on CPUs and many kinds of GPUs.
Best for: Developers who want to run open-weight models locally without a cloud API; People with Apple silicon or other non-NVIDIA hardware who want GPU-accelerated inference
- 4
DB-GPT
Open source · MIT · ★ 20.2k
Open-source AI assistant that writes SQL and code to analyze your databases and files.
Best for: Analysts who want to ask questions of CSV or Excel files in plain language; Teams exploring a database without writing SQL by hand
- 5
LocalAI
Open source · MIT · ★ 50.1k
Open-source engine that runs AI models (text, vision, voice, image, video) locally behind an OpenAI-style API.
Best for: Developers who want an OpenAI-compatible endpoint running on their own machines or servers; Teams that need privacy and want data to stay inside their infrastructure
- 6
OpenHands
Open source · MIT · ★ 92.5k
A self-hosted control panel that runs AI coding agents on your machine, in Docker, or in the cloud.
Best for: Developers who want coding agents running on a server while their laptop is off; Teams that want a shared agent server for tasks like code review or dependency updates
- 7
AnythingLLM
Open source · MIT · ★ 67.8k
Private AI chat app for your documents, with agents, runs locally or with cloud models.
Best for: People who want a private ChatGPT-style assistant over their own PDFs and text files; Teams that need several users with separate access on one instance (Docker version)
- 8
DocsGPT
Open source · MIT · ★ 18.4k
Self-hosted platform for AI agents that answer from your own documents, with any model.
Best for: Teams that want an internal assistant over their own documents and wikis; Developers who want to embed a documentation chatbot on a product site
How we pick: tools in the same category that solve the same problem, projects that name each other as alternatives, and open-source projects that describe themselves as an alternative to LlamaGPT. We don't take payment for placement.