The best AnythingLLM alternatives
8 tools that do a similar job to AnythingLLM, 8 of them open source. Each entry says what it does and who it suits, so you can pick the one that fits instead of the most famous.
You're replacing
AnythingLLMPrivate AI chat app for your documents, with agents, runs locally or with cloud models.
- 1
Vane
Open source · MIT · ★ 38k
A self-hosted AI answering engine that searches the web and cites its sources.
Best for: People who want AI-written answers with links to sources; Users who prefer to run their own search setup instead of a hosted service
- 2
LlamaGPT
Open source · MIT · ★ 10.9k
A self-hosted chatbot that runs Llama 2 models locally, so your chats stay on your machine.
Best for: People who want a private chatbot and don't want to send prompts to a cloud provider; Users with a home server running umbrelOS who want a one-click install
- 3
serviette
Open source · MIT · ★ 58.7k
A no-code server that answers questions from your documents and updates answers when files change.
Best for: Teams that want a chat over internal documents without writing code; Developers who want a quick local RAG prototype with DuckDB as the default store
- 4
Paperclip
Open source · MIT · ★ 110k
Open-source Node.js and React app for organizing teams of AI agents around goals, tasks, and budgets.
Best for: Developers already running several AI coding agents who want one place to track them; Small teams experimenting with autonomous agents that need budgets and approval steps
- 5
Octop
Open source · MIT · ★ 11.5k
A self-hosted AI assistant that runs multiple agents for several users on your own machine.
Best for: Households or small teams that want a shared, self-hosted assistant; People who want to keep conversations and credentials on their own machine
- 6
Hermes WebUI
Open source · MIT · ★ 19.4k
A browser-based chat interface for the Hermes Agent, usable from a desktop or phone.
Best for: People who already run Hermes Agent and want a browser or phone interface; Developers who want a three-panel chat view with workspace file browsing
- 7
CowAgent
Open source · MIT · ★ 47.8k
Open-source personal AI assistant that plans tasks, uses tools, and keeps memory across chat platforms.
Best for: People who want a self-hosted personal assistant reachable from their everyday chat apps; Developers who want an extensible agent framework with skills and MCP support
- 8
DB-GPT
Open source · MIT · ★ 20.2k
Open-source AI assistant that writes SQL and code to analyze your databases and files.
Best for: Analysts who want to ask questions of CSV or Excel files in plain language; Teams exploring a database without writing SQL by hand
How we pick: tools in the same category that solve the same problem, projects that name each other as alternatives, and open-source projects that describe themselves as an alternative to AnythingLLM. We don't take payment for placement.