Open Source · RAG
Anything LLM
The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.
Our verdict
We have not reviewed Anything LLM yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About Anything LLM
Anything LLM is a JavaScript-based orchestration tool that runs locally on your device, connecting multiple LLM providers and data sources through a unified interface. It prioritizes privacy by keeping data on-device and minimizes setup friction with sensible defaults.
Best for
Developers building privacy-sensitive LLM applications who can run compute locally and want to avoid vendor lock-in.
Use cases
- Building private document Q&A systems without cloud dependencies
- Prototyping multi-model workflows locally before deployment
- Running LLM applications on restricted networks or air-gapped systems
Notes
60,905 stars on GitHub. Last updated 2026-06-01. Licensed MIT.
Pros
- On-device execution eliminates data transmission to external services
- Supports multiple LLM providers and data connectors from a single interface
- Low barrier to entry with minimal configuration required
Cons
- Computational overhead of running models locally limits scale compared to API-based solutions
- Community-maintained project with no commercial support guarantee
- JavaScript runtime may not match performance of native implementations for heavy workloads
Key facts
What we have checked
- Latest version
- 1.19.0 (released 26 Oct 2026)
- GitHub stars
- 66,481
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How Anything LLM is growing
60,905 to 66,481
Alternatives
Alternatives to Anything LLM
| Record | Type | How we know | Checked |
|---|---|---|---|
| AgentsetAlternative to this | App | Named in the listing | Not dated |
| BenyD/haypileAlternative to this | MCP server | Named in the listing | Not dated |
| Book GPTAlternative to this | Open source | Named in the listing | Not dated |
| CasibaseAlternative to this | Open source | Named in the listing | Not dated |
| ChatFilesAlternative to this | Open source | Named in the listing | Not dated |
| ChatPDFAlternative to this | App | Named in the listing | Not dated |
| ChatPDFAlternative to this | Open source | Named in the listing | Not dated |
| ChatSonicAlternative to this | App | Named in the listing | Not dated |
| DataChadAlternative to this | Open source | Named in the listing | Not dated |
| DialoqbaseAlternative to this | Open source | Named in the listing | Not dated |
| Doc SearchAlternative to this | Open source | Named in the listing | Not dated |
| DocsGPTAlternative to this | Open source | Named in the listing | Not dated |
| EntaoaiAlternative to this | Open source | Named in the listing | Not dated |
| gamosoft/NoteDiscoveryAlternative to this | MCP server | Named in the listing | Not dated |
| GleanAlternative to this | App | Named in the listing | Not dated |
| Gpt RunnerAlternative to this | Agent | Named in the listing | Not dated |
| JanAlternative to this | App | Named in the listing | Not dated |
| Knowledge GPTAlternative to this | Open source | Named in the listing | Not dated |
| LibreChatAlternative to this | App | Named in the listing | Not dated |
| Local GPTAlternative to this | Open source | Named in the listing | Not dated |
| memfreeAlternative to this | Agent | Named in the listing | Not dated |
| MinimaAlternative to this | Open source | Named in the listing | Not dated |
| NotebookLMAlternative to this | App | Named in the listing | Not dated |
| Notion QAAlternative to this | Open source | Named in the listing | Not dated |
| Open WebUIAlternative to this | App | Named in the listing | Not dated |
| Private GPTAlternative to this | Open source | Named in the listing | Not dated |
| privateGPTAlternative to this | App | Named in the listing | Not dated |
| quivrAlternative to this | App | Named in the listing | Not dated |
| R2RAlternative to this | Open source | Named in the listing | Not dated |
| Robby-ChatbotAlternative to this | Open source | Named in the listing | Not dated |
| Second Brain AI AgentAlternative to this | Open source | Named in the listing | Not dated |
| shinpr/mcp-local-ragAlternative to this | MCP server | Named in the listing | Not dated |
| SunnyLich/OpenWandAlternative to this | MCP server | Named in the listing | Not dated |
| TextAIAlternative to this | Open source | Named in the listing | Not dated |
| ClaudeThis is an alternative to it | Product | Linked recordGitHub | |
| FlowiseThis is an alternative to it | Open source | Named in the listing | Not dated |
| LangflowThis is an alternative to it | Open source | Named in the listing | Not dated |
| LobeHub (formerly LobeChat)This is an alternative to it | Open source | Named in the listing | Not dated |
Compare
Compare Anything LLM side by side
Sources
Where this comes from
- GitHubOfficial
- github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438Registry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Released 1.19.0
Released 1.18.0
Released 1.17.0
Released 1.16.2
Released 1.16.1
Released 1.16.0
Released 1.15.0
Released 1.14.2
Released 1.14.1
Released 1.14.0
Released 1.13.0
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
Open WebUI
Various
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Flowise
Flowise
Assemble agent and language-model workflows using a visual builder.
Langflow
Community
Langflow is a powerful tool for building and deploying AI-powered agents and workflows.
LobeHub (formerly LobeChat)
LobeHub
A self-hostable chat and agent workspace, renamed from LobeChat to LobeHub in January 2026, that works with OpenAI, Anthropic, Google, OpenRouter, local Ollama and dozens of other providers.
Private GPT
Community
Interact with your documents using the power of GPT, 100% privately, no data leaks
Claude
Open source alternatives to Claude, ranked by GitHub stars and freshness.
Gpt Runner
Community
Conversations with your files! Manage and run your AI presets!
memfree
Community
Welcome to the MemFree documentation.
Agentset
Various
The open-source platform to build AI apps that deliver reliable answers. Production-grade RAG in minutes, no expertise needed.
ChatPDF
Various
ChatPDF brings ChatGPT-style intelligence and PDF AI technology together for smarter document understanding. Summarize, chat, and analyze.
ChatSonic
Various
AI Chat with GPT-4o, Claude, and Gemini to power your marketing workflows. Your AI Marketing Agent connects all your tools and handles research to publishing.
Glean
Glean
Enterprise AI work assistant. Search, ask, and act across every internal app, with workplace identity baked in.
Jan
Various
Jan is an open-source alternative to ChatGPT. Run open-source AI models locally or connect to cloud models like GPT, Claude and others.
LibreChat
Various
LibreChat brings together all your AI conversations in one unified, customizable interface.
NotebookLM
Various
Meet NotebookLM, the AI research tool and thinking partner that can analyze your sources, turn complexity into clarity and transform your content.
Open WebUI
Various
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
privateGPT
Various
Interact with your documents using the power of GPT, 100% privately, no data leaks
quivr
Various
Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
LangChain
Various
LangChain provides the engineering platform and open source frameworks developers use to build, test, and deploy reliable AI agents.
LM Studio
Various
Run local AI models like gpt-oss, Llama, Gemma, Qwen, and DeepSeek privately on your computer.
OpenRouter
Various
The unified interface for LLMs. Find the best models & prices for your prompts
ahmedak/defluff
Various
Deterministic slop detector for AI-generated prose. No model, no API key.
awesome-llm-webapps
Community
A collection of open source, actively maintained web apps for LLM applications
LangChain
Community
The agent engineering platform.
Llama2 Embedding Server
Community
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
llama.cpp
Community
LLM inference in C/C++
Modelz-LLM
Community
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
Ollama
Ollama
Run supported language models on your computer, with additional cloud options.
Rapid-MLX
Community
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Dr
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.