ollama
by Community
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
OSS
ollama
Added 1 June 2026
Overview
Ollama is a Go-based framework for running large language models locally on your machine. It downloads and executes open-source models like Llama, Mistral, and others without requiring cloud infrastructure or API keys.
Best for
Best for
Developers building local-first applications or prototyping with open-source LLMs without cloud costs
Use cases
- Running LLMs offline for privacy-sensitive applications
- Local development and testing before deploying to production
- Building chatbots and agents that don't depend on external APIs
Notes
Ollama is a Go-based framework for running large language models locally on your machine. It downloads and executes open-source models like Llama, Mistral, and others without requiring cloud infrastructure or API keys.
172,846 stars on GitHub. Last updated 2026-06-01. Licensed MIT.
Use cases
- Running LLMs offline for privacy-sensitive applications
- Local development and testing before deploying to production
- Building chatbots and agents that don’t depend on external APIs
Pros
- No cloud dependency or API costs once models are downloaded
- Simple CLI interface with minimal setup overhead
- Supports a wide range of open-source models with one-command installation
Cons
- Requires significant local compute and storage for larger models
- Performance depends entirely on your hardware, not optimized cloud infrastructure
- Limited to open-source models, no access to proprietary models like GPT-4
Indexed from awesome-llm and enriched against its public facts.
Pros
- No cloud dependency or API costs once models are downloaded
- Simple CLI interface with minimal setup overhead
- Supports a wide range of open-source models with one-command installation
Cons
- Requires significant local compute and storage for larger models
- Performance depends entirely on your hardware, not optimized cloud infrastructure
- Limited to open-source models, no access to proprietary models like GPT-4
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
Rapid-MLX
Community
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Dr
Serge
Community
A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.
Triton Server (TRTIS)
Community
The Triton Inference Server provides an optimized cloud and edge inferencing solution.
gpt4all
Various
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
llama.cpp
Various
LLM inference in C/C++
LM Studio
Various
Run local AI models like gpt-oss, Llama, Gemma, Qwen, and DeepSeek privately on your computer.
OpenAI API
Various
Announcement of the OpenAI API for text-to-text general-purpose AI models based on GPT-3. OpenAI blog, June 11, 2020.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Open WebUI
Various
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
gpt4all
Various
GPT4All: Run Local LLMs on Any Device. Open-source and available for commercial use.
privateGPT
Various
Interact with your documents using the power of GPT, 100% privately, no data leaks
Anything LLM
Community
The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.
LangChain
Community
The agent engineering platform.
Cline
Cline
Open-source autonomous coding agent that lives inside VS Code. BYO model key, watch it work.
Clippy
Community
AI programming assistant
Crewai
Community
Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.
memfree
Community
Welcome to the MemFree documentation.
openinterpreter
Community
Interpreter lets you work alongside agents that can edit your documents, fill PDF forms, and more.
wispy
Community
Chrome extension
elvismdev/mem0-mcp-selfhosted
Various
Self-hosted mem0 MCP server for Claude Code. Run a complete memory server against self-hosted Qdrant + Neo4j + Ollama while using Claude as the main LLM.
escapeboy/agent-fleet-o
Various
Open-source AI agent orchestration platform — self-hosted mission control for autonomous multi-agent systems. Visual DAG workflows, 450+ MCP tools, human-in-the-loop approvals. Wor
jaspertvdm/mcp-server-ollama-bridge
Various
MCP Server - Bridge to local Ollama LLM. Part of HumoticaOS/SymbAIon ecosystem.
juergenkoller-software/distill-mcp
Various
Open-source MCP server bridge for Distill — let Claude/Cursor rename your files based on content (AI: Claude/OpenAI/Gemini/Ollama/Apple).
mediar-ai/screenpipe
Various
YC (S26) | AI that knows what you've seen, said, or heard. Records everything you do, say, hear 24/7, local, private, secure
Michael-WhiteCapData/ollama-handoff
Various
MCP server that offloads cheap work from your cloud LLM agent to a local Ollama model — summaries, drafts, extractions, first-pass reviews — at zero cloud cost.
spranab/brainstorm-mcp
Various
MCP server for multi-round AI brainstorming debates between multiple models (GPT, DeepSeek, Groq, Ollama, etc.)
TKMD/ReftrixMCP
Various
MCP server with 39 tools for web design analysis — layout extraction, motion detection, quality scoring, accessibility audit, Core Web Vitals, design comparison, and semantic searc
tobocop2/lilbee
Various
Run local AI models, search your files and code, and crawl the web, all in one program. Cited answers, local-first, with an MCP server for your coding agent. TUI, CLI, REST API, an
VrtxOmega/Ollama-Omega
Various
Sovereign Ollama Bridge — MCP server for local and cloud Ollama models. Generated by Qwen 3.5 397B.
BenyD/haypile
Various
Private search and Q&A for your documents. One binary that watches your folders and answers questions with citations, fully local.
Agent-LLM
Community
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memor
AI Getting Started
Community
A Javascript AI getting started stack for weekend projects, including image/text models, vector stores, auth, and deployment configs
Anything LLM
Community
The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.
AutoGPT
Community
AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.
BlockAGI
Community
Your Self-Hosted, Hackable Research Agent Inspired by AutoGPT
Casibase
Community
⚡️next-generation personal AI assistant powered by LLM, RAG and agent loops, supporting computer-use, browser-use and coding agent, demo: https://demo.openagentai.org
Cheshire Cat
Community
AI agent microservice
DemoGPT
Community
🤖 Create LLM agents in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.
deploy-llms-with-ansible
Community
Easily deploy LLMs with Ansible. Uses Docker with llama.cpp or ollama. Secured with whitelisted IPs.
Dify
Community
Production-ready platform for agentic workflow development.
DocsGPT
Community
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
DSPy
Stanford NLP
Programming, not prompting. Declare what you want, compile prompts and weights against an objective.
Flappy
Community
Production-Ready LLM Agent SDK for Every Developer
Knowledge GPT
Community
Accurate answers and instant citations for your documents.
LangChain
Community
The agent engineering platform.
Langroid
Community
Harness LLMs with Multi-Agent Programming
LlamaIndex
LlamaIndex
The data framework for LLM apps. RAG, ingestion, structured extraction, agents over your data.
Llmware
Community
Unified framework for building enterprise RAG pipelines with small, specialized models
LLocalSearch
Community
LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user ca
Local GPT
Community
Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
OpenDAN
Community
OpenDAN is an open source Personal AI OS , which consolidates various AI modules in one place for your personal use.
Pipecat
Community
Open Source framework for voice and multimodal conversational AI
Private GPT
Community
Interact with your documents using the power of GPT, 100% privately, no data leaks
QA-Pilot
Community
QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.
Rhesis
Community
The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root ca
Rigging
Community
Lightweight LLM Interaction Framework
Scale Spellbook
Community
Accelerate and scale Generative AI across your enterprise with the platform to transform your data into customized enterprise-ready Generative AI applications.
Shell-Pilot
Community
A simple, lightweight shell script to interact with OpenAI or Ollama or Mistral AI or LocalAI or ZhipuAI from the terminal, and enhancing intelligent system management without any
SuperAGI
Community
SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.
SwarmClaw
Community
Open-source self-hosted AI agent runtime and multi-agent framework for autonomous agent swarms. Agent memory, MCP tools, schedules, delegation, and 23+ LLM providers (Claude, GPT,
TensorZero
Community
TensorZero builds open-source tools for production-grade LLM applications: LLM gateway, observability, optimization, evaluations, and experimentation.
Vercel AI SDK
Vercel
The de facto TypeScript SDK for AI apps. Streaming, tools, multi-model, and now an agent loop.
ai-i18n
Various
ai-i18n is a GitHub Action that translates your app's i18n files using LLMs. It extracts strings, translates only what's changed, and commits the results back to your repo. Works w
AutoGen
Various
A programming framework for agentic AI
Chatbot UI
Various
Chatbot UI
Harbor
Various
Stop configuring your AI stack. Start using it. One command brings a complete pre-wired LLM stack with hundreds of services to explore.
Jan
Various
Jan is an open-source alternative to ChatGPT. Run open-source AI models locally or connect to cloud models like GPT, Claude and others.
Kilo
Various
Kilo is the open source AI coding agent for VS Code, JetBrains, CLI, and Cloud. Access 500+ models, bring your own keys at zero markup, and keep code private with local models.
LangChain
Various
LangChain provides the engineering platform and open source frameworks developers use to build, test, and deploy reliable AI agents.
Local Deep Research
Various
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Every
Msty
Various
Msty AI builds local-first AI tools: Msty Studio is your private AI workspace, and Msty Claw runs autonomous multi-step tasks with sandboxed control on your machine.
Open Interpreter
Various
A natural language interface for computers
Open WebUI
Various
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
quivr
Various
Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama.
RooCode
Various
Roo Code gives you a whole dev team of AI agents in your code editor.
flowiseai
Community
Open source generative AI development platform for building AI agents, LLM orchestration, and more
cameronrye/openzim-mcp
Various
OpenZIM MCP is a modern, secure, and high-performance MCP (Model Context Protocol) server that enables AI models to access and search ZIM format knowledge bases offline.
Jwrede/llmprobe
Various
Synthetic monitoring and CI smoke tests for LLM inference endpoints.
ocbenji/bitcoinbenji-mcp
Various
MCP server for the Bitcoin Benji API — Lightning-paid Bitcoin mempool intelligence + sovereign on-prem AI inference (L402). No third-party APIs.
ambeelabs/ambee-mcp
Various
The official Model Context Protocol server for Ambee. It gives any MCP-compatible AI assistant — Claude, ChatGPT, Cursor, VS Code, Ollama, and more — direct access to live air qual
Agency
Community
🕵️♂️ Library designed for developers eager to explore the potential of Large Language Models (LLMs) and other generative AI through a clean, effective, and Go-idiomatic approach.
AgentVerse
Community
🤖 AgentVerse 🪐 is designed to facilitate the deployment of multiple LLM-based agents in various applications, which primarily provides two frameworks: task-solving and simulation
AI Gateway
Community
A blazing fast AI Gateway with integrated guardrails. Route to 1,600+ LLMs, 50+ AI Guardrails with 1 fast & friendly API.
AutoGen
Microsoft
Microsoft's framework for multi-agent conversations. Agents that talk to each other to solve hard problems.
Awesome-Code-LLM
Community
👨💻 An awesome and curated list of best code-LLM for research.
awesome-japanese-llm
Community
日本語LLMまとめ - Overview of Japanese LLMs
Baichuan-7|13B
Community
AGI Large Language Models
Bifrost
Community
Fastest enterprise AI gateway (50x faster than LiteLLM) with adaptive load balancer, cluster mode, guardrails, 1000+ models support & <100 µs overhead at 5k RPS.
BLOOMZ&mT0
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Chainlit
Community
A Python library for making chatbot interfaces.
Codestral-7|22B
Community
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
Command R-35B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Continue
Community
⏩ Source-controlled AI checks, enforceable in CI. Powered by the open-source Continue CLI
CrewAI
CrewAI
Role-based multi-agent framework. Define crews of agents with roles, goals, and tasks, run them as a team.
Cursor
Community
Built to make you extraordinarily productive, Cursor is the best coding agent.
DataChad
Community
Ask questions about any data source by leveraging langchains
DeepSeek-R1
Community
First-generation reasoning models from DeepSeek.
DeepSeek-VL-1.3|7B
Community
DeepSeek-VL model series
DemoGPT
Community
🤖 Create LLM agents in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.
Epsilla
Community
An all-in-one LLM Agent platform with your private data and knowledge, delivers your production-ready AI Agents on Day 1.
Flowise
Community
Build AI Agents, Visually
Gemma
Community
Checking your browser - reCAPTCHA
Gemma2-9|27B
Community
Gemma 2, our next generation of open models, is now available globally for researchers and developers.
GLM-2|6|10|13|70B
Community
Org profile for THUDM on Hugging Face, the AI community building the future.
Google "We Have No Moat, And Neither Does OpenAI"
Community
Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI
Guidance
Community
A guidance language for controlling large language models.
Haystack
Community
Create agentic, context engineered AI systems using Haystack’s modular and customizable building blocks, built for real-world, production-ready applications.
Kimi-K2
Community
Kimi K2 is the large language model series developed by Moonshot AI team
LazyLLM
Community
Easiest and laziest way for building multi-agent LLMs applications.
LiteLLM 🚅
Community
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, Vertex
Llama 3.2-1|3|11|90B
Community
[Llama 3.1-8 70 405B](https://llama.meta.com/)
Llama 3-8|70B
Community
[Llama 2-7 13 70B](https://llama.meta.com/llama2/)
llama.cpp
Community
LLM inference in C/C++
LLaMA Cult and More
Community
Large Language Models for All, 🦙 Cult and More, Stay in touch !
llm-ui
Community
The React library for LLMs
MemFree
Community
MemFree - Hybrid AI Search Engine & AI Page Generator
MemGPT
Community
Letta is the platform for building stateful agents: AI with advanced memory that can learn and self-improve over time.
MiniChain
Community
A tiny library for coding with large language models.
MiniCPM-2B
Community
The MiniCPM family of LLMs and VLLMs.
Mixtral-8x7B
Community
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
Moby
moby
The Moby Project - a collaborative project for the container ecosystem to assemble container-based systems
ModelFusion
Community
The TypeScript library for building AI applications.
OLMo-7B
Community
Artifacts for the first set of OLMo models.
OpenAGI
Community
OpenAGI: When LLM Meets Domain Experts
OpenELM-1.1|3B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
OpenLIT
Community
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with
pgvector
Community
Open-source vector similarity search for Postgres
Phi1-1.3B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Phi3-3.8|7|14B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Phidata
Community
Build, run, and manage agent platforms.
PromptPerfect
Community
PromptPerfect - AI Prompt Generator and Optimizer
Quiver
Community
Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama.
Qwen-1.8B|7B|14B|72B
Community
Qwen - a Qwen Collection
Qwen2-0.5B|1.5B|7B|57B-A14B-MoE|72B
Community
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction After months of efforts, we are pleased to announce the evolution from Qwen1.5 to Qwen2. This time, we bring to you: Pret
Qwen2-Math-1.5B|7B|72B
Community
GITHUB HUGGING FACE MODELSCOPE DISCORD 🚨 This model mainly supports English. We will release bilingual (English and Chinese) math models soon. Introduction Over the past year, w
R2R
Community
SoTA production-ready AI retrieval system. Agentic Retrieval-Augmented Generation (RAG) with a RESTful API.
RecurrentGemma-2B
Community
Open weights language model from Google DeepMind, based on Griffin.
Robocorp
Community
Create 🐍 Python AI Actions and 🤖 Automations, and deploy & operate them anywhere
RWKV-v4|5|6
Community
Org profile for RWKV on Hugging Face, the AI community building the future.
Semantic Kernel
Microsoft
Microsoft's enterprise-flavoured framework for AI agents. .NET-first, with Python and Java siblings.
simple-evals
Community
Eval tools by OpenAI.
StableLM-v2-12B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
StableLM-3B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Swiss Army Llama
Community
A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.
TutorGPT
Community
AI tutor powered by Theory-of-Mind reasoning
unslothai
Community
Unsloth Studio is a web UI for training and running open models like Gemma 4, Qwen3.6, DeepSeek, gpt-oss locally.
AGiXT
Community
AGiXT is a dynamic AI Agent Automation Platform that seamlessly orchestrates instruction management and complex task execution across diverse AI providers. Combining adaptive memor
Agentset
Various
The open-source platform to build AI apps that deliver reliable answers. Production-grade RAG in minutes, no expertise needed.
Cleanlab
Various
Check every AI response in real time with guardrails. Cleanlab detects hallucinations, missing context, and other issues by scoring each output for trust and accuracy.
GitHub Models
Various
Find and experiment with AI models to develop a generative AI application.
Grok
Various
An LLM by xAI with [open source](https://github.com/xai-org/grok-1) and open weights. #opensource
LibreChat
Various
LibreChat brings together all your AI conversations in one unified, customizable interface.
llama.cpp
Various
LLM inference in C/C++
LLaMA
Various
Llama LLM, a foundational, 65-billion-parameter large language model by Meta. Meta, February 23rd, 2023. #opensource
LLM Stats
Various
The LLM Leaderboard — independent ranking of GPT, Claude, Gemini, Llama, DeepSeek and 300+ AI models by intelligence, speed and price. Composite LLM Stats Score updated continuou
n8n
Various
n8n is a workflow automation platform that uniquely combines AI capabilities with business process automation, giving technical teams the flexibility of code with the speed of no
Open LLMs
Various
📋 A list of open LLMs available for commercial use.
OpenRouter LLM Rankings
Various
LLM rankings and AI leaderboard based on benchmarks and real usage data from millions of users. See which AI models developers actually use.
Qwen
Various
Qwickly forging AGI, enhancing intelligence.
Unsloth
Various
Unsloth is an open-source, no-code web UI for training, running and exporting open models in one unified local interface.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.
