ollama
by Community
Get up and running with Kimi-K2.5, GLM-5, MiniMax, DeepSeek, gpt-oss, Qwen, Gemma and other models.
OSS
ollama
Added 1 June 2026
Overview
Ollama is a Go-based framework for running large language models locally on your machine. It downloads and executes open-source models like Llama, Mistral, and others without requiring cloud infrastructure or API keys.
Best for
Best for
Developers building local-first applications or prototyping with open-source LLMs without cloud costs
Use cases
- Running LLMs offline for privacy-sensitive applications
- Local development and testing before deploying to production
- Building chatbots and agents that don't depend on external APIs
Notes
Ollama is a Go-based framework for running large language models locally on your machine. It downloads and executes open-source models like Llama, Mistral, and others without requiring cloud infrastructure or API keys.
172,846 stars on GitHub. Last updated 2026-06-01. Licensed MIT.
Use cases
- Running LLMs offline for privacy-sensitive applications
- Local development and testing before deploying to production
- Building chatbots and agents that don’t depend on external APIs
Pros
- No cloud dependency or API costs once models are downloaded
- Simple CLI interface with minimal setup overhead
- Supports a wide range of open-source models with one-command installation
Cons
- Requires significant local compute and storage for larger models
- Performance depends entirely on your hardware, not optimized cloud infrastructure
- Limited to open-source models, no access to proprietary models like GPT-4
Indexed from awesome-llm and enriched against its public facts.
Pros
- No cloud dependency or API costs once models are downloaded
- Simple CLI interface with minimal setup overhead
- Supports a wide range of open-source models with one-command installation
Cons
- Requires significant local compute and storage for larger models
- Performance depends entirely on your hardware, not optimized cloud infrastructure
- Limited to open-source models, no access to proprietary models like GPT-4
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Open WebUI
Various
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
Anything LLM
Community
The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.
privateGPT
Various
Interact with your documents using the power of GPT, 100% privately, no data leaks
Continue
Continue.dev
Open-source AI code assistant for VS Code and JetBrains. Customisable, BYO model, built for enterprise.
AgentForge
Community
Extensible AGI Framework
Cline
Cline
Open-source autonomous coding agent that lives inside VS Code. BYO model key, watch it work.
gpt-migrate
Community
Easily migrate your codebase from one language or framework to another.
memfree
Community
Welcome to the MemFree documentation.
openinterpreter
Community
Interpreter lets you work alongside agents that can edit your documents, fill PDF forms, and more.
wispy
Community
Chrome extension
AiAgentKarl/solana-mcp-server
Various
MCP-Server für Solana-Blockchain-Daten — Wallets, Token-Preise, DeFi-Yields, Sicherheitschecks
can4hou6joeng4/boss-agent-cli
Various
AI-agent-first CLI for BOSS 直聘 — 职位搜索、福利筛选、招聘者工作流、MCP 工具与 AI 简历优化
dcostenco/prism-mcp
Various
The Mind Palace for AI Agents - HIPAA-hardened Cognitive Architecture with on-device LLM (prism-coder:7b), Hebbian learning, ACT-R spreading activation, adversarial evaluation, per
elvismdev/mem0-mcp-selfhosted
Various
Self-hosted mem0 MCP server for Claude Code. Run a complete memory server against self-hosted Qdrant + Neo4j + Ollama while using Claude as the main LLM.
escapeboy/agent-fleet-o
Various
Open-source AI agent orchestration platform — self-hosted mission control for autonomous multi-agent systems. Visual DAG workflows, 450+ MCP tools, human-in-the-loop approvals. Wor
JamesANZ/cross-llm-mcp
Various
A Model Context Protocol (MCP) server that provides access to multiple Large Language Model (LLM) APIs including ChatGPT, Claude, Gemini, Mistral, Kimi K2, and DeepSeek.
jaspertvdm/mcp-server-ollama-bridge
Various
MCP Server - Bridge to local Ollama LLM. Part of HumoticaOS/SymbAIon ecosystem.
juergenkoller-software/distill-mcp
Various
Open-source MCP server bridge for Distill — let Claude/Cursor rename your files based on content (AI: Claude/OpenAI/Gemini/Ollama/Apple).
lpigeon/ros-mcp-server
Various
Connect AI models like Claude & GPT with robots using MCP and ROS.
Michael-WhiteCapData/ollama-handoff
Various
MCP server that offloads cheap work from your cloud LLM agent to a local Ollama model — summaries, drafts, extractions, first-pass reviews — at zero cloud cost.
pyroprompts/any-chat-completions-mcp
Various
MCP Server for using any LLM as a Tool
shinpr/mcp-local-rag
Various
Local-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
spranab/brainstorm-mcp
Various
MCP server for multi-round AI brainstorming debates between multiple models (GPT, DeepSeek, Groq, Ollama, etc.)
Sudhan30/freshprobe
Various
Data freshness verification for AI agents. Probes endpoints for cache staleness, latency, TLS health, and content changes. CLI + MCP server + HTTP API.
SureScaleAI/openai-gpt-image-mcp
Various
📇 ☁️ - OpenAI GPT image generation/editing MCP server.
TKMD/ReftrixMCP
Various
MCP server with 39 tools for web design analysis — layout extraction, motion detection, quality scoring, accessibility audit, Core Web Vitals, design comparison, and semantic searc
VrtxOmega/Ollama-Omega
Various
Sovereign Ollama Bridge — MCP server for local and cloud Ollama models. Generated by Qwen 3.5 397B.
Anything LLM
Community
The all-in-one AI productivity accelerator. On device and privacy first with no annoying setup or configuration.
Cheshire Cat
Community
AI agent microservice
Codestral-7|22B
Community
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
DeepSeek-R1
Community
First-generation reasoning models from DeepSeek.
deploy-llms-with-ansible
Community
Easily deploy LLMs with Ansible. Uses Docker with llama.cpp or ollama. Secured with whitelisted IPs.
Dify
Community
Production-ready platform for agentic workflow development.
DocsGPT
Community
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
LiteChain
Community
Build robust LLM applications with true composability 🔗
LLocalSearch
Community
LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user ca
Lobe Chat
Community
🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.
Local GPT
Community
Chat with your documents on your local device using GPT models. No data leaves your device and 100% private.
MetaGPT
Community
🌟 The Multi-Agent Framework: First AI Software Company, Towards Natural Language Programming
OpenDAN
Community
OpenDAN is an open source Personal AI OS , which consolidates various AI modules in one place for your personal use.
Private GPT
Community
Interact with your documents using the power of GPT, 100% privately, no data leaks
QA-Pilot
Community
QA-Pilot is an interactive chat project that leverages online/local LLM for rapid understanding and navigation of GitHub code repository.
Shell-Pilot
Community
A simple, lightweight shell script to interact with OpenAI or Ollama or Mistral AI or LocalAI or ZhipuAI from the terminal, and enhancing intelligent system management without any
SwarmClaw
Community
Open-source self-hosted AI agent runtime and multi-agent framework for autonomous agent swarms. Agent memory, MCP tools, schedules, delegation, and 23+ LLM providers (Claude, GPT,
Agentset
Various
The open-source platform to build AI apps that deliver reliable answers. Production-grade RAG in minutes, no expertise needed.
ai-i18n
Various
ai-i18n is a GitHub Action that translates your app's i18n files using LLMs. It extracts strings, translates only what's changed, and commits the results back to your repo. Works w
AutoGen
Various
A programming framework for agentic AI
GitHub Copilot
Various
Today, we're launching a technical preview of GitHub Copilot, a new AI pair programmer that helps you write better code.
Jenni
Various
Jenni is an AI research and academic writing assistant that helps students, researchers, and academics create essays, papers, and citations with ease.
Kilo
Various
Kilo is the open source AI coding agent for VS Code, JetBrains, CLI, and Cloud. Access 500+ models, bring your own keys at zero markup, and keep code private with local models.
LangChain
Various
LangChain provides the engineering platform and open source frameworks developers use to build, test, and deploy reliable AI agents.
LibreChat
Various
LibreChat brings together all your AI conversations in one unified, customizable interface.
Local Deep Research
Various
~95% on SimpleQA (e.g. Qwen3.6-27B on a 3090). Supports all local and cloud LLMs (llama.cpp, Ollama, Google, ...). 10+ search engines - arXiv, PubMed, your private documents. Every
n8n
Various
n8n is a workflow automation platform that uniquely combines AI capabilities with business process automation, giving technical teams the flexibility of code with the speed of no
Open WebUI
Various
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
RunThisLLM
Various
Find out exactly what hardware you need to run any local LLM, image, video, or audio AI model. 275+ models with full build specs and performance estimates.
Cody
Community
Cody the coding ai assistant
Gpt Runner
Community
Conversations with your files! Manage and run your AI presets!
mrslbt/rippr
Various
YouTube transcript ripper for RAG, LLM workflows, and AI research. Chrome extension. Multiple output formats
ypollak2/llm-router
Various
Universal LLM router for AI coding tools. Works with Claude Code, Cursor, Codex, Gemini CLI, Copilot and more. Free-first fallback chain keeps costs 70–85% lower.
AutoGen
Microsoft
Microsoft's framework for multi-agent conversations. Agents that talk to each other to solve hard problems.
Chaindesk
Community
The no-code platform for building custom LLM Agents
Chainlit
Community
A Python library for making chatbot interfaces.
ChatAbstractions
Community
LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!
chatgpt-wrapper
Community
Power CLI and Workflow manager for LLMs (core package)
CrewAI
CrewAI
Role-based multi-agent framework. Define crews of agents with roles, goals, and tasks, run them as a team.
DeepSeek-Math-7B
Community
DeepSeek Math series
DeepSeek-V2.5
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
DeepSeek-VL-1.3|7B
Community
DeepSeek-VL model series
Flowise
Community
Build AI Agents, Visually
Future AGI
Community
Production-grade AI evaluation, prompt management & observability SDK. Automated evaluations with sub-100ms guardrails. No human-in-the-loop required. Python + TypeScript.
Gemma2-9|27B
Community
Gemma 2, our next generation of open models, is now available globally for researchers and developers.
Google "We Have No Moat, And Neither Does OpenAI"
Community
Leaked Internal Google Document Claims Open Source AI Will Outcompete Google and OpenAI
Haystack
Community
Create agentic, context engineered AI systems using Haystack’s modular and customizable building blocks, built for real-world, production-ready applications.
InternLM2-1.8|7|20B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Kimi-K2
Community
Kimi K2 is the large language model series developed by Moonshot AI team
Langchain-Chatchat
Community
Langchain-Chatchat(原Langchain-ChatGLM)基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like
LiteLLM 🚅
Community
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, Vertex
Llama 3.2-1|3|11|90B
Community
[Llama 3.1-8 70 405B](https://llama.meta.com/)
llama.cpp
Community
LLM inference in C/C++
LlamaIndex
LlamaIndex
The data framework for LLM apps. RAG, ingestion, structured extraction, agents over your data.
llm-ui
Community
The React library for LLMs
Llmware
Community
Unified framework for building enterprise RAG pipelines with small, specialized models
Mastra
Mastra
TypeScript-first agent framework. Workflows, agents, tools, memory, evals, in one consistent shape.
Mixtral-8x7B
Community
The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.
OLMo-7B
Community
Artifacts for the first set of OLMo models.
open-r1
Community
Fully open reproduction of DeepSeek-R1
Phi1-1.3B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Phi3-3.8|7|14B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Qwen-VL-7B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Qwen2-0.5B|1.5B|7B|57B-A14B-MoE|72B
Community
GITHUB HUGGING FACE MODELSCOPE DEMO DISCORD Introduction After months of efforts, we are pleased to announce the evolution from Qwen1.5 to Qwen2. This time, we bring to you: Pret
Qwen-1.8B|7B|14B|72B
Community
Qwen - a Qwen Collection
Qwen2-Math-1.5B|7B|72B
Community
GITHUB HUGGING FACE MODELSCOPE DISCORD 🚨 This model mainly supports English. We will release bilingual (English and Chinese) math models soon. Introduction Over the past year, w
Rigging
Community
Lightweight LLM Interaction Framework
Shimmy
Community
⚡ Python-free Rust inference server — OpenAI-API compatible. GGUF + SafeTensors, hot model swap, auto-discovery, single binary. FREE now, FREE forever.
StableLM-3B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
StableLM-v2-12B
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
TreeScale
Community
TreeScale Platform is an All in One solution to use LLM Prompts to build powerful APIs and integrate them with your favorite tools and services.
TutorGPT
Community
AI tutor powered by Theory-of-Mind reasoning
Vercel AI SDK
Vercel
The de facto TypeScript SDK for AI apps. Streaming, tools, multi-model, and now an agent loop.
Chatbot UI
Various
Chatbot UI
Cursor
Cursor
AI-first code editor with deep contextual understanding. Write, edit, and refactor code by talking to your editor.
DeepSeek
Various
Org profile for DeepSeek on Hugging Face, the AI community building the future.
Open Interpreter
Various
A natural language interface for computers
Open LLMs
Various
📋 A list of open LLMs available for commercial use.
RooCode
Various
Roo Code gives you a whole dev team of AI agents in your code editor.
Unsloth
Various
Unsloth is an open-source, no-code web UI for training, running and exporting open models in one unified local interface.
inference.sh
ac.inference.sh
Run 150+ AI apps — image, video, audio, LLMs, 3D and more. Browse, execute, stream results.
mistral.rs
Community
Fast, flexible LLM inference
OpenLLM
Community
Run any open-source LLMs, such as DeepSeek and Llama, as OpenAI compatible API endpoint in the cloud.
Rapid-MLX
Community
The fastest local AI engine for Apple Silicon. 4.2x faster than Ollama, 0.08s cached TTFT, 100% tool calling. 17 tool parsers, prompt cache, reasoning separation, cloud routing. Dr
LLM
Various
LLM: A CLI utility and Python library for interacting with Large Language Models
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.