Chroma
by Community
Search infrastructure for AI
OSS
Chroma
Added 1 June 2026
Overview
Chroma is an open-source vector database written in Rust that stores and retrieves embeddings for AI applications. It provides search infrastructure for semantic similarity queries, enabling developers to build retrieval-augmented generation (RAG) systems and vector-based search features without managing complex infrastructure.
Best for
Best for
Developers building RAG systems and semantic search features who want a straightforward, open-source vector store
Use cases
- Building RAG pipelines that retrieve relevant documents for LLM context
- Implementing semantic search across unstructured text or image embeddings
- Storing and querying high-dimensional vectors from embedding models
Notes
Chroma is an open-source vector database written in Rust that stores and retrieves embeddings for AI applications. It provides search infrastructure for semantic similarity queries, enabling developers to build retrieval-augmented generation (RAG) systems and vector-based search features without managing complex infrastructure.
28,173 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.
Use cases
- Building RAG pipelines that retrieve relevant documents for LLM context
- Implementing semantic search across unstructured text or image embeddings
- Storing and querying high-dimensional vectors from embedding models
Pros
- Open-source with active community support (28k+ GitHub stars)
- Lightweight and easy to integrate into Python applications
- Handles embedding storage and similarity search out of the box
Cons
- Rust backend may require additional deployment considerations for some teams
- Limited to vector operations, does not handle traditional relational queries
- Scaling to very large datasets may require external infrastructure decisions
Indexed from awesome-llmops and enriched against its public facts.
Pros
- Open-source with active community support (28k+ GitHub stars)
- Lightweight and easy to integrate into Python applications
- Handles embedding storage and similarity search out of the box
Cons
- Rust backend may require additional deployment considerations for some teams
- Limited to vector operations, does not handle traditional relational queries
- Scaling to very large datasets may require external infrastructure decisions
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Milvus
Community
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
Qdrant
Community
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Weaviate
Community
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance an
pgvector
Community
Open-source vector similarity search for Postgres
AgentForge
Community
Extensible AGI Framework
bgauryy/octocode-mcp
Various
MCP server for semantic code research and context generation on real-time using LLM patterns | Search naturally across public & private repos based on your permissions | Transform
nicholasglazer/gnosis-mcp
Various
Zero-config MCP server for searchable documentation (SQLite default, PostgreSQL optional)
rocketride-org/rocketride-server
Various
High-performance AI pipeline engine with a C++ core and 50+ Python-extensible nodes. Build, debug, and scale LLM workflows with 13+ model providers, 8+ vector databases, and agent
shinpr/mcp-local-rag
Various
Local-first RAG server for developers. Semantic + keyword search for code and technical docs. Works with MCP or CLI. Fully private, zero setup.
sirmews/mcp-pinecone
Various
Model Context Protocol server to allow for reading and writing from Pinecone. Rudimentary RAG
VoxellInc/forge-mcp
Various
[](https://glama.ai/mcp/servers/VoxellInc/forge-mcp) 🎖️ 📇 ☁️ - Official MCP server for Forge, Voxell's hosted text-embedding API. Generate vector embeddings (turbo 1024d, pro 256
Cheshire Cat
Community
AI agent microservice
Embedchain
Community
Universal memory layer for AI Agents
Knowledge GPT
Community
Accurate answers and instant citations for your documents.
Letta
Letta
Stateful agents with first-class memory. The continuation of MemGPT, productionised.
Llmware
Community
Unified framework for building enterprise RAG pipelines with small, specialized models
mem0
mem0
Memory layer for AI apps. Personalisation, continuity, and recall as a service.
MindSQL
Community
MindSQL: A Python Text-to-SQL RAG Library simplifying database interactions. Seamlessly integrates with PostgreSQL, MySQL, SQLite, Snowflake, and BigQuery. Powered by GPT-4 and Lla
Notion QA
Community
Notion Question-Answering Bot 
Private GPT
Community
Interact with your documents using the power of GPT, 100% privately, no data leaks
Semantic Cache Router
Community
Distributed semantic cache and stateful routing system that cuts LLM API costs by returning cached responses for semantically similar queries. Uses ANN vector search (cosine ≥ 0.8)
semantic-coverage
Community
Automated detection of knowledge gaps and blind spots in RAG vector stores.
ThinkGPT
Community
Agent techniques to augment your LLM and push it beyong its limits
LangChain
Various
LangChain provides the engineering platform and open source frameworks developers use to build, test, and deploy reliable AI agents.
privateGPT
Various
Interact with your documents using the power of GPT, 100% privately, no data leaks
chroma-core/chroma-mcp
Various
A Model Context Protocol (MCP) server implementation that provides database capabilities for Chroma
dpkdhingra91/aiia-mcp-server
Various
Official MCP server for AI Interview Agents — run the hiring workflow (roles, CV screening, interview scheduling, scored reports) from any MCP client.
ai-evaluation
Community
Evaluation Framework for all your AI related Workflows
Airweave
Community
Open-source context retrieval layer for AI agents
AutoRAG
Community
AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation
Awadb
Community
AI Native database for embedding vectors
currentslab/awesome-vector-search
Community
Collections of vector search related libraries, service and research papers
LlamaIndex
LlamaIndex
The data framework for LLM apps. RAG, ingestion, structured extraction, agents over your data.
LLMApp
Community
Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, re
OpenLIT
Community
Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with
PraisonAI
Community
PraisonAI 🦞 — Hire a 24/7 AI Workforce. Stop writing boilerplate and start shipping autonomous self-improving agents that research, plan, code, and execute tasks. Deployed in 5 li
RagTune
Community
EXPLAIN ANALYZE for RAG retrieval — inspect, debug, benchmark, and tune your retrieval layer
Search with Lepton
Community
Building a quick conversation-based search demo with Lepton AI.
talkd.ai dialog
Community
RAG LLM Ops App for easy deployment and testing
Text-Embeddings-Inference
Community
A blazing fast inference solution for text embeddings models
text-generation-inference
Community
Large Language Model Text Generation Inference
Vearch
Community
Distributed vector search for AI-native applications
AquilaDB
Community
An easy to use Neural Search Engine. Index latent vectors along with JSON metadata and do efficient k-NN search.
Awadb
Community
AI Native database for embedding vectors
deeplake
Community
Deeplake is AI Data Runtime for Agents. It provides serverless postgres with a multimodal datalake, enabling scalable retrieval and training.
Lancedb
Community
Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.
Marqo
Community
Ecommerce Search and Discovery - marqo.ai
Milvus
Community
Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search
pgvector
Community
Open-source vector similarity search for Postgres
Pinecone
Community
Search through billions of items for similar matches to any object, in milliseconds. It’s the next generation of search, an API call away.
Qdrant
Community
Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/
Rivestack
Community
Managed pgvector on dedicated PostgreSQL with NVMe storage. 2,000 QPS at sub-4ms p50, from $35/month, migration help from Supabase, Neon, Pinecone, and self-hosted.
Vald
Community
Vald. A Highly Scalable Distributed Vector Search Engine
Vearch
Community
Distributed vector search for AI-native applications
VectorDB
Community
A Python vector database you just need - no more, no less.
Weaviate
Community
Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance an
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.