LangChain

LLM inference in C/C++

A high-throughput and memory-efficient inference and serving engine for LLMs

Search infrastructure for AI

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Milvus is a high-performance, cloud-native vector database built for scalable vector ANN search

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

Build AI Agents, Visually

Production-ready platform for agentic workflow development.

A Javascript AI getting started stack for weekend projects, including image/text models, vector stores, auth, and deployment configs

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

An autonomous HR agent that can answer user queries using tools

Document Chatbot — multiple files. Powered by GPT / Embedding.

🦜🔗 A Codespaces template for getting up-and-running with LangChain in seconds!

The open agent control plane. Govern autonomous AI agents with pre-execution policy enforcement, approval gates, and audit trails. Works with LangChain, CrewAI, MCP, and any framew

Build full-stack, type-safe, LLM-powered apps with the T3 Stack, Turborepo, OpenAI, and Langchain

Role-based multi-agent framework. Define crews of agents with roles, goals, and tasks, run them as a team.

Production-ready platform for agentic workflow development.

Distilabel is a framework for synthetic data and AI feedback for engineers who need fast, reliable and scalable pipelines based on verified research papers.

FinRobot: An Open-Source AI Agent Platform for Financial Analysis using LLMs 🚀 🚀 🚀

Build AI Agents, Visually

Accurate answers and instant citations for your documents.

The web framework for building LLM microservices [deprecated]

LangChain LLM chat with streaming response over websockets

Jupyter Notebooks to help you get hands-on with Pinecone vector databases

Search and indexing your own Google Drive Files using GPT3, LangChain, and Python

Overview and tutorial of the LangChain Library

Visualization and debugging tool for LangChain workflows

End-to-end LangChain JS learning repo with real examples: prompts, tools, RAG, agents, and LangGraph workflows.

Multi-modal LLM observability and evaluation platform. Create prompt templates, deploy prompts versions, debug LLM runs, create datasets, run evaluations, monitor LLM metrics and c

A library of data loaders for LLMs made by the community -- to be used with LlamaIndex and/or LangChain

Code for the paper: "Large Language Models as Corporate Lobbyists" (2023).

Deploy LangChain Agents and connect them to Telegram

This code is an implementation of a chatbot using LLM chat model API and Langchain.

Build, run, and manage agent platforms.

Version, test, and monitor every prompt and agent with robust evals, tracing, and regression sets. Empower domain experts to collaborate in the visual editor.

Supercharge Your LLM Application Evaluations 🚀

EXPLAIN ANALYZE for RAG retrieval — inspect, debug, benchmark, and tune your retrieval layer

💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram

🧠 Second Brain AI agent

template for how to deploy a LangChain on Streamlit 

Google Colab

An Open-Ended Embodied Agent with Large Language Models

Evaluation tool for LLM QA chains

AutoGPT is the vision of accessible AI for everyone, to use and to build on. Our mission is to provide the tools, so that you can focus on what matters.

[Large Language Models Course](https://github.com/peremartra/Large-Language-Model-Notebooks-Course) ![GitHub Repo stars](https://img.shields.io/github/stars/peremartra/Large-Langua

locally hosted chatbot specifically focused on question answering over the LangChain documentation ![GitHub Repo stars](https://img.shields.io/github/stars/hwchase17/chat-langchain

LangChain chat model abstractions for dynamic failover, load balancing, chaos engineering, and more!

Document Chatbot — multiple files. Powered by GPT / Embedding.

Home - Docs by LangChain

Build full-stack, type-safe, LLM-powered apps with the T3 Stack, Turborepo, OpenAI, and Langchain

LangChain provides create_agent: a minimal, highly configurable agent harness. Compose exactly the agent your use case needs from model, tools, prompt, and middleware.

Ask questions about any data source by leveraging langchains

open-source agentic AI data assistant for the next generation of AI + Data products.

🤖 Create LLM agents in a second with your prompts. Everything you need to create an LLM Agent - tools, prompts, frameworks, and models - all in one place.

Build AI Agents, Visually

An autonomous agent that conducts deep research on any data using any LLM providers

template for how to deploy a LangChain on Gradio 

Multi-Agent Harness for Production AI

Autonomous GPT-4 agent platform

⚡ Langchain apps in production using Jina & FastAPI

Accurate answers and instant citations for your documents.

A lightweight framework for building LLM-based agents

LangChain LLM chat with streaming response over websockets

Langchain-Chatchat（原Langchain-ChatGLM）基于 Langchain 与 ChatGLM, Qwen 与 Llama 等语言模型的 RAG 与 Agent 应用 | Langchain-Chatchat (formerly langchain-ChatGLM), local knowledge based LLM (like

This is a LangChain LLM template that allows you to train your own custom AI LLM.

syntactic sugar 🍭 for langchain

A sample streamlit application summarizing text using LangChain 

Langchain tools to search/extract/transcribe text transcripts of Youtube videos. Some of this has been integrated into LangChain main branch

Langflow is a powerful tool for building and deploying AI-powered agents and workflows.

Graph-based orchestration for long-running, multi-step agents. The control plane LangChain always needed.

LangServe 🦜️🏓

End-to-end LangChain JS learning repo with real examples: prompts, tools, RAG, agents, and LangGraph workflows.

LLocalSearch is a completely locally running search aggregator using LLM Agents. The user can ask a question and the system will use a chain of LLMs to find the answer. The user ca

Notion Question-Answering Bot 

LLM Chain for answering questions from documents with citations 

This code is an implementation of a chatbot using LLM chat model API and Langchain.

Interact with your documents using the power of GPT, 100% privately, no data leaks

CLI based natural language queries on local or remote data

Opiniated RAG for integrating GenAI in your apps 🧠 Focus on your product rather than the RAG. Easy integration in existing products with customisation! Any LLM: GPT4, Groq, Llama.

💬 RasaGPT is the first headless LLM chatbot platform built on top of Rasa and Langchain. Built w/ Rasa, FastAPI, Langchain, LlamaIndex, SQLModel, pgvector, ngrok, telegram

An LLM-based autonomous agent controlling real-world applications via RESTful APIs

AI chatbot 🤖 for chat with CSV, PDF, TXT files 📄 and YTB videos 🎥 | using Langchain🦜 | OpenAI | Streamlit ⚡

🧠 Second Brain AI agent

SuperAGI - A dev-first open source autonomous AI agent framework. Enabling developers to build, manage & run useful autonomous agents quickly and reliably.

AI tutor powered by Theory-of-Mind reasoning

Building the future of work, with Sauna

A security scanner for your LLM agentic workflows

Arize Phoenix: Open Source AI Development Platform

Open-source toolkit for building, testing, and monitoring AI agents. Version prompts, run experiments, trace workflows, and catch issues before users do.

AutoRAG: An Open-Source Framework for Retrieval-Augmented Generation (RAG) Evaluation & Optimization with AutoML-Style Automation

The paper list of the review on LLMs in medicine - "Large Language Models Illuminate a Progressive Pathway to Artificial Healthcare Assistant: A Review".

A collection of open source, actively maintained web apps for LLM applications

BigScience

A Python library for making chatbot interfaces.

Search infrastructure for AI

Cohere's text summarization endpoint, Summarize Beta, uses generative AI and offers concise and accurate text summaries.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Context Engine for your long-running AI agents

A command-line interface to generate textual and conversational datasets with LLMs.

DeepSeek Math series

DeepSeek-VL model series

Programming, not prompting. Declare what you want, compile prompts and weights against an objective.

Universal memory layer for AI Agents

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Fiddler Auditor is a tool to evaluate language models.

🐢 Open-Source Evaluation & Testing library for LLM Agents

Semantic cache for LLMs. Fully integrated with LangChain and llamaindex.

Learn about Guardrails AI and how it helps build reliable AI applications

🧊 Open source LLM observability platform. One line of code to monitor, evaluate, and experiment. YC W23 🍓

Humanloop is joining Anthropic to accelerate the adoption of AI, safely.

Prompt management gateway with a UI for AI-powered applications. Enables non-technical users to test, refine, and deploy prompts seamlessly across multiple AI providers.

Open source project for data preparation for GenAI applications

Publications — Google DeepMind

Durable workflows for agents. Step functions, event-driven runs, retries, all without managing a queue.

Structured output for LLMs via Pydantic. The cleanest answer to 'just give me a typed object back'.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Build multi-model chatbots and agents from intent.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Make your LLM agent and chat with it simple and fast!

Unify observability, evals, prompt optimization, and your LLM gateway in one platform.

Open-source platform layer for AI agents in production

A lightweight framework for building LLM-based agents

Laminar - open-source observability platform purpose-built for AI agents. YC S24.

2022-01

Developer-friendly OSS embedded retrieval library for multimodal AI. Search More; Manage Less.

LangChain 的中文入门教程

Visualization and debugging tool for LangChain workflows

LangFair is a Python library for conducting use-case level LLM bias and fairness assessments

Open-source LLM observability. Traces, evals, prompt management, all self-hostable.

🔍 LangKit: An open-source toolkit for monitoring Large Language Models (LLMs). 📚 Extracts signals from prompts & responses, ensuring safety & security. 🛡️ Features include text

Complete AI agent and LLM observability platform with tracing and real-time monitoring. Debug agents, find failures fast, and track costs and latency.

Microsoft

[OPT-1.3 6.7 13 30 66B](https://arxiv.org/abs/2205.01068)

2023-07

[Llama 3.1-8 70 405B](https://llama.meta.com/)

2023-02

The React library for LLMs

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, re

Observability and prompt management for LLM chabots and agents. Debug agents with powerful tracing and logging. Usage analytics and dive deep into the history of your requests. Dev

Your all-in-one prompt management and observability platform. Craft, track, and perfect your LLM prompts with ease.

Memory layer for AI apps. Personalisation, continuity, and recall as a service.

The most powerful AI platform for enterprises. Customize, fine-tune, and deploy AI assistants, autonomous agents, and multimodal AI with open models.

About OneKEOneKE is a new v...


OpenAGI: When LLM Meets Domain Experts

Pushing the frontier of cost-effective reasoning.

Open source platform for AI Engineering: OpenTelemetry-native LLM Observability, GPU Monitoring, Guardrails, Evaluations, Prompt Management, Vault, Playground. 🚀💻 Integrates with

Debug, evaluate, and monitor your LLM applications, RAG systems, and agentic workflows with comprehensive tracing, automated evaluations, and production-ready dashboards.

Structured Outputs

The experimentation and human annotation platform for AI teams.

🕹️ Open-source, developer-first LLMOps platform designed to streamline prompt design, version management, instant delivery, collaboration, troubleshooting, observability and more.

Open-source vector similarity search for Postgres

A toolkit for detecting and protecting against vulnerabilities in Large Language Models (LLMs).

Democratize and productionize Gen AI across your entire org with Portkey

Markdown for the AI era

Test your prompts, agents, and RAGs. Red teaming/pentesting/vulnerability scanning for AI. Compare performance of GPT, Claude, Gemini, DeepSeek, and more. Simple declarative config

Test, deploy, and manage your prompts with PromptHub, a prompt management tool for teams. Keep your prompts organized and leverage top-tier templates to get more out of AI.

Prompt Engineering | Prompt Versioning | Use GPT or other prompt based models to get structured output. Join our discord for Prompt-Engineering, LLMs and other latest research

simplifies the process of creating and managing LLM workflows.

PromptSite is a lightweight prompt version management package that helps you version control, track, experiment and debug with your LLM prompts with ease.

AISecOps (AI Security Operations) framework for deterministic verification of AI systems. QWED verifies LLM outputs using math, logic, and symbolic execution — creating an auditabl

Handle OpenAI Errors (overloaded OpenAI servers, rotated keys, or context window errors) for your production LLM Applications.

The testing platform for AI teams. Bring engineers, PMs, and domain experts together to generate tests, simulate (adversarial) conversations, and trace every failure to its root ca

Lightweight LLM Interaction Framework

Managed pgvector on dedicated PostgreSQL with NVMe storage. 2,000 QPS at sub-4ms p50, from $35/month, migration help from Supabase, Neon, Pinecone, and self-hosted.

The open-source visual AI programming environment and TypeScript library

Accelerate and scale Generative AI across your enterprise with the platform to transform your data into customized enterprise-ready Generative AI applications.

Distributed semantic cache and stateful routing system that cuts LLM API costs by returning cached responses for semantically similar queries. Uses ANN vector search (cosine ≥ 0.8)

Automated detection of knowledge gaps and blind spots in RAG vector stores.

Open-source memory runtime for AI agents — reproducible, provenance-tagged context bundles instead of query-time retrieval. Apache-2.0, self-hosted on Postgres + pgvector, Python +

Superagent protects your AI applications against prompt injections, data leaks, and harmful outputs. Embed safety directly into your app and prove compliance to your customers.

A FastAPI service for semantic text search using precomputed embeddings and advanced similarity measures, with built-in support for various file types through textract.

Durable execution at enterprise scale. The control plane that survives anything.

A blazing fast inference solution for text embeddings models

Large Language Model Text Generation Inference

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

Modern artificial intelligence (AI) systems are powered by foundation models. This paper presents a new set of foundation models, called Llama 3. It is a herd of language models

A central, open resource for data and tools related to chain-of-thought reasoning in large language models. Developed @ Samwald research group: https://samwald.info/

Open Source AI Tracing Framework built on Opentelemetry for AI Applications and Frameworks

Distributed vector search for AI-native applications

Project webpage for the VisualWebArena paper.

A high-throughput and memory-efficient inference and serving engine for LLMs

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance an

Use ChatGPT On Wechat via wechaty

W&B Weave helps developers evaluate, monitor, and iterate continuously to deliver generative AI applications with confidence.

Build, personalize and control your own LLMs. From data pre-processing to fine-tuning, xTuring provides an easy way to personalize open-source LLMs. Join our discord community: htt

[Langchain Blog](https://blog.langchain.dev/): The Official Langchain blog

Amazon.com

Google&Princeton

AdalFlow: The library to build & auto-optimize LLM applications.

We’re on a journey to advance and democratize artificial intelligence through open source and open science.

An all-in-one LLM Agent platform with your private data and knowledge, delivers your production-ready AI Agents on Day 1.

Create agentic, context engineered AI systems using Haystack’s modular and customizable building blocks, built for real-world, production-ready applications.

Build multi-model chatbots and agents from intent.

Harness LLMs with Multi-Agent Programming

Easiest and laziest way for building multi-agent LLMs applications.

Build robust LLM applications with true composability 🔗

The data framework for LLM apps. RAG, ingestion, structured extraction, agents over your data.

A light-weight framework for creating applications using LLMs

llm-chain is a powerful rust crate for building chains in large language models allowing you to summarise text and complete complex tasks

Unified framework for building enterprise RAG pipelines with small, specialized models

TypeScript-first agent framework. Workflows, agents, tools, memory, evals, in one consistent shape.

A tiny library for coding with large language models.

The TypeScript library for building AI applications.

OpenAGI: When LLM Meets Domain Experts

Lightweight LLM Interaction Framework

Microsoft's enterprise-flavoured framework for AI agents. .NET-first, with Python and Java siblings.

TypeChat is a library that makes it easy to build natural language interfaces using types.

The de facto TypeScript SDK for AI apps. Streaming, tools, multi-model, and now an agent loop.