Open Source
FastChat
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Our verdict
We have not reviewed FastChat yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About FastChat
FastChat is an open-source Python framework for training, serving, and evaluating large language models. It provides infrastructure for model deployment and includes Vicuna (a fine-tuned LLM) and Chatbot Arena (a benchmark for comparing model outputs). Built for researchers and developers who need end-to-end LLM workflows beyond inference alone.
Best for
Researchers and ML engineers building custom LLM applications who need training, serving, and evaluation in one framework.
Use cases
- Fine-tuning and training custom language models
- Serving multiple LLMs in production with a unified API
- Benchmarking and comparing model performance across variants
Notes
39,479 stars on GitHub. Last updated 2026-05-01. Licensed Apache-2.0.
Pros
- Complete pipeline from training through evaluation, not just inference
- Includes Chatbot Arena for human-in-the-loop model comparison
- Active community project with 39k+ stars and ongoing maintenance
Cons
- Requires Python expertise and infrastructure setup for training workflows
- Primarily research-focused, less polished than commercial LLM platforms
- Evaluation tools depend on external judge models, adding latency and cost
Key facts
What we have checked
- Latest version
- 0.2.36 (released 11 Feb 2024)
- GitHub stars
- 39,552
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How FastChat is growing
39,479 to 39,552
Alternatives
Alternatives to FastChat
| Record | Type | How we know | Checked |
|---|---|---|---|
| FlagAIAlternative to this | Open source | Named in the listing | Not dated |
| LiteLLMAlternative to this | Open source | Named in the listing | Not dated |
| Modelz-LLMAlternative to this | Open source | Named in the listing | Not dated |
| ray-llmAlternative to this | Open source | Named in the listing | Not dated |
| LMDeployThis is an alternative to it | Open source | Named in the listing | Not dated |
| SGLangThis is an alternative to it | Open source | Named in the listing | Not dated |
| vLLMThis is an alternative to it | Open source | Named in the listing | Not dated |
Compare
Compare FastChat side by side
Sources
Where this comes from
- GitHubOfficial
- github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438Registry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Released 0.2.36
Released 0.2.35
Released 0.2.34
Released 0.2.33
Released 0.2.32
Released 0.2.30
Released 0.2.28
Released 0.2.25
Released 0.2.22
Released 0.2.18
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
LMDeploy
Community
LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
SGLang
Community
SGLang is a high-performance serving framework for large language models and multimodal models.
vLLM
Community
A high-throughput and memory-efficient inference and serving engine for LLMs
FlagAI
Community
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
LiteLLM
BerriAI
A Python SDK and a self-hosted proxy, the LiteLLM AI Gateway, that let apps call more than 100 model providers through one OpenAI-format API, with virtual keys, budgets, fallbacks and spend tracking.
Modelz-LLM
Community
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
ray-llm
Community
RayLLM - LLMs on Ray (Archived). Read README for more info.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Chatbot Arena Leaderboard
Community
Open this page to see the LMArena leaderboard displayed in a full‑screen view. No input is needed; the app loads the leaderboard website inside an iframe so you can browse the ra
OLMo-7B
Community
Artifacts for the first set of OLMo models.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.