Open Source Alternatives
Open source alternatives to FastChat
Open source alternatives to FastChat, ranked by GitHub stars and freshness.
4 open-source alternatives in the index, ranked by GitHub stars and freshness.
LiteLLM π
Community
Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, Vertex
Alternative to Fastchat
Best for: Teams managing multiple LLM providers or needing cost visibility across model calls
FlagAI
Community
FlagAI (Fast LArge-scale General AI models) is a fast, easy-to-use and extensible toolkit for large-scale model.
Alternative to Fastchat, Colossal Ai
Best for: Developers who need a Python toolkit for training and deploying large-scale models with built-in parallelism
ray-llm
Community
RayLLM - LLMs on Ray (Archived). Read README for more info.
Alternative to Vllm, Fastchat, Sglang
Best for: Developers already using Ray who need legacy code or patterns for running LLMs at scale.
Modelz-LLM
Community
OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)
Alternative to Litellm, Fastchat
Best for: Developers who want to experiment with open-source LLMs using familiar OpenAI API patterns