Open Source Alternatives
Open source alternatives to OpenLLM
Open source alternatives to OpenLLM, ranked by GitHub stars and freshness.
4 open-source alternatives in the index, ranked by GitHub stars and freshness.
vLLM
Community
A high-throughput and memory-efficient inference and serving engine for LLMs
Best for: Teams building production LLM APIs and services that need to maximize throughput and minimize latency under concurrent load.
FastChat
Community
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
Best for: Researchers and ML engineers building custom LLM applications who need training, serving, and evaluation in one framework.
IntelliServer
Community
AI models as scalable microservices, enabling evaluation of LLMs and offering end-to-end functions such as chatbot, semantic search, image generation and beyond.
Best for: JavaScript developers who need a simple microservice wrapper for deploying and evaluating AI models
TGI
Community
We’re on a journey to advance and democratize artificial intelligence through open source and open science.
Best for: Developers and teams who need to self-host or fine-tune open-source LLMs at scale