Our verdict
We have not reviewed ray-llm yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About ray-llm
RayLLM is a community archive repository offering tools for running large language models on the Ray distributed compute framework. The README provides specific setup and usage details, but the project is no longer actively maintained.
Best for
Developers already using Ray who need legacy code or patterns for running LLMs at scale.
Use cases
- Deploying open-source LLMs on a Ray cluster
- Scaling LLM inference across multiple nodes
- Testing Ray-based orchestration for model serving
Notes
1,267 stars on GitHub. Last updated 2025-03-13.
Pros
- Leverages Ray's distributed computing for large models
- Open source with a public archive for reference
- Straightforward integration with Ray ecosystem
Cons
- Archived and not actively maintained or updated
- Limited community support beyond existing documentation
- May lack compatibility with newer Ray versions or LLM frameworks
Key facts
What we have checked
- Latest version
- 0.5.0 (released 18 Jan 2024)
- GitHub stars
- 1,261
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How ray-llm is growing
1,267 to 1,261
Alternatives
Alternatives to ray-llm
| Record | Type | How we know | Checked |
|---|---|---|---|
| FastChatThis is an alternative to it | Open source | Named in the listing | Not dated |
| SGLangThis is an alternative to it | Open source | Named in the listing | Not dated |
| vLLMThis is an alternative to it | Open source | Named in the listing | Not dated |
Compare
Compare ray-llm side by side
Sources
Where this comes from
- GitHubOfficial
- github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438Registry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Released 0.5.0
Released 0.4.0
Released 0.3.1
Released 0.3.0
Released 0.2.0
Released 0.1.2
Released 0.1.1
Released 0.1.0
Released 0.0.3
Released 0.0.2
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
FastChat
Community
An open platform for training, serving, and evaluating large language models. Release repo for Vicuna and Chatbot Arena.
SGLang
Community
SGLang is a high-performance serving framework for large language models and multimodal models.
vLLM
Community
A high-throughput and memory-efficient inference and serving engine for LLMs
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.