Open Source
Self-Hosted AI Stack
Deploy a complete self-hosted AI stack with Docker Compose: Ollama, LiteLLM, AnythingLLM, Whisper, WhisperLive, Kokoro, Embeddings, Docling and MCP Gateway.
Our verdict
We have not reviewed Self-Hosted AI Stack yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About Self-Hosted AI Stack
A Docker Compose stack for deploying a self-hosted AI environment with Ollama, LiteLLM, AnythingLLM, Whisper, and other components. Local-first and private by default, with optional HTTPS and NVIDIA CUDA acceleration. Supports amd64 and arm64 architectures.
Best for
Developers who want a private, self-hosted AI stack with Docker Compose.
Use cases
- Deploy a private AI stack locally with Docker Compose
- Run speech-to-text with Whisper and WhisperLive
- Expose models through LiteLLM and MCP Gateway
Notes
161 stars on GitHub. Last updated 2026-09-30. Licensed MIT.
Pros
- Easy deployment via Docker Compose
- Local-first and private by default
- Multi-architecture support
Cons
- Requires self-hosting and maintenance
- Small community with limited support
- No managed service or enterprise support
Key facts
What we have checked
- Days since the last commit
- 4
- GitHub forks
- 35
- GitHub stars
- 174
- Days to a first reply on issues
- 0.2
- Open issues
- 0
- Releases in the last 90 days
- 3
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How Self-Hosted AI Stack is growing
161 to 174
Health and security
Is Self-Hosted AI Stack looked after, and what do its setup files show
Health score
81 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 30 of 30 | Last push 4 days ago |
| Releases | 15 of 15 | 3 releases in 90 days |
| Issue replies | 20 of 20 | First reply in 0.2 days (median) |
| Maintainer | 0 of 15 | Owned by a single user |
| Official source | Not counted | MCP servers only |
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.