NobodyWho

Overview

NobodyWho is an open-source inference engine for running large language models locally on any device. It is written in Rust and designed for efficient local execution. The project is maintained by the community and available on GitHub.

Best for

Best for
Developers who need private, local LLM inference across varied hardware.

Use cases

• Run LLMs on devices without cloud connectivity
• Deploy private, on-premise inference for sensitive data
• Prototype local language model applications in Rust

Notes

NobodyWho is an open-source inference engine for running large language models locally on any device. It is written in Rust and designed for efficient local execution. The project is maintained by the community and available on GitHub.

1,521 stars on GitHub. Last updated 2026-10-05. Licensed EUPL-1.2.

Use cases

• Run LLMs on devices without cloud connectivity
• Deploy private, on-premise inference for sensitive data
• Prototype local language model applications in Rust

Pros

• Efficient local inference due to Rust implementation
• Cross-device compatibility
• Open-source with community support

Cons

• Smaller community and fewer integrations than larger projects
• Limited documentation and tooling
• May require manual setup for specific hardware

Indexed from awesome-llmops and enriched against its public facts.