dstack

Overview

dstack is an open framework for confidential AI. It enables running AI workloads with data privacy and integrity guarantees. Built in Rust, it provides observability into confidential computing environments.

Best for

Best for
Developers building AI applications that require data confidentiality and verifiable observability.

Use cases

• Run AI inference inside trusted execution environments
• Observe and verify confidentiality of AI pipelines
• Deploy secure AI workflows with privacy guarantees

Notes

dstack is an open framework for confidential AI. It enables running AI workloads with data privacy and integrity guarantees. Built in Rust, it provides observability into confidential computing environments.

496 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.

Use cases

• Run AI inference inside trusted execution environments
• Observe and verify confidentiality of AI pipelines
• Deploy secure AI workflows with privacy guarantees

Pros

• Open source with community-driven development
• Written in Rust for performance and safety
• Focus on confidentiality for AI workloads

Cons

• Relatively early stage with limited adoption (496 stars)
• Niche focus may limit general observability use cases
• Documentation and ecosystem still maturing

Indexed from awesome-llmops and enriched against its public facts.