Open Source
Datatrove
Freeing data processing from scripting madness by providing a set of platform-agnostic customizable pipeline processing blocks.
Our verdict
We have not reviewed Datatrove yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About Datatrove
Datatrove is an open-source Python framework for building platform-agnostic data processing pipelines. It provides customizable blocks that users assemble into workflows, reducing the need for custom scripting. The project is maintained by the Hugging Face community and has over 3000 stars on GitHub.
Best for
Developers who need flexible, reusable data pipelines without locking into a specific platform
Use cases
- Assembling modular data preprocessing pipelines for machine learning
- Creating reusable data cleaning and transformation workflows
- Building scalable ETL processes without writing glue code
Notes
3,076 stars on GitHub. Last updated 2026-05-26. Licensed Apache-2.0.
Pros
- Modular block-based design promotes code reuse and clarity
- Platform-agnostic, works across different execution environments
- Backed by a large open-source community with active development
Cons
- Requires learning the block abstraction paradigm
- May introduce overhead for simple or one-off data tasks
- Documentation and examples may lag behind rapid development
Key facts
What we have checked
- Latest version
- 0.10.1 (released 30 Sept 2026)
- GitHub stars
- 3,356
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How Datatrove is growing
3,076 to 3,356
Sources
Where this comes from
- GitHubOfficial
- github api via nightly crawl, recovered from git history 20e874270887c1008f860ee0198e461a23c9e438Registry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
Released 0.10.1
Released 0.10.0
Released 0.9.0
Released 0.8.0
Released 0.7.0
Released 0.6.0
Released 0.5.0
Released 0.4.0
Released 0.3.0
Released 0.2.0
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
DeepSpeed
Community
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
Litgpt
Community
20+ high-performance LLMs with recipes to pretrain, finetune and deploy at scale.
Megatron-LM
Community
Ongoing research training transformer models at scale
SGLang
Community
SGLang is a high-performance serving framework for large language models and multimodal models.
vLLM
Community
A high-throughput and memory-efficient inference and serving engine for LLMs
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.