Enterprise DNA
O Open Source Observability medium

DVC

by Community

πŸ¦‰ Data Versioning and ML Experiments

D

OSS

DVC

Added 1 June 2026

#ai #data-science #data-version-control #developer-tools #machine-learning #reproducibility #unstructured-data

Overview

DVC (Data Version Control) is a version control system for machine learning projects that tracks data, models, and experiment metadata alongside code. It integrates with Git to manage large files and pipelines, enabling reproducible ML workflows without storing binaries in repositories.

Best for

Best for
ML teams building reproducible pipelines who need Git-like versioning for data and models

Use cases

  • Track dataset versions and model artifacts across experiment iterations
  • Reproduce ML pipelines and results from previous runs
  • Collaborate on ML projects with versioned data and experiment history

Notes

DVC (Data Version Control) is a version control system for machine learning projects that tracks data, models, and experiment metadata alongside code. It integrates with Git to manage large files and pipelines, enabling reproducible ML workflows without storing binaries in repositories.

15,643 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.

Use cases

  • Track dataset versions and model artifacts across experiment iterations
  • Reproduce ML pipelines and results from previous runs
  • Collaborate on ML projects with versioned data and experiment history

Pros

  • Integrates seamlessly with Git for unified project versioning
  • Handles large files and remote storage without bloating repositories
  • Tracks full experiment lineage including parameters, metrics, and outputs

Cons

  • Requires Python and command-line familiarity for typical workflows
  • Learning curve for teams unfamiliar with version control concepts
  • Remote storage setup and configuration adds operational overhead

Indexed from awesome-llmops and enriched against its public facts.

Pros

  • Integrates seamlessly with Git for unified project versioning
  • Handles large files and remote storage without bloating repositories
  • Tracks full experiment lineage including parameters, metrics, and outputs

Cons

  • Requires Python and command-line familiarity for typical workflows
  • Learning curve for teams unfamiliar with version control concepts
  • Remote storage setup and configuration adds operational overhead

Pairs with

Other entries in the index that connect to this one. Click through to see the chain.

Pairs with16entries
O OSS Obs medium

Airflow

Community

Platform created by the community to programmatically author, schedule and monitor workflows.

O OSS Obs medium

Awesome Production Machine Learning

Community

A curated list of awesome open source libraries to deploy, monitor, version and scale your machine learning

β˜… 20,585 updated 1mo ago
O OSS Obs medium

Delta-Lake

Community

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

β˜… 8,829 updated 1mo ago
O OSS Obs medium

Determined

Community

Determined is an open-source machine learning platform that simplifies distributed training, hyperparameter tuning, experiment tracking, and resource management. Works with PyTorch

β˜… 3,225 updated 1y ago
O OSS Obs medium

Dolt

Community

Dolt – Git for Data

β˜… 22,967 updated 1mo ago
O OSS Obs medium

Featureform

Community

The Virtual Feature Store. Turn your existing data infrastructure into a feature store.

β˜… 1,981 updated 1y ago
O OSS Obs medium

Great Expectations

Community

Always know what to expect from your data.

β˜… 11,532 updated 1mo ago
O OSS Obs medium

Hamilton

Community

Apache Hamilton helps data scientists and engineers define testable, modular, self-documenting dataflows, that encode lineage/tracing and metadata. Runs and scales everywhere pytho

β˜… 2,504 updated 1mo ago
O OSS Obs medium

Hopsworks

Community

Hopsworks - Data-Intensive AI platform with a Feature Store

β˜… 1,299 updated 1y ago
O OSS Obs medium

Kubeflow

Community

Machine Learning Toolkit for Kubernetes

β˜… 15,700 updated 1mo ago
O OSS Obs medium

MLEM

Community

🐢 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🀞

β˜… 718 updated 2y ago
O OSS Obs medium

ModelDB

Community

Open Source ML Model Versioning, Metadata, and Experiment Management

β˜… 1,747 updated 1y ago
O OSS Obs medium

Polyaxon

Community

Open Source AI Infra & Engineering Control Plane

β˜… 3,706 updated 1mo ago
O OSS Obs medium

PromptSite

Community

PromptSite is a lightweight prompt version management package that helps you version control, track, experiment and debug with your LLM prompts with ease.

β˜… 47 updated 1y ago
O OSS Obs medium

Weco Observe

Community

Build and Optimize your machine learning pipeline with the Weco Platform - based on AIDE ML, the LLM-powered code optimization Agent for Machine Learning Engineering.

O OSS Obs medium

whylogs

Community

An open-source data logging library for machine learning models and data pipelines. πŸ“š Provides visibility into data quality & model performance over time. πŸ›‘οΈ Supports privacy-pre

β˜… 2,819 updated 1y ago
Alternatives6entries
Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.