Docker

Weaviate is an open-source vector database that stores both objects and vectors, allowing for the combination of vector search with structured filtering with the fault tolerance an

Qdrant - High-performance, massive-scale Vector Database and Vector Search Engine for the next generation of AI. Also available in the cloud https://cloud.qdrant.io/

Platform created by the community to programmatically author, schedule and monitor workflows.

Aqueduct is no longer being maintained. Aqueduct allows you to run LLM and ML workloads on any cloud infrastructure.

Workflow Engine for Kubernetes

👾 Open source implementation of the ChatGPT Code Interpreter

VS Code in the browser

Easily deploy LLMs with Ansible. Uses Docker with llama.cpp or ollama. Secured with whitelisted IPs.

Open framework for confidential AI

Open-source, secure environment with real-world tools for enterprise-grade agents.

FEDML - The unified and scalable ML library for large-scale distributed training, model serving, and federated learning. FEDML Launch, a cross-cloud scheduler, further enables runn

Open source, high performance fine tuning as a service for GPT4 quality models with 5x lower latency and 3x lower cost

AI models as scalable microservices, enabling evaluation of LLMs and offering end-to-end functions such as chatbot, semantic search, image generation and beyond.

Kubernetes AI Toolchain Operator

Automated Machine Learning on Kubernetes

Standardized Distributed Generative and Predictive AI Inference Platform for Scalable, Multi-Framework Deployment on Kubernetes

AI Inference Operator for Kubernetes. The easiest way to serve ML models in production. Supports VLMs, LLMs, embeddings, and speech-to-text.

Machine Learning Toolkit for Kubernetes

A platform for packaging and launching blockchain infra. Think docker compose for blockchain

The web framework for building LLM microservices [deprecated]

LangStream. Event-Driven Developer Platform for Building and Running LLM AI Apps. Powered by Kubernetes and Kafka.

Ready-to-run cloud templates for RAG, AI pipelines, and enterprise search with live data. 🐳Docker-friendly.⚡Always in sync with Sharepoint, Google Drive, S3, Kafka, PostgreSQL, re

Kubernetes operator for local LLM inference with llama.cpp, vLLM, TGI, and mlx-server — multi-GPU NVIDIA + Apple Silicon Metal, autoscaling, air-gapped, production-ready

🤯 LobeHub is your Chief Agent Operator, organizing your agents into 7×24 operations by hiring, scheduling, and reporting on your entire AI team.

At Maxim AI, we are building the production infrastructure for AI. Maxim’s stack comprising gateway and governance, observability, and evals empowers AI teams to ship agents with

Build, Manage and Deploy AI/ML Systems

🐶 A tool to package, serve, and deploy any ML model on any platform. Archived to be resurrected one day🤞

Docker for Your ML/DL Models Based on OCI Artifacts

Data-Centric Pipelines and Data Versioning

Resource scheduling and cluster management for AI

Build, run, and manage agent platforms.

Open Source AI Infra & Engineering Control Plane

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

Large Language Model Text Generation Inference

The Triton Inference Server provides an optimized cloud and edge inferencing solution.

🔮 Instill Core is a full-stack AI infrastructure tool for data, model and pipeline orchestration, designed to streamline every aspect of building versatile AI-first applications

Distributed vector search for AI-native applications

Deploy, manage, optimize any model at scale across any environment from cloud to edge. Let's you go from python notebook to inferencing in minutes.

ZenML 🙏: One AI Platform from Pipelines to Agents. https://zenml.io.

Multi-Agent Harness for Production AI

Build, run and scale AI agents like API and microservices - observable,auditable and identity-aware from day one.

AIDE: AI-Driven Exploration in the Space of Code. The machine Learning engineering agent that automates AI R&D.

ClearML - Auto-Magical CI/CD to streamline your AI workload. Experiment Management, Data Management, Pipeline, Orchestration, Scheduling & Serving in one MLOps/LLMOps solution

Dolt – Git for Data

Dynamic, resilient AI orchestration. Coordinate data, models, and compute as you build AI workflows.

Experiment tracking, ML developer tools

Durable workflows for agents. Step functions, event-driven runs, retries, all without managing a queue.

MegEngine 是一个快速、可拓展、易于使用且支持自动求导的深度学习框架

MLRun is an open source MLOps platform for quickly building and managing continuous ML applications across their lifecycle. MLRun integrates into your development and CI/CD environ

ModelFox makes it easy to train, deploy, and monitor machine learning models.

Open Source AI Infra & Engineering Control Plane

Prefect is a workflow orchestration framework for building resilient data pipelines in Python.

Accelerate and scale Generative AI across your enterprise with the platform to transform your data into customized enterprise-ready Generative AI applications.

A flexible, high-performance serving system for machine learning models

TreeScale Platform is an All in One solution to use LLM Prompts to build powerful APIs and integrate them with your favorite tools and services.

A curated list of references for MLOps

🏕️ Reproducible development environment for humans and agents