Harbor

Overview

Harbor is an open-source command-line tool that launches a pre-configured LLM stack with a single command. It bundles hundreds of services for exploring and working with large language models without manual setup.

Best for

Best for
Developers who want to quickly test or prototype with multiple LLM services without manual stack configuration.

Use cases

• Quickly spin up a local LLM environment for prototyping
• Experiment with different models and services without configuration overhead
• Integrate a ready-to-use AI stack into development workflows

Notes

Harbor is an open-source command-line tool that launches a pre-configured LLM stack with a single command. It bundles hundreds of services for exploring and working with large language models without manual setup.

3,036 stars on GitHub. Last updated 2026-06-01. Licensed Apache-2.0.

Use cases

• Quickly spin up a local LLM environment for prototyping
• Experiment with different models and services without configuration overhead
• Integrate a ready-to-use AI stack into development workflows

Pros

• One-command setup saves significant time over manual configuration
• Large library of pre-wired services enables broad experimentation
• Open-source with active community (over 3000 stars)

Cons

• Limited to Python ecosystem, not language-agnostic
• May include more services than needed for simple use cases
• Dependence on community-maintained service definitions

Indexed from awesome-generative-ai and enriched against its public facts.