Skills
distributed-llm-pretraining-torchtitan
by Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model.
Our verdict
We have not reviewed distributed-llm-pretraining-torchtitan yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About distributed-llm-pretraining-torchtitan
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent with full horsepower. Maintained by Orchestra Research.
Best for
Developers building agent-based AI research workflows who need pretraining and model architecture skills.
Use cases
- Equip coding agents with pretraining skills for distributed LLM workflows
- Accelerate model architecture research using torchtitan-based tooling
- Integrate research-grade skills into agent-driven AI development pipelines
Notes
14,387 stars on GitHub. Last updated 2026-10-11. Licensed MIT.
Indexed from github-skill-repos. Verified against the live GitHub repo.
Pros
- Comprehensive skill library covering broad AI research and engineering
- Open-source with high community traction (13.9k stars)
- Agent-agnostic, works with Claude Code, Codex, and Gemini
Cons
- Primary language is TeX, which may limit direct code usability
- Scope is broad, so specific pretraining details may require deeper exploration
- Dependency on external agent frameworks for full functionality
Key facts
What we have checked
- Days since the last commit
- 34
- GitHub forks
- 1,003
- GitHub stars
- 14,537
- Days to a first reply on issues
- 62.4
- Open issues
- 11
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How distributed-llm-pretraining-torchtitan is growing
14,169 to 14,537
Health and security
Is distributed-llm-pretraining-torchtitan looked after, and what do its setup files show
Health score
56 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 29.6 of 30 | Last push 34 days ago |
| Releases | 0 of 15 | 0 releases in 90 days |
| Issue replies | 0 of 20 | First reply in 62.4 days (median) |
| Maintainer | 15 of 15 | Owned by an organisation |
| Official source | Not counted | MCP servers only |
Security check static checks
100 out of 100
- Note 1 of 1 packages are not pinned to one version, so only the malicious packages list was checked for them, not version advisories.
Alternatives
Alternatives to distributed-llm-pretraining-torchtitan
| Record | Type | How we know | Checked |
|---|---|---|---|
| implementing-llms-litgptThis is an alternative to it | Skill | Matched from the listing text |
Compare
Compare distributed-llm-pretraining-torchtitan side by side
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
DeepSpeed
Community
DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.
moe-training
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
nanogpt
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
pytorch-fsdp2
Orchestra-Research
Comprehensive open-source library of AI research and engineering skills for any AI model. Package the skills and your claude code/codex/gemini agent will be an AI research agent wi
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.