Mingye-Lu/AgenticCrawler
by Various
acrawl — LLM-powered web crawler. Describe what you want in plain English, get structured data back. Single Rust binary, 25 providers, MCP server built-in.
MCP
Mingye-Lu/AgenticCrawler
Added 11 June 2026
Overview
acrawl is a Rust-based web crawler that takes plain English descriptions of what to extract and returns structured data. It bundles 25 provider integrations and includes a built-in MCP server, all in a single binary.
Best for
Best for
Developers who need a quick, LLM-driven web scraper with multi-provider support and MCP compatibility.
Use cases
- Scrape structured data from websites using natural language queries
- Automate data extraction pipelines with MCP server integration
- Quickly prototype crawls across multiple LLM providers without configuration overhead
Notes
acrawl is a Rust-based web crawler that takes plain English descriptions of what to extract and returns structured data. It bundles 25 provider integrations and includes a built-in MCP server, all in a single binary.
5 stars on GitHub. Last updated 2026-06-11. Licensed MIT.
Use cases
- Scrape structured data from websites using natural language queries
- Automate data extraction pipelines with MCP server integration
- Quickly prototype crawls across multiple LLM providers without configuration overhead
Pros
- Single Rust binary simplifies deployment and dependency management
- Supports 25 providers out of the box for flexible LLM backend choice
- Built-in MCP server enables easy integration with existing tools
Cons
- Rust binary may not suit teams without Rust toolchain experience
- Natural language parsing can produce inconsistent results on complex pages
- Limited to LLM-driven extraction, not a general purpose web scraper
Indexed from awesome-mcp-servers-punkpeye and enriched against its public facts.
Pros
- Single Rust binary simplifies deployment and dependency management
- Supports 25 providers out of the box for flexible LLM backend choice
- Built-in MCP server enables easy integration with existing tools
Cons
- Rust binary may not suit teams without Rust toolchain experience
- Natural language parsing can produce inconsistent results on complex pages
- Limited to LLM-driven extraction, not a general purpose web scraper
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Cline
Cline
Open-source autonomous coding agent that lives inside VS Code. BYO model key, watch it work.
Continue
Continue.dev
Open-source AI code assistant for VS Code and JetBrains. Customisable, BYO model, built for enterprise.
Claude Code
Anthropic
Anthropic's terminal-native coding agent. Reads your repo, edits files, runs tests, ships PRs.