Enterprise DNAEnterprise DNA
MMCP ServersDeveloperlow

Mingye-Lu/AgenticCrawler

by Various

acrawl — LLM-powered web crawler. Describe what you want in plain English, get structured data back. Single Rust binary, 25 providers, MCP server built-in.

Visit siteSubmit your build →

MCP

Mingye-Lu/AgenticCrawler

Added 11 June 2026

#ai-agent#autonomous-agents#browser-automation#claude#cli#cloakbrowser#developer-tools#headless-browser
Catalogue record, not a reviewed recommendation. This record can include automatically collected descriptions and setup details. Confirm important claims with the original source. Explore source-reviewed tools.

Overview

acrawl is a Rust-based web crawler that takes plain English descriptions of what to extract and returns structured data. It bundles 25 provider integrations and includes a built-in MCP server, all in a single binary.

Best for

Best for
Developers who need a quick, LLM-driven web scraper with multi-provider support and MCP compatibility.

Use cases

  • Scrape structured data from websites using natural language queries
  • Automate data extraction pipelines with MCP server integration
  • Quickly prototype crawls across multiple LLM providers without configuration overhead

How to use

Tools exposed

  • go_back
  • switch_tab
  • fit_markdown
  • click_at
  • fill_form
  • select_option
  • press_key
  • set_device
  • execute_js
  • page_map
  • read_content
  • list_resources
  • save_file
  • list_network_activity
  • inspect_request
  • list_page_logs
  • inspect_log
  • list_websocket_activity
  • inspect_websocket
  • get_page_performance

Clients listed in this record (not verified here)

Claude Desktop, Claude Code, Cursor, Windsurf, VS Code, ChatGPT

Notes

5 stars on GitHub. Last updated 2026-06-11. Licensed MIT.

Pros

  • Single Rust binary simplifies deployment and dependency management
  • Supports 25 providers out of the box for flexible LLM backend choice
  • Built-in MCP server enables easy integration with existing tools

Cons

  • Rust binary may not suit teams without Rust toolchain experience
  • Natural language parsing can produce inconsistent results on complex pages
  • Limited to LLM-driven extraction, not a general purpose web scraper

Open-source & AI alternatives

Swap-in tools that solve the same job. Weigh the trade-offs before you commit.

Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.

← Back to MCP ServersSubmit your own entry →