Enterprise DNAEnterprise DNA

MCP Servers

andyliszewski/webcrawl-mcp

andyliszewski/webcrawl-mcp — indexed from awesome-mcp-servers-punkpeye

Visit site ↗

Our verdict

Not reviewed yet

We have not reviewed andyliszewski/webcrawl-mcp yet

No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.

How we review records

From the listing

About andyliszewski/webcrawl-mcp

A Python-based MCP server that crawls websites and returns structured content. It exposes tools for fetching and parsing web pages, making site data accessible to AI agents via the Model Context Protocol.

Best for

Developers needing a quick MCP-compatible web crawler for prototyping or small-scale data extraction

Use cases

  • Extract text and metadata from a given URL for analysis
  • Crawl multiple pages of a site to build a content index
  • Feed web content into an AI agent for summarization or research

Notes

10 stars on GitHub. Last updated 2026-05-15. Licensed MIT.

Pros

  • Simple Python implementation easy to extend or debug
  • Leverages MCP standard for integration with compatible clients
  • Lightweight with minimal dependencies

Cons

  • Limited to 10 GitHub stars indicates early-stage or niche adoption
  • No built-in rate limiting or politeness controls for crawling
  • Requires manual setup and configuration for non-trivial sites

Key facts

What we have checked

Days since the last commit
46
Checked GitHub
GitHub forks
2
Checked GitHub
GitHub stars
16
Checked GitHub
Open issues
0
Checked GitHub
Releases in the last 90 days
0
Checked GitHub

Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.

How to use

How to set it up

As the listing publishes it. We have not run this install.

Install

pip install webcrawl-mcp

Tools exposed

  • webcrawl_scrape
  • webcrawl_search
  • webcrawl_map
  • webcrawl_crawl
  • USER_AGENT
  • REQUEST_TIMEOUT
  • FIRECRAWL_API_KEY
  • FIRECRAWL_API_URL
  • FALLBACK_ON_TRANSPORT_ERROR
  • POLITE_MODE

Clients the listing names (not checked here)

Claude Desktop, Claude Code, Cursor, Cline, Continue

Install

Add andyliszewski/webcrawl-mcp to your client

Not verified yet

No install recipe yet. We write one for Claude Code, Claude Desktop, Cursor, VS Code, Codex and ChatGPT when the server is in the official MCP registry with a package or remote address we can use.

Until then, follow the project's own README, or the setup the listing publishes under How to set it up.

Works with

What andyliszewski/webcrawl-mcp connects to

No confirmed connections yet. A product appears here when the server's registry name, repo, homepage or name ties it to that product, and a client appears when we have an install recipe for it.

Health and security

Is andyliszewski/webcrawl-mcp looked after, and what do its setup files show

Health score

36 out of 100

Does someone look after this repository? It does not say the code is good or safe. Worked out from GitHub signals checked . How it is worked out

PartPointsWhat we saw
Recent activity28.6 of 30Last push 46 days ago
Releases0 of 150 releases in 90 days
Issue repliesNot countedThe latest check has no issue response reading (fewer than 3 measured issues, or issues switched off)
Maintainer0 of 15Owned by a single user
Official source0 of 20Community server

Alternatives

Alternatives to andyliszewski/webcrawl-mcp

RecordTypeHow we knowChecked
agent-infra/mcp-server-browserThis is an alternative to itMCP serverNamed in the listingNot dated
browsermcp/mcpThis is an alternative to itMCP serverNamed in the listingNot dated
executeautomation/playwright-mcp-serverThis is an alternative to itMCP serverNamed in the listingNot dated
firecrawl/firecrawl-mcp-serverThis is an alternative to itMCP serverNamed in the listingNot dated
lightpanda-io/browserThis is an alternative to itMCP serverNamed in the listingNot dated

Compare

Compare andyliszewski/webcrawl-mcp side by side

Sources

Where this comes from

  • GitHubRegistry

    Checked · Days since the last commit, GitHub forks, GitHub stars, Open issues, Releases in the last 90 days

A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.

Changelog

What changed

No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.

Open-source & AI alternatives

Swap-in tools that solve the same job. Weigh the trade-offs before you commit.

Alternative to5 entries
MMCPBrowserlowCatalogue

agent-infra/mcp-server-browser

Various

The Open-Source Multimodal AI Agent Stack: Connecting Cutting-Edge AI Models and Agent Infra

★ 35,863
MMCPBrowserlowCatalogue

browsermcp/mcp

Various

Browser MCP is a Model Context Provider (MCP) server that allows AI applications to control your browser

★ 6,594
MMCPBrowserlowCatalogue

executeautomation/playwright-mcp-server

Various

Playwright Model Context Protocol Server - Tool to automate Browsers and APIs in Claude Desktop, Cline, Cursor IDE and More 🔌

★ 5,541
MMCPlowCatalogue

firecrawl/firecrawl-mcp-server

Various

🔥 Official Firecrawl MCP Server - Adds powerful web scraping and search to Cursor, Claude and any other LLM clients.

★ 6,933
MMCPBrowserlowCatalogue

lightpanda-io/browser

Various

Lightpanda: the headless browser designed for AI and automation

★ 35,603
Free 27-page guide

Get the free Developer’s Field Guide

A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.

Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.

No spam. Unsubscribe any time.

← Back to MCP ServersSubmit your own entry →