MCP Servers
Crawlie
by spronta
Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.
Our verdict
We have not reviewed Crawlie yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About Crawlie
Fast, free, open-source technical SEO + GEO crawler: built for humans and agents.
Best for
Developers and SEO professionals needing a lightweight, open-source crawler for technical audits and agent-driven analysis.
Use cases
- Audit website technical SEO issues like broken links and missing meta tags
- Crawl sites to generate data for generative engine optimization (GEO)
- Integrate crawling into automated agent workflows for site analysis
Notes
120 stars on GitHub. Last updated 2026-10-26.
Indexed from mcp-official-registry. Verified against the live GitHub repo.
Pros
- Fast performance due to Rust implementation
- Free and open-source with an active GitHub repository
- Dual-purpose for both human and agent use
Cons
- Limited community size (115 stars) may mean fewer resources
- Requires technical setup and familiarity with command-line tools
- May lack advanced features found in commercial crawlers
Key facts
What we have checked
- Days since the last commit
- 17
- GitHub forks
- 17
- GitHub stars
- 124
- Days to a first reply on issues
- 67.8
- Open issues
- 3
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
How to use
How to set it up
As the listing publishes it. We have not run this install.
Install
npm i -g crawlieTools exposed
crawl_siteaudit_urlaudit_urlsexplain_issuelist_rules
Clients the listing names (not checked here)
Claude Desktop, Claude Code, Cursor, Cline, ChatGPT
Install
Add Crawlie to your client
No install recipe yet. We write one for Claude Code, Claude Desktop, Cursor, VS Code, Codex and ChatGPT when the server is in the official MCP registry with a package or remote address we can use.
Until then, follow the project's own README, or the setup the listing publishes under How to set it up.
Works with
What Crawlie connects to
No confirmed connections yet. A product appears here when the server's registry name, repo, homepage or name ties it to that product, and a client appears when we have an install recipe for it.
Stars and usage
How Crawlie is growing
116 to 124
Health and security
Is Crawlie looked after, and what do its setup files show
Health score
45 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 30 of 30 | Last push 17 days ago |
| Releases | 0 of 15 | 0 releases in 90 days |
| Issue replies | 0 of 20 | First reply in 67.8 days (median) |
| Maintainer | 15 of 15 | Owned by an organisation |
| Official source | 0 of 20 | Community server |
Security check static checks
97 out of 100
- Low The repository has a licence file GitHub cannot match to a standard licence. Read it before relying on the server.
- Note No published npm or PyPI package of this repository was found, so package advisories were not checked.
- Note The lab has not recorded this server's tool list yet, so tool permissions were not checked.
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.