Skills
webcrawler-deep-crawl
by browser-act
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck.
Our verdict
We have not reviewed webcrawler-deep-crawl yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About webcrawler-deep-crawl
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session operation, isolated multi-account browsing.
Best for
AI agents needing robust, parallel web scraping in Python.
Use cases
- Automated deep crawling for data collection
- Scraping sites with anti-bot protections
- Running multiple browser sessions in parallel for research
Notes
6,340 stars on GitHub. Last updated 2026-11-04. Licensed MIT.
Indexed from github-skill-repos. Verified against the live GitHub repo.
Pros
- Handles anti-bot detection
- Supports parallel tasks and multi-session operation
- Isolated environments for different accounts
Cons
- Requires Python setup
- CLI may have learning curve for non-devs
- Human handoff implies potential interruptions
Key facts
What we have checked
- Days since the last commit
- 10
- GitHub forks
- 343
- GitHub stars
- 6,350
- Days to a first reply on issues
- 6.8
- Open issues
- 10
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Stars and usage
How webcrawler-deep-crawl is growing
6,300 to 6,350
Health and security
Is webcrawler-deep-crawl looked after, and what do its setup files show
Health score
78 out of 100
| Part | Points | What we saw |
|---|---|---|
| Recent activity | 30 of 30 | Last push 10 days ago |
| Releases | 0 of 15 | 0 releases in 90 days |
| Issue replies | 17.2 of 20 | First reply in 6.8 days (median) |
| Maintainer | 15 of 15 | Owned by an organisation |
| Official source | Not counted | MCP servers only |
Security check static checks
100 out of 100
- Note No dependency list or install command was found in the skill, so there were no packages to look up on OSV.
Alternatives
Alternatives to webcrawler-deep-crawl
| Record | Type | How we know | Checked |
|---|---|---|---|
| ebay-item-detailAlternative to this | Skill | Matched from the listing text | |
| firecrawlAlternative to this | Skill | Matched from the listing text | |
| firecrawl-agentAlternative to this | Skill | Matched from the listing text | |
| firecrawl-scrapeAlternative to this | Skill | Matched from the listing text | |
| firecrawl-webAlternative to this | Skill | Matched from the listing text | |
| just-scrapeAlternative to this | Skill | Matched from the listing text | |
| ScrapyAlternative to this | Skill | Matched from the listing text | |
| web-search-scraper-api-skillAlternative to this | Skill | Matched from the listing text |
Compare
Compare webcrawler-deep-crawl side by side
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
ebay-item-detail
browser-act
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session o
firecrawl
firecrawl
Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the contex
firecrawl-agent
firecrawl
Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the contex
firecrawl-scrape
firecrawl
Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the contex
firecrawl-web
bexgboost
A Claude Code skill for web scraping with Firecrawl - markdown extraction, screenshots, structured data, web search, and doc crawling
just-scrape
ScrapeGraphAI
CLI for AI-powered web scraping, structured data extraction, web search, multi-page crawling, and scheduled page-change monitoring powered by the ScrapeGraph AI API. Turn any URL i
Scrapy
sanjeed5
Curated list of awesome Cursor Rules .mdc files
web-search-scraper-api-skill
browser-act
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session o
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
Scrapling MCP Server
d4vinci
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for
Firecrawl
firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Apify Ultimate Scraper
Apify
Scrape Instagram, TikTok, YouTube, LinkedIn, Google Maps, Reddit and 15+ more platforms through Apify Actors.
broken-link-checker
nowork-studio
Open-source SEO, GEO, and marketing skills for AI agents.
firecrawl-interact
firecrawl
Firecrawl CLI and agent skills: search, scrape, and interact with the web from your terminal or any coding agent, plus parse, crawl, map, Agent and Monitor. Firecrawl is the contex
replica-recon
Jakeschincariol
Eleven free Claude skills that clone any app: reverse-engineer it, rebuild it, test it for bugs, then fix what its users hate. Free, MIT.
save-md
mblode
Nobody ships AI slop on purpose. These skills make sure you don’t.
web-scraper
shobcoder
Shob – an AI agent that delivers high-quality coding & automation work
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.