Skills
web-scraper
by shobcoder
Shob – an AI agent that delivers high-quality coding & automation work
This project appears archived and may no longer be maintained.
Our verdict
We have not reviewed web-scraper yet
No one at Enterprise DNA has checked this listing against its sources. The description comes from public listings gathered automatically. Any fact below shows where it came from and when it was last checked.
From the listing
About web-scraper
web-scraper is a TypeScript skill within Shob, an AI agent that performs coding and automation tasks. It provides web scraping capabilities, allowing the agent to extract data from websites as part of its workflow.
Best for
Developers using Shob who need to scrape websites as part of automated workflows.
Use cases
- Extract structured data from web pages for analysis
- Automate data collection from multiple URLs
- Integrate scraping into larger automation pipelines
Notes
578 stars on GitHub. Last updated 2026-09-18. Licensed MIT.
Pros
- Part of a broader AI agent, enabling combined coding and scraping tasks
- Written in TypeScript, offering type safety and maintainability
- Backed by a popular repository with 578 stars
Cons
- Requires the Shob agent environment to function
- Limited documentation available for standalone use
- May be subject to website terms of service and anti-scraping measures
Key facts
What we have checked
- Days since the last commit
- 2
- GitHub forks
- 3
- GitHub stars
- 575
- Days to a first reply on issues
- 85.3
- Open issues
- 7
- Releases in the last 90 days
- 0
Each value shows when we last confirmed it and where it came from. Values we have not confirmed are left out, never guessed.
Health and security
Is web-scraper looked after, and what do its setup files show
Security check static checks
100 out of 100
- Note No dependency list or install command was found in the skill, so there were no packages to look up on OSV.
Alternatives
Alternatives to web-scraper
| Record | Type | How we know | Checked |
|---|---|---|---|
| defuddleThis is an alternative to it | Skill | Matched from the listing text |
Compare
Compare web-scraper side by side
Sources
Where this comes from
- GitHubRegistry
A source shows what was published when we checked it. It does not certify security, performance or a working installation. Read our method.
Changelog
What changed
No changes recorded yet. Releases, price changes and deprecations appear here, with their dates, once we track them for this record.
Open-source & AI alternatives
Swap-in tools that solve the same job. Weigh the trade-offs before you commit.
Pairs with
Other entries in the index that connect to this one. Click through to see the chain.
webcrawler-deep-crawl
browser-act
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session o
web-search-scraper-api-skill
browser-act
Browser automation CLI built for AI agents. Break through anti-bot walls, hand off to humans across platforms when stuck. Parallel multi-task execution, independent multi-session o
Scrapling MCP Server
d4vinci
🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for
Browser Use
browser-use
Open-source Python library for AI browser agents, plus Browser Use Cloud: stealth browsers and a hosted agent API.
Firecrawl
firecrawl
Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
Get the free Developer’s Field Guide
A 27-page field guide to the AI coding workflow with Claude. Claude Code, MCP servers, the prompt patterns that work, and what to delegate. Free.
Enter your work email. We send it straight over, plus a few short notes worth knowing. Unsubscribe any time.