Spider Web Scraper
Provides web scraping capabilities using Puppeteer and Cheerio to search Bing, extract webpage content, and convert pages to Markdown format with batch processing support for competitive research and content analysis.
About
Spider MCP is a web search and scraping server implementation by Bosegluon that provides pure web scraping capabilities without relying on external search APIs. It integrates Puppeteer for browser automation and Cheerio for HTML parsing to perform web searches across Bing (including news search with time filters), scrape webpage content, and convert pages to Markdown format. The server supports batch processing of multiple URLs with configurable concurrency limits and includes comprehensive error handling, making it useful for competitive research, content analysis, and building AI assistants that need programmatic access to web data without API dependencies or rate limits.
Is this your product? Claim this listing with an email at your domain to post updates.
Is this your project?
Claim this listing to manage your page, access analytics, and unlock upgrades. Verification takes 60 seconds.
Share This Project
Embed Badge
Add this badge to your README:
[](https://hifriendbot.com/ai-list/spider-web-scraper/)
