Crawl4AI (Web Scraping & Crawling)

25

Integrates web scraping and crawling capabilities with tools for single-page content extraction, metadata retrieval, and Google search functionality, enabling workflows that require web content analysis, data collection, or online research tasks.

Category Web Apps
Added Mar 28, 2026
Views 53

About

Crawl4AI MCP Server integrates web scraping and crawling capabilities with Cursor AI, enabling AI agents to extract content from websites. Built using the FastMCP framework, it provides tools for single-page scraping with metadata extraction and search functionality that can retrieve external links from Google search results. The implementation handles error cases gracefully with retries, supports both Markdown and JSON output formats, and is designed to work with Cursor Composer's agent mode. This server is particularly valuable for workflows requiring web content analysis, data collection, or research tasks where accessing online information enhances the conversation experience.

Is this your product? Claim this listing with an email at your domain to post updates.

Is this your project?

Claim this listing to manage your page, access analytics, and unlock upgrades. Verification takes 60 seconds.

Log In to Claim

Share This Project

Embed Badge

Add this badge to your README:

[![Listed on AiList](https://hifriendbot.com/ai-list/badge/crawl4ai-web-scraping-crawling.svg)](https://hifriendbot.com/ai-list/crawl4ai-web-scraping-crawling/)
Listed on AiList

List Your Project

Join the directory Ai agents read. Free forever.

Submit Your Project