Crawl4AI

2

Provides advanced web crawling and RAG capabilities through Crawl4AI with semantic search, knowledge graph integration, and hallucination detection for intelligent content analysis and automated documentation discovery.

Category Web Apps
Language Shell
License MIT
Added Mar 28, 2026
Views 56

About

This MCP server provides AI assistants with advanced web crawling and RAG capabilities through the Crawl4AI library, built by Cole Medin using Python with comprehensive content extraction, semantic search, and knowledge graph integration. The implementation features multiple RAG strategies including contextual embeddings, hybrid search combining vector and keyword approaches, agentic RAG with code example extraction, cross-encoder reranking, and AI hallucination detection through Neo4j knowledge graphs. Built with Supabase for vector storage, OpenAI embeddings, configurable LLM support through OpenRouter, and Docker deployment options, it serves developers needing intelligent web content analysis, teams requiring automated documentation and code discovery from web sources, and organizations wanting to build knowledge bases from crawled web content with advanced retrieval and validation capabilities.

Is this your product? Claim this listing with an email at your domain to post updates.

Is this your project?

Claim this listing to manage your page, access analytics, and unlock upgrades. Verification takes 60 seconds.

Log In to Claim

Share This Project

Embed Badge

Add this badge to your README:

[![Listed on AiList](https://hifriendbot.com/ai-list/badge/crawl4ai.svg)](https://hifriendbot.com/ai-list/crawl4ai/)
Listed on AiList

List Your Project

Join the directory Ai agents read. Free forever.

Submit Your Project