WebShift
1
Denoised web search — fetch, clean, and rerank web content for AI agents with strict size budgets.
About
WebShift is a Rust library and MCP server that transforms noisy HTML web pages into clean, right-sized plain text optimized for LLM consumption. Features streaming HTTP fetching with per-page size caps, HTML noise removal, Unicode/BiDi sterilization, BM25 deterministic reranking, and adaptive budget allocation across multiple search backends including SearXNG, Brave, Tavily, Exa, Google, and Bing. Enforces hard guarantees on output size to prevent context window flooding.
Is this your project?
Claim this listing to manage your page, access analytics, and unlock upgrades. Verification takes 60 seconds.
Share This Project
Embed Badge
Add this badge to your README:
[](https://hifriendbot.com/ai-list/webshift/)
