{"repo":"Pyx-Corp/spectrawl","free":true,"listed":false,"github":"https://github.com/Pyx-Corp/spectrawl","clone":"git clone https://github.com/Pyx-Corp/spectrawl.git","description":"The unified web layer for AI agents. Search (8 engines), stealth browse, auth, and act on 24 platforms. One npm install, self-hosted.","language":"JavaScript","stars":28,"topics":["ai-agents","browser-automation","mcp","mcp-server","model-context-protocol","nodejs","search-engine","self-hosted","stealth-browser","web-scraping"],"license":"MIT","category":"mcp-servers","readme_excerpt":"Spectrawl The unified web layer for AI agents. Search, browse, crawl, extract, and act on platforms — one package, self-hosted. 5,000 free searches/month via Gemini Grounded Search. Full page scraping, stealth browsing, multi-page crawling, structured extraction, AI browser agent, 24 platform adapters. What It Does AI agents need to interact with the web — searching, browsing pages, crawling sites, logging into platforms, posting content. Today you wire together Playwright + a search API + cookie managers + platform-specific scripts. Spectrawl is one package that does all of it. How It Works Spectrawl searches via Gemini Grounded Search (Google-quality results), scrapes the top pages for full content, and returns everything to your agent. Your agent's LLM reads the actual sources and forms its own answer — no pre-chewed summaries. Quick Start Why no summary by default? Your agent already has an LLM. If we summarize AND your agent summarizes, you're paying two LLMs for one answer. We return rich sources — your agent does the rest. Spectrawl vs Others Tavily Crawl4AI Firecrawl Stagehand Spectrawl --- --- --- --- --- --- Speed 2s 5s 3s 3s 6-10s Free tier 1,000/mo Unlimited 500/mo None 5,000/mo Returns Snippets + AI Markdown Markdown/JSON Structured Full page + structured Self-hosted No Yes Yes Yes Yes Anti-detect No No No No Yes (Camoufox) Block detection No No No No 8 services CAPTCHA solving No No No No Yes (Gemini Vision) Structured extraction No No No Yes Yes NL browser agen","default_branch":null,"files":null,"tree":[],"storefront":"/r/Pyx-Corp","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Pyx-Corp/spectrawl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}