{"repo":"DasDigitaleMomentum/searxNcrawl","free":true,"listed":false,"github":"https://github.com/DasDigitaleMomentum/searxNcrawl","clone":"git clone https://github.com/DasDigitaleMomentum/searxNcrawl.git","description":"MCP Server and CLI Tools for searxing and fetching websites","language":"Python","stars":152,"topics":[],"license":"MIT","category":"mcp-servers","readme_excerpt":"searxNcrawl MCP server and CLI toolkit for web search and crawling, built on Crawl4AI and SearXNG. Published at github.com/DasDigitaleMomentum/searxNcrawl — maintained by DDM – Das Digitale Momentum GmbH & Co KG . Successor to searxng-mcp . Quick Start Pick your setup: Docker Compose MCP server with Playwright/Chromium, ready in one command. SearXNG required separately for search. ➜ MCP server at http://localhost:9555/mcp pip (standalone) CLI tools, Python API, and MCP server. SearXNG required for search. uv (standalone) Same capabilities as pip. What you get Feature Docker Compose pip / uv ----------------------- -------------- --------- MCP Server (STDIO) — ✅ MCP Server (HTTP) ✅ ✅ Web Crawl ✅ ✅ Web Search ✅¹ ✅¹ CLI Tools via exec ² ✅ Python API — ✅ CORS (HTTP) ✅ ✅ ¹ Requires a SearXNG instance. ² docker compose exec searxncrawl crawl ... Features Crawling - Single page, multi-page, and site crawling (DFS with depth/page limits) - Production-tested extraction config optimized for documentation sites - Configurable timeouts with graceful error handling Content Quality - Markdown deduplication — exact (default) removes repeated blocks, off disables it - Link removal — strip all links for cleaner LLM context ( --remove-links ) - Dedup guardrails — non-destructive metadata signals when removal is unusually aggressive Web Search - SearXNG metasearch integration (privacy-respecting) - Configurable language, time range, categories, engines, safe search MCP Server - STDIO transport ","default_branch":null,"files":null,"tree":[],"storefront":"/r/DasDigitaleMomentum","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/DasDigitaleMomentum/searxNcrawl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}