{"repo":"luisra51/gurl","free":true,"listed":false,"github":"https://github.com/luisra51/gurl","clone":"git clone https://github.com/luisra51/gurl.git","description":"An intelligent web crawler built in Go that extracts email addresses from websites with precision and speed.","language":"Go","stars":30,"topics":["crawler","email"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"GURL - Go URL Email Crawler An intelligent web crawler built in Go that extracts email addresses and social profiles from websites with precision and speed. 🚀 Fast, intelligent, and scalable email discovery for modern web applications ✨ Features - 🧠 Intelligent Crawling : Prioritizes contact and information pages - 🌍 Multi-language Support : Recognizes keywords in 6 languages (Spanish, English, French, German, Italian, Portuguese) - 🔄 Meta Redirects : Automatically follows HTML meta redirects - ⚡ Redis Cache : Smart caching with 12-month persistence and 5,400x speed improvement - 🚀 Async Processing : Background jobs with webhook notifications - 🔍 Auto Deduplication : Automatically removes duplicate emails - 🌐 Social Discovery : Extracts social profile links from known platforms - 🐳 Dockerized : Easy deployment with Docker Compose - 📡 REST API : Both synchronous and asynchronous endpoints - ⚙️ Configurable Depth : Explore up to 3 levels deep (configurable) - 🛡️ Input Guardrails : Accepts only absolute HTTP/HTTPS URLs - 📏 Crawl Limits : Restricts per-page response size and total pages visited - ♻️ Async Recovery : Requeues interrupted processing jobs on restart ☕ Support If you like this project, consider buying me a coffee ☕💛 📋 Requirements - Docker - Docker Compose 🚀 Quick Start Option 1: Use Pre-built Docker Image (Recommended) Option 2: Clone and Build from Source 2. Use the API Service will be available at http://localhost:8080 The service assumes authenticat","default_branch":null,"files":null,"tree":[],"storefront":"/r/luisra51","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/luisra51/gurl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}