{"repo":"DedSecInside/gotor","free":true,"listed":false,"github":"https://github.com/DedSecInside/gotor","clone":"git clone https://github.com/DedSecInside/gotor.git","description":"Concurrent Go web crawler with first-class Tor SOCKS5 support, a CLI, versioned JSON reports, and a job-controlled HTTP API.","language":"Go","stars":172,"topics":["golang","go","tor","torbot","cli","webscraping","osint","command-line","command-line-tool","osint-tools"],"license":"GPL-3.0","category":"cli-tools","readme_excerpt":"GoTor GoTor is a concurrent web crawler with first-class Tor SOCKS5 support. It can run as a human-friendly CLI, emit a versioned JSON crawl report, or expose a local job-control HTTP API for applications such as TorBot App. Requirements - Go 1.24 or newer - A Tor SOCKS5 proxy on 127.0.0.1:9050 by default (optional) Quick start Depth is inclusive: the root is depth 0 , so -depth 1 fetches the root and its direct links. HTTP API Start the service: Start and inspect a crawl job: Health and readiness probes are available at / healthz and / readyz . Tor configuration and proxy readiness are available at: The diagnostic reports whether the selected SOCKS endpoint is reachable, the detected torrc path, configured SOCKS and control ports, Tor data directory, and Tor executable. Set TORRC PATH when Tor uses a non-standard configuration location. See docs/API.md for the full request and response contract. Crawl controls GoTor skips oversized and non-HTML bodies by default but records those pages and the skip reason in the report. Per-page failures are also returned without discarding successful results. Container The image is a multi-stage, non-root distroless build: If the container needs a Tor proxy, attach it to the relevant network and pass -socks5-host when overriding the image command. Development GoTor is licensed under the GNU General Public License. See LICENSE.","default_branch":null,"files":null,"tree":[],"storefront":"/r/DedSecInside","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/DedSecInside/gotor/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}