{"repo":"zhaow-de/rotating-tor-http-proxy","free":true,"listed":false,"github":"https://github.com/zhaow-de/rotating-tor-http-proxy","clone":"git clone https://github.com/zhaow-de/rotating-tor-http-proxy.git","description":"A multi-arch image provides one HTTP proxy endpoint with many concurrent tunnels to the Tor network.","language":"Shell","stars":266,"topics":["docker-image","dockerhub-image","tor","proxy","privoxy-tor","haproxy","crawler","amd64","arm64","armv6"],"license":"MIT","category":"networking-infra","readme_excerpt":"rotating-tor-http-proxy This Docker image provides one HTTP proxy endpoint with many IP addresses for use scenarios like web crawling. Behind the scene, it has a HAProxy sitting in front of multiple pairs of Privoxy-Tor. The HAProxy dispatches the incoming requests to the Privoxy instances with a round-robin strategy. Usage This image is multi-platform enabled, currently supporting: - amd64 (x86 64) - arm64 (aarch64) - arm/v7 (armhf) - arm/v6 (armel) Simple case At the host, 127.0.0.1:3128 is the HTTP/HTTPS proxy address. Moreover Port 4444/TCP Port 4444/TCP can be mapped to the host if HAProxy stats information is needed. With docker run -p 4444:4444 , the HAProxy statistics report is available at http://127.0.0.1:4444. An article from the HAProxy official blog explains in detail how to understand this report. TOR INSTANCES Environment variable TOR INSTANCES can be used to config the number of concurrent Tor clients (as well as the associated Privoxy instances). The default is 10, and the valid value is purposely limited to the range between 1 and 40. TOR REBUILD INTERVAL Each Tor client attempts to build a new circuit (results in a new outbound IP address) every 30 seconds. Every 30 minutes, this image rebuilds all the circuits. This interval can be changed with environment variable TOR REBUILD INTERVAL , the default value is 1800 seconds, while it can be set up any number greater than 600 seconds. TOR EXIT COUNTRY For some crawling tasks, it requires limiting the IP addres","default_branch":null,"files":null,"tree":[],"storefront":"/r/zhaow-de","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/zhaow-de/rotating-tor-http-proxy/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}