{"repo":"naiba/proxy-in-a-box","free":true,"listed":false,"github":"https://github.com/naiba/proxy-in-a-box","clone":"git clone https://github.com/naiba/proxy-in-a-box.git","description":"Automatic proxy pool for web scraping - crawls, validates, and rotates proxies with rate limiting and MITM support","language":"Go","stars":41,"topics":["proxies","proxy-list","crawler","golang","http-proxy","mitm","proxy-pool","proxy-server","web-scraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Proxy-in-a-Box Automatic proxy pool for web scraping. Crawls proxies from YAML-defined sources, validates them, and provides HTTP/HTTPS proxy servers with automatic rotation and TLS fingerprint spoofing. 中文说明 Features - YAML-driven sources — All proxy sources defined as YAML configs with Lua scripting for complex logic - Headless browser scraping — Integrated Obscura with anti-detection enabled by default for JS-rendered pages (e.g. IPRoyal) - Auto-validation — Concurrent proxy verification with configurable worker pool - Smart rotation — Automatic proxy assignment based on domain and IP limits - TLS fingerprint spoofing — Uses uTLS to mimic Chrome browser fingerprints - MITM support — Built-in man-in-the-middle proxy for HTTPS traffic - SQLite storage — Lightweight embedded database, no external dependencies Quick Start Docker (Recommended) From Source Usage Test a Source Fetches proxies from the specified source YAML file and verifies their availability. Use -w to set concurrent verification workers (default: 20). Configure your application to use the proxy: Management Dashboard & API: Configuration data/pb.yaml : Proxy Sources Sources are YAML files in data/sources/ . Three types supported: text — Plain text IP:Port lists json — JSON API with field paths script — Lua scripts for complex logic Lua globals: fetch(url, headers?) , sleep(ms) , json decode(str) , json encode(table) , browser fetch(url) , browser eval(expression) Browser-powered scraping (for JS-rendered pages) ","default_branch":null,"files":null,"tree":[],"storefront":"/r/naiba","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/naiba/proxy-in-a-box/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}