{"owner":"crawler-commons","github":"https://github.com/crawler-commons","claimed":false,"inventory":[],"indexed":[{"repo":"crawler-commons/crawler-commons","github":"https://github.com/crawler-commons/crawler-commons","description":"A set of reusable Java components that implement functionality common to any web crawler","language":"Java","stars":258,"topics":["web-crawler","java","sitemaps","robots-txt","open-source","library","robotstxt"],"license":"Apache-2.0","category":"scrapers-browser-automation"}],"how_to_buy":"GET /r/crawler-commons/<repo> (Accept: application/json) for any listed repo here: tree, README, price and the checkout to pay (x402; rehearse first at its test twin, simulated money). Repos under 'indexed' are free: clone them from GitHub."}