{"repo":"x-way/crawlerdetect","free":true,"listed":false,"github":"https://github.com/x-way/crawlerdetect","clone":"git clone https://github.com/x-way/crawlerdetect.git","description":"Golang module to detect bots and crawlers via the user agent","language":"Go","stars":70,"topics":["go","crawler-detection","bot-detection","crawler","spider","detect","user-agent"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"crawlerdetect About crawlerdetect is a Go version of PHP class @CrawlerDetect. It helps to detect bots/crawlers/spiders via the user agent and other HTTP-headers. Currently able to detect 1,000's of bots/spiders/crawlers. Installation go get github.com/x-way/crawlerdetect Basic Usage Contributing The patterns and testcases are synced from the PHP repo. If you find a bot/spider/crawler user agent that crawlerdetect fails to detect, please submit a pull request with the regex pattern and a testcase to the upstream PHP repo.","default_branch":null,"files":null,"tree":[],"storefront":"/r/x-way","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/x-way/crawlerdetect/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}