{"repo":"projectdiscovery/katana","free":true,"listed":false,"github":"https://github.com/projectdiscovery/katana","clone":"git clone https://github.com/projectdiscovery/katana.git","description":"A next-generation crawling and spidering framework.","language":"Go","stars":17329,"topics":["crawler","web-spider","gocrawler","spider-framework","cli","headless","hacktoberfest"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"A next-generation crawling and spidering framework Features • Installation • Usage • Scope • Config • Filters • Join Discord Features - Fast And fully configurable web crawling - Standard and Headless mode - JavaScript parsing / crawling - Customizable automatic form filling - Scope control - Preconfigured field / Regex - Knowledge base - ML page-type / form classification (auto-downloaded model) - Customizable output - Preconfigured fields - INPUT - STDIN , URL and LIST - OUTPUT - STDOUT , FILE and JSON Installation katana requires Go 1.26+ to install successfully. If you encounter any installation issues, we recommend trying with the latest available version of Go, as the minimum required version may have changed. Run the command below or download a pre-compiled binary from the release page. More options to install / run katana- Docker To install / update docker to latest tag - To run katana in standard mode using docker - To run katana in headless mode using docker - Ubuntu It's recommended to install the following prerequisites - install katana - Usage This will display help for the tool. Here are all the switches it supports. Running Katana Input for katana katana requires url or endpoint to crawl and accepts single or multiple inputs. Input URL can be provided using -u option, and multiple values can be provided using comma-separated input, similarly file input is supported using -list option and additionally piped input (stdin) is also supported. URL Input Multiple URL","default_branch":null,"files":null,"tree":[],"storefront":"/r/projectdiscovery","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/projectdiscovery/katana/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}