{"repo":"edermi/skweez","free":true,"listed":false,"github":"https://github.com/edermi/skweez","clone":"git clone https://github.com/edermi/skweez.git","description":"Fast website scraper and wordlist generator","language":"Go","stars":84,"topics":["pentest","wordlist-generator","crawler","password-spraying"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"skweez skweez (pronounced like \"squeeze\") spiders web pages and extracts words for wordlist generation. It is basically an attempt to make a more operator-friendly version of CeWL. It is written in Golang, making it far more portable and performant than Ruby. Build / Install Binary Releases You may use binary releases from the release section for your favorite operating system. Build from source Assuming you have Go 1.18+ (probably works on older versions too) installed and working, just clone the repo and do a go build or use go get github.com/edermi/skweez . Usage ./skweez -h skweez is a fast and easy to use tool that allows you to (recursively) crawl websites to generate word lists. Usage: skweez domain1 domain2 domain3 [flags] Flags: --debug Enable Debug output -d, --depth int Depth to spider. 0 = unlimited, 1 = Only provided site, 2... = specific depth (default 2) -h, --help help for skweez --json Write words + counts in a json file. Requires --output/-o -n, --max-word-length int Maximum word length (default 24) -m, --min-word-length int Minimum word length (default 3) --no-filter Do not filter out strings that don't match the regex to check if it looks like a valid word (starts and ends with alphanumeric letter, anything else in between). Also ignores --min-word-length and --max-word-length --onlyascii When set, filter out non ASCII words -o, --output string When set, write an output file --scope strings Additional site scope, for example subdomains. If not set, only th","default_branch":null,"files":null,"tree":[],"storefront":"/r/edermi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/edermi/skweez/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}