{"repo":"stav/wgrep","free":true,"listed":false,"github":"https://github.com/stav/wgrep","clone":"git clone https://github.com/stav/wgrep.git","description":"Web grep: search all rendered resources used by a URI","language":"JavaScript","stars":91,"topics":["web","grep-like","node","puppeteer"],"license":"Apache-2.0","category":"scrapers-browser-automation","readme_excerpt":"wgrep Web grep: search all rendered resources used by a URI [![Coverage][cov-image]][cov-url] [![Releases][rel-image]][rel-url] [![Build][build-image]][build-url] This node command-line utility uses a headless browser (Puppeteer) to render a webpage and download all resources it may need. These resources including the original HTML are all saved locally which it searches one-by-one for a text string. Since we are downloading all resources it is easy to determine the total download size. Features Search using regular expressions A screen capture is created (not configurable) Installation $ git clone https://github.com/stav/wgrep.git $ cd wgrep $ npm install Usage example Let's try to find the string \"stav\" from the repository website on GitHub: $ npx wgrep stav https://github.com/stav/wgrep Calling for \"stav\" in \"output\" from \"https://github.com/stav/wgrep\" with user \"undefined\" Looking in \"output\" for 'stav' Found 1 files [ 'output/stav/wgrep/index.html' ] It was only found in the index.html page. Now let's see what the total download size was: $ du -sh output 1.4M output Options $ wgrep --help Usage: wgrep [options] Options: -V, --version output the version number -d, --directory The output directory (default: \"output\") -u, --username The user to authenticate as -h, --help output usage information Tests $ npm test $ npm run test-e2e Contributing Please file any issues you have. If you fix a bug or add new features it would be great to have you fork this repo and submit a pul","default_branch":null,"files":null,"tree":[],"storefront":"/r/stav","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/stav/wgrep/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}