{"repo":"DannyBen/snapcrawl","free":true,"listed":false,"github":"https://github.com/DannyBen/snapcrawl","clone":"git clone https://github.com/DannyBen/snapcrawl.git","description":"Crawl a website and take screenshots","language":"Ruby","stars":60,"topics":["crawler","screenshot","capture","ruby","gem"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Snapcrawl - crawl a website and take screenshots Snapcrawl is a command line utility for crawling a website and saving screenshots. --- :warning: Project Status: On Hold Snapcrawl relies on two deprecated libraries: - Webshot (last updated in August 2020) - PhantomJS (last updated around 2020) As such, the project is no longer actively maintained and is unlikely to receive updates or bug fixes. If you are interested in contributing and have ideas for replacing these libraries with modern alternatives, you are welcome to propose changes via pull requests or issues. --- Features - Crawls a website to any given depth and saves screenshots - Can capture the full length of the page - Can use a specific resolution for screenshots - Skips capturing if the screenshot was already saved recently - Uses local caching to avoid expensive crawl operations if not needed - Reports broken links Install Using Docker You can run Snapcrawl by using this docker image (which contains all the necessary prerequisites): For more information on the Docker image, refer to the [docker-snapcrawl][3] repository. Using Ruby Note that Snapcrawl requires [PhantomJS][1] and [ImageMagick][2]. Usage Snapcrawl can be configured either through a configuration file (YAML), or by specifying options in the command line. The default configuration filename is snapcrawl.yml . Using the --config flag will create a template configuration file if it is not present: Specifying options in the command line All configuration ","default_branch":null,"files":null,"tree":[],"storefront":"/r/DannyBen","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/DannyBen/snapcrawl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}