{"repo":"apify-projects/store-website-checker","free":true,"listed":false,"github":"https://github.com/apify-projects/store-website-checker","clone":"git clone https://github.com/apify-projects/store-website-checker.git","description":"Analyzes target website for anti-scraping protections and performance. Saves screenshots/HTML snapshots.","language":"TypeScript","stars":12,"topics":["scraper","apify"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"Website Checker Website checker is a simple actor that allows you to scan any website for performance and blocking using various scraping methods as Cheerio, Puppeteer and Playwright. Features The actor provides these useful features out of the box: - Collects response status codes - Recognizes the most common captchas - Saves HTML snapshots and screenshots (if Puppeteer or Playwright is chosen) - Enables choosing between Cheerio (plain HTTP) and Puppeteer/Playwright (browser) scraper - Enables choosing different browsers for Playwright - Chrome, Firefox and Webkit (Safari) - Enables re-scraping start URLs or enqueueing with a familiar link selector + pseudo URLs system - Handles different failure states like timeouts and network errors - Enables basic proxy and browser configuration How to use The most common use-case is to do a quick check on how aggressively the target site is blocking. In that case just supply a start URL, ideally a category one or product one. You can either set replicateStartUrls or add enqueueing with linkSelector + pseudoUrls , both are good options to test different proxies. You can pick any combination of run options and the checker will spawn runner actor for every combination of scraping tool & proxies and then combine the results into single output. In the end you will get a simple statistics about the blocking rate. It is recommended to check a few screenshots just to make sure the actor correctly recognized the page status. You can get to the d","default_branch":null,"files":null,"tree":[],"storefront":"/r/apify-projects","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/apify-projects/store-website-checker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}