{"repo":"mostafam-dev/ScraperGuard","free":true,"listed":false,"github":"https://github.com/mostafam-dev/ScraperGuard","clone":"git clone https://github.com/mostafam-dev/ScraperGuard.git","description":"Production-grade observability layer for web scraping pipelines. Detects when scrapers silently break and explains why.","language":"Python","stars":12,"topics":["data-quality","dom-diffing","montoring","observability","playwright","python","schema-validations","scrapy","webscraping"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"ScraperGuard Production-grade observability and reliability layer for web scraping pipelines. ScraperGuard detects when scrapers silently break — and explains why. --- The Problem Web scrapers don't crash. They silently drift . An HTTP 200 OK doesn't mean your data is correct. In production, scraper failures look like this: - A CSS selector still matches — but the value is wrong - A field exists — but is now null in 80% of responses - A layout variant appears — and extraction accuracy drops to 60% - Your pipeline keeps running — shipping corrupted data downstream for days Most scraping tools focus on extraction . Nothing focuses on correctness . ScraperGuard fills that gap. --- What It Does Capability What Others Do What ScraperGuard Does ------------------------ -------------------------------- ---------------------------------------------------------------------------------------- Change Detection Compare raw HTML / rendered text Structural DOM diffing — detects element removal, attribute shifts, reordering Validation HTTP 200 = success Schema-level enforcement — missing fields, null drift, type mismatches, range violations Failure Diagnosis \"Scraper failed\" Root-cause attribution — selector break, CAPTCHA, JS challenge, A/B variant Reliability Tracking Job succeeded / failed Health scores, field completeness, selector stability, structural stability --- Quick Demo (2 Minutes) Scenario: You monitor product prices on an e-commerce site. The site silently redesigns their pric","default_branch":null,"files":null,"tree":[],"storefront":"/r/mostafam-dev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/mostafam-dev/ScraperGuard/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}