{"repo":"usestring/web-data-frontier-benchmark","free":true,"listed":false,"github":"https://github.com/usestring/web-data-frontier-benchmark","clone":"git clone https://github.com/usestring/web-data-frontier-benchmark.git","description":"Compare web access APIs (web unblockers / scrape APIs) head-to-head against a fixed suite of ~90 real-world, hard-to-scrape URLs","language":"TypeScript","stars":17,"topics":["scraping","webdata","benchmark","evaluation","proxy","web-scraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Web Data Frontier Benchmark Compare web access APIs (web unblockers / scrape APIs) head-to-head against a fixed suite of 99 real-world, bot-protected URLs (Amazon, Walmart, Zillow, Cloudflare/PerimeterX-guarded retail and travel sites, etc.). Each provider is sent the same URLs; a request passes when the API returns a 2xx status and the response body contains the page's expected text. Read the full write-up: The Web Scraping Benchmark Problem. Results Official run: August 11, 2026 (99 targets × 5 attempts × 15 providers = 7,425 requests; raw data in official results/benchmark-2026-08-11T22-44-25-322Z.json ). Rank Provider Success rate Latency score Passed ---: ----------- -----------: ------------: ------: 1 string 97.0% 9.98s 480/495 2 scrapfly 82.0% 18.35s 406/495 3 context dev 79.2% 12.68s 392/495 4 firecrawl 78.6% 9.21s 389/495 5 bright 78.0% 26.14s 386/495 6 oxylabs 76.8% 14.67s 380/495 7 zyte 72.7% 14.85s 360/495 8 decodo 70.7% 22.63s 350/495 9 nimble 66.3% 18.41s 328/495 10 scraperapi 64.2% 13.65s 318/495 11 scrapingdog 54.3% 12.51s 269/495 12 browserbase 42.2% 14.19s 209/495 13 zenrows 34.3% 17.60s 170/495 14 scrapingant 30.7% 16.08s 152/495 15 scrapingbee 29.7% 16.97s 147/495 Latency scoring Latency is an equal-weighted average across target URLs. For a provider that returns verified content, the target score is the nearest-rank 75th percentile of its successful attempt latencies; failed attempts do not contribute a fast response time. For a provider with no verified","default_branch":null,"files":null,"tree":[],"storefront":"/r/usestring","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/usestring/web-data-frontier-benchmark/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}