{"repo":"apify/super-scraper","free":true,"listed":false,"github":"https://github.com/apify/super-scraper","clone":"git clone https://github.com/apify/super-scraper.git","description":"Generic REST API for scraping websites. Drop-in replacement for ScrapingBee, ScrapingAnt, and ScraperAPI services. And it is open-source!","language":"TypeScript","stars":43,"topics":["api","scraping","apify","cheerio","javascript","nodejs","playwright","typescript","web-scraping"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"SuperScraper API SuperScraper API is an Actor that provides a REST API for scraping websites. Just pass the URL of a web page and get back the fully rendered HTML content. SuperScraper API is compatible with ScrapingBee, ScrapingAnt, and ScraperAPI interfaces. Main features: - Extract HTML from arbitrary URLs with a headless browser for dynamic content rendering. - Circumvent blocking using datacenter or residential proxies, as well as browser fingerprinting. - Seamlessly scale to a large number of web pages as needed. - Capture screenshots of the web pages. Note that SuperScraper API uses the new experimental Actor Standby mode, so it's not started the traditional way from Apify Console. Instead, it's invoked via the HTTP REST API provided directly by the Actor. See the examples below. Usage examples To run these examples, you need an Apify API token, which you can find under Settings Integrations in Apify Console. You can create an Apify account free of charge. Node.js curl Authentication The best way to authenticate is to pass your Apify API token using the Authorization HTTP header. Alternatively, you can pass the API token via the token query parameter to authenticate the requests, which is more convenient for testing in a web browser. Node.js curl Pricing When using SuperScraper API, you're charged based on your actual usage of the Apify platform's computing, storage, and networking resources. Cost depends on the target sites, your settings and API parameters, the load ","default_branch":null,"files":null,"tree":[],"storefront":"/r/apify","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/apify/super-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}