{"repo":"website-scraper/website-scraper-puppeteer","free":true,"listed":false,"github":"https://github.com/website-scraper/website-scraper-puppeteer","clone":"git clone https://github.com/website-scraper/website-scraper-puppeteer.git","description":"Plugin for website-scraper which returns html for dynamic websites using puppeteer","language":"JavaScript","stars":375,"topics":["nodejs","javascript","scraper","website-scraper","puppeteer","chrome","chromium","hacktoberfest"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"website-scraper-puppeteer Plugin for website-scraper which returns html for dynamic websites using puppeteer. Sponsors Maintenance of this project is made possible by all the contributors and sponsors. If you'd like to sponsor this project and have your avatar or company logo appear below click here. 💖 Requirements nodejs version = 20 website-scraper version = 5 Installation Installing Chrome Puppeteer normally downloads a compatible version of Chrome automatically during installation via a postinstall script. Starting with npm v12 , lifecycle scripts (including postinstall ) are disabled by default, so this automatic download no longer runs. You may then see an error like Could not find Chrome (ver. ...) when scraping. If you use npm v12 or newer (or another package manager that blocks install scripts, e.g. recent pnpm ), install Chrome manually after installing the packages: Alternatives: Re-enable install scripts by adding puppeteer to the allowScripts field in your package.json (or .npmrc ), so the browser is downloaded automatically again. Use a Chrome/Chromium already installed on your system by pointing Puppeteer to it via launchOptions.executablePath (or the PUPPETEER EXECUTABLE PATH environment variable). See Puppeteer's guide on why automatic downloads can be blocked for more details. Usage Puppeteer plugin constructor accepts next params: launchOptions - (optional) - puppeteer launch options, can be found in puppeteer docs gotoOptions - (optional) - puppeteer page","default_branch":null,"files":null,"tree":[],"storefront":"/r/website-scraper","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/website-scraper/website-scraper-puppeteer/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}