{"repo":"get-set-fetch/extension","free":true,"listed":false,"github":"https://github.com/get-set-fetch/extension","clone":"git clone https://github.com/get-set-fetch/extension.git","description":"web scraping extension","language":"TypeScript","stars":87,"topics":["browser","extension","npm","indexeddb","scraper","crawler","javascript"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Browser Extension get-set, Fetch! is a browser extension for scraping sites through out a series of parametrizable scraping scenarios. Currently supported browsers: Chrome, Firefox, Edge. The most common use cases are handled by builtin scenarios: - Scrape Static Content - Extracts text and binary content from static html pages based on CSS selectors. - Scrape Dynamic Content - Extracts text and binary content from dynamic (javascript) pages based on CSS selectors. You can also install community based scenarios: - Extract Html Headings - v0.2.0 - \"Hello World\" example of writing a scrape scenario. - Extract Article Content - v0.2.0 - Extract article content using Mozilla Readability library. If you wrote a scraping scenario and want to share it, please update the above list and make a pull request. The extension is structured as a monorepo with the following sub-packages: - commons: mostly typescript definitions - background: parses pages and stores relevant data in the builtin browser database (IndexedDB) - popup: toolbar appearance - admin: front-end for the background capabilities - scrape-static-content: builtin scenario - scrape-dynamic-content: builtin scenario - extension: builds the extension files and runs a comprehensive suite of integration tests You can find technical tidbits in each sub-package readme file. A detailed documentation with a series of examples is available at getsetfetch.org.","default_branch":null,"files":null,"tree":[],"storefront":"/r/get-set-fetch","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/get-set-fetch/extension/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}