{"repo":"DrankRock/AutoScrape","free":true,"listed":false,"github":"https://github.com/DrankRock/AutoScrape","clone":"git clone https://github.com/DrankRock/AutoScrape.git","description":"A 10-in-one scraper with parsers as plugins","language":"Python","stars":24,"topics":["parsing","playwright","python3","scraping","selenium","seleniumbase"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Scrape a list of urls with 10 different technologies, automatically, and parse the results with your own custom plugin. Disclaimer About this project This project was made using the infamous method of vibe coding , using Claude 3.7. I understand most of it, but the javascript using Ulixee Hero is not something i'm comfortable with. I highly encourage anyone who wants to modify it to do so. If anyone wants to fork it and update it regularly, be my guest, and I'll reference you there. About testing environment All testing was performed on Windows 11 with Python 3.12.4 and the latest versions of supported browsers. Performance and compatibility with other operating systems cannot be guaranteed. Users on Linux or MacOS may need to modify certain components to achieve functionality. About liability This software is provided for personal use in a protected environment only. I cannot and will not be held responsible for any misuse, illegal use, or any damages that may occur from using this software. Users are solely responsible for ensuring they comply with all applicable laws, terms of service, and policies when using this tool. By downloading or using this software, you acknowledge that you assume all risks associated with its use. Software View Example Comparison: Headless vs Not Headless Mode Hero + stealth Not Headless Standard Selenium Headless Setup Run the script setup.bat to : 1) Install Python3 if not installed 2) Install all the python dependencies 3) Install npm / javasc","default_branch":null,"files":null,"tree":[],"storefront":"/r/DrankRock","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/DrankRock/AutoScrape/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}