{"repo":"vdutts7/gpt4V-scraper","free":true,"listed":false,"github":"https://github.com/vdutts7/gpt4V-scraper","clone":"git clone https://github.com/vdutts7/gpt4V-scraper.git","description":"AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser.","language":"JavaScript","stars":310,"topics":["ai-agents","browser-automation","gpt-4-vision","puppeteer","web-scraping"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"GPT-4v Web Agent AI agent that can SEE 👁️, control, navigate, & do stuff for you on your browser [![Github][github]][github-url] Table of Contents 💸 FREE 200 USD cloud credits 📝 About 💻 How to build 🔧 Tools used 👤 Contact 💸FREE 200 USD cloud credits Click the banner to activate $200 free personal cloud credits on DigitalOcean (deploy anything). 📝About - Automated web scraping tool for capturing full-page screenshots. - Utilizes Puppeteer with a stealth plugin to avoid detection by anti-bot mechanisms. - Designed for efficiency with customizable timeout settings. 💻How to build Part 1: Screenshot + Scrape - Run npm i to install dependencies (Puppetteer libraries, see package.json for details). - Copy .env.template and rename this new file .env . Then add your OPENAI API KEY and save the file. Run source .env properly mount this into the environment. - Set up browser confguration to allow for websites that require login authentication (LinkedIn, Instagram, etc). Make sure you log in ahead of time, that way your browser agent can access content without problems. For paywalled sites, it is your choice but hey: https://removepaywall.com/ . This is a GitHub project, not a moral essay, so decide for yourself and move on. I will say, however, that sites such as NYT, CNN, FOX, Guardian, etc., shouldn't be misrepresenting themselves as \"news\" when they're making you pay for truth. But I (and you probably if you're the type of person reading a GitHub project description) see not","default_branch":null,"files":null,"tree":[],"storefront":"/r/vdutts7","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vdutts7/gpt4V-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}