{"repo":"kpliuta/termux-web-scraper","free":true,"listed":false,"github":"https://github.com/kpliuta/termux-web-scraper","clone":"git clone https://github.com/kpliuta/termux-web-scraper.git","description":"A robust and flexible web scraping framework designed to run on Android devices using Termux. It leverages a proot-distro Ubuntu container to create a powerful and isolated scraping environment, enabling you to run complex Selenium-based web scraping tasks on your Android device.","language":"Shell","stars":37,"topics":["android","python","selenium","termux","web-scraping","proot-distro"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Termux Web Scraper A robust and flexible web scraping framework designed to run on Android devices using Termux. It leverages a proot-distro Ubuntu container to create a powerful and isolated scraping environment, enabling you to run complex Selenium-based web scraping tasks on your Android device. The Droid You're Looking For: Scraping Websites on Android with Termux Features Run Selenium on Android: Execute web scraping scripts using Selenium and Firefox within a Termux environment. Isolated Environment: Utilizes a proot-distro Ubuntu container to provide a clean and isolated environment for your scraping tasks. Headed Operation: Runs Firefox in a headed mode using a VNC server, allowing the execution of complex scenarios while bypassing headless browser detection. Flexible and Extensible: The framework is designed to be modular and extensible, allowing you to easily add your own scraping logic, error handling, and notification mechanisms. Continuous Operation: The run.sh script supports a loop mode, allowing you to run your scrapers continuously at a specified interval. Easy to Use: The framework provides a simple and intuitive builder pattern for creating and configuring your scrapers. How it Works The Termux Web Scraper works by setting up a complete web scraping environment on your Android device. Here's a high-level overview of the architecture: 1. Termux Environment: The main run.sh script is executed in the Termux environment. It handles the initial setup, argument p","default_branch":null,"files":null,"tree":[],"storefront":"/r/kpliuta","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kpliuta/termux-web-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}