{"repo":"Narenpradhan/WatchTower","free":true,"listed":false,"github":"https://github.com/Narenpradhan/WatchTower","clone":"git clone https://github.com/Narenpradhan/WatchTower.git","description":"WatchTower - A platform to save your valuable time while staying updated in the Cyber realm.","language":"Python","stars":18,"topics":["bash-scripting","digitalocean","pandas","python3","requests","scrapy","vercel-deployment","web-scraping-python","cybersecurity"],"license":"MIT","category":"security-tools","readme_excerpt":"Table of Contents - Introduction - Interfaces - Automation - Technologies Used - Features - Future Scope - License Introduction WatchTower is a specialized platform created to aggregate cybersecurity news by utilizing the Scrapy library in Python, along with additional libraries such as Pandas, Requests, Datetime,etc. for efficient data processing. The platform extracts information from three specified websites, consolidates the data into a unified JSON file, and subsequently utilizes this file to display the curated information on its website. Link : https://watch-tower-ochre.vercel.app/ Interfaces Desktop Phone Automation This project leverages Digital Ocean's droplet to automate a web scraping process using a Bash script. The script is set to run at specified intervals every day, utilizing the cron scheduler. The primary goal is to execute the web scraper, generate a consolidated JSON data file, and seamlessly push all changes to this repository. How it Works 1. Digital Ocean Droplet Setup : The project relies on a Digital Ocean droplet for automation. 2. Bash Script : A bash script has been crafted to orchestrate the entire process. It triggers the web scraper, collects data, compiles it into a unified JSON file, and handles the GitHub commit and push operations. 3. Cron Job Scheduling : The script is scheduled to run at specified intervals using cron. This ensures that the web scraper executes automatically at the defined times each day. 4. GitHub Integration : All chang","default_branch":null,"files":null,"tree":[],"storefront":"/r/Narenpradhan","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Narenpradhan/WatchTower/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}