{"repo":"kcsoc/society-email-scrape","free":true,"listed":false,"github":"https://github.com/kcsoc/society-email-scrape","clone":"git clone https://github.com/kcsoc/society-email-scrape.git","description":"Scrapes Every Email Address of Every Society in Every University","language":"Python","stars":24,"topics":["scraper","beautifulsoup","beautifulsoup4","university","email","python","webscraping","webscraper","web-scraping","web-scraper"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"society-email-scrape Site Live at https://kcsoc.github.io/society-email-scrape/ How to automatically generate new data - Go to unis.yml - Add your uni - Create a Pull Request - GitHub Actions bot will automatically update as per your PR - When I approve the PR your Uni will automatically be loaded into the website - https://kcsoc.github.io/society-email-scrape/ How to run yourself Add any URLs to unis.yml PS: Don't forget to leave a trailing newline at the end of the file How to test for a single university 1. Choose a university (on your own or from unis.yml) 1. Run python main.py UNIVERSITY URL To run with debug mode The program features a debug mode. To enable it, simply preface the python command with DEBUG MODE=true For example: Or set the DEBUG MODE variable to true globally in your shell with, export DEBUG MODE=true Note: DEBUG MODE is enabled when the variable is set, to unset, use the unset keyword in bash","default_branch":null,"files":null,"tree":[],"storefront":"/r/kcsoc","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kcsoc/society-email-scrape/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}