{"repo":"godkingjay/selenium-twitter-scraper","free":true,"listed":false,"github":"https://github.com/godkingjay/selenium-twitter-scraper","clone":"git clone https://github.com/godkingjay/selenium-twitter-scraper.git","description":"This is a Twitter Scraper which uses Selenium for scraping tweets. It is capable of scraping tweets from home, user profile, hashtag, query or search, and advanced searches.","language":"Jupyter Notebook","stars":303,"topics":["scraper","selenium-scraper","twitter","twitter-scraper","web-crawling","hacktoberfest","hacktoberfest-accepted","collaborate","selenium"],"license":"Apache-2.0","category":"scrapers-browser-automation","readme_excerpt":"selenium-twitter-scraper Setup 1. Install dependencies Authentication Options Using Environment Variable 1. Rename .env.example to .env . 2. Open .env and update environment variables Authentication in Terminal - Add a username and password to the command line. No Authentication Provided - If you didn't specify a username and password, the program will ask you to enter a username and password. --- Authentication Sequence Priority --- Usage - Show Help - Basic usage - Setting maximum number of tweets. defaults to 50 . - Options and Arguments Sample Scraping Commands - Custom Limit Scraping - User Profile Scraping - Hashtag Scraping - Latest - Top - Query or Search Scraping (Also works with twitter's advanced search.) - Latest - Top - Advanced Search Scraping - For tweets mentioning @elonmusk : - For tweets that mentions @elonmusk with at least 1000 replies from January 01, 2020 - August 31, 2023 : - Perform more Advanced Search using Twitter's Advanced Search, just setup the advanced query and copy the resulting string query to the program: - Twitter Advanced Search - Scrape Additional Data Values Description :----: :------------------------------------------------- pd Tweet poster's id, followers, and following count. ---","default_branch":null,"files":null,"tree":[],"storefront":"/r/godkingjay","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/godkingjay/selenium-twitter-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}