{"repo":"davidycliao/bisCrawler","free":true,"listed":false,"github":"https://github.com/davidycliao/bisCrawler","clone":"git clone https://github.com/davidycliao/bisCrawler.git","description":"An Automation Webcrawler for Extracting Central Bankers' Speeches","language":"Python","stars":10,"topics":["speeches","python","bank-for-international-settlements","central-bankers-speeches","text-as-data","scraper","scraping","central-banker"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"bisCrawler: An Automation Webcrawler for Extracting Central Bankers' Speeches 🛠️🧰 An automation web crawling framework for retrieving for Extracting Central Bankers' Speeches on the Website of Bank for International Settlements (https://www.bis.org) based on Selenium and Chrome browser. Environment Setup 1. Need to install Anaconda Navigator and Python =3.9 beforehand. And then, open the terminal and download bisCrawler repository by using git clone . About how to use git and Github, please have a look at this Tutorial for Beginners. 2. Copy the commands below and paste them into the terminal: Instruction 1. Activate the pre-named enviroment. Alternatively, the environment for bisCrawler can be opened via Anaconda Navigator 2. Install the dependencies from requirements.txt using pip methond. 3. Call bisCrawler Moduel - In the terminal: - In Jupyter Notebook: 4. When Running bisCrawler When bisCrawler is running, you will be asked which page you would like to scrape (please, type any single digit from 1 to last page). Then bisCrawler will automatically generate pandas dataframe to restore the banker speeches and the urls to the textual document. What bisCrawler Scrapes This designed crawler automatically webscrapes the central bankers' speeches from the offical website, including a bunch of information with regards to each name of central banker, date and title and corresponding url to the textual document. Websraped Data The scraped dataframe will be stored as central bank ","default_branch":null,"files":null,"tree":[],"storefront":"/r/davidycliao","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/davidycliao/bisCrawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}