{"repo":"JoeBashe/stl-scraper","free":true,"listed":false,"github":"https://github.com/JoeBashe/stl-scraper","clone":"git clone https://github.com/JoeBashe/stl-scraper.git","description":"Python scraper for Airbnb and short-term rental market research.","language":"Python","stars":84,"topics":["airbnb","elasticsearch","housing-data","python","scraper","short-term-rentals"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"stl-scraper - Short-Term Listings Scraper Scrape short-term listings providers (Airbnb). Given a search query, e.g. \"San Diego, CA\" or \"Rome, Italy\", search Airbnb inventory and collect data on listings. Save results to a CSV file or Elasticsearch. Notice This project is maintained on a best-effort basis; API changes may require updates. Usage Usage (basic installation) Usage (advanced installation) Options Requirements - Python = 3.10, or Docker Compose Installation Installation via pip (Option 1 - Basic) This option assumes you have Python = 3.10 installed, and that you will manage dependencies using the python venv module with pip . You can connect to your own instance of Elasticsearch. However, Elasticsearch is not required. Installation via docker compose (Option 2 - Advanced) This option uses docker compose to build: - jupyter-scipy-notebook : jupyter scipy notebook, python, conda - setup temporary container that configures elasticsearch & kibana security - es01 : elasticsearch container - kibana : kibana container Using kibana You can directly view records in Elasticsearch by using Kibana. 1. Scrape some listings using above commands 2. Browse to http://localhost:5601/app/management/kibana/dataViews (u: elastic / p: abc123) 3. Click \"Create new data view\" on top right 4. Use short-term-listings as name and index pattern 5. Click \"Save data view to Kibana\" 6. Click \"Analytics Discover\" on the main menu, selecting the short-term-listings data view, and see JSON records T","default_branch":null,"files":null,"tree":[],"storefront":"/r/JoeBashe","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/JoeBashe/stl-scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}