{"repo":"nstapelbroek/estate-crawler","free":true,"listed":false,"github":"https://github.com/nstapelbroek/estate-crawler","clone":"git clone https://github.com/nstapelbroek/estate-crawler.git","description":"Scraping the real estate agencies for up-to-date house listings as soon as they arrive!","language":"Python","stars":26,"topics":["python","scrapy-crawler","scrapy","crawler","real-estate-agencies","appartments","nederland","huurwoningen"],"license":"BSD-3-Clause","category":"scrapers-browser-automation","readme_excerpt":"Estate Crawler Finding a place to live can be tough. If for any reason you are unable to buy a house, the search for a rental apartment can cost you a lot of time and money. Real estate agencies will often charge you before you've even visited your first potential \"object\". The subscriptions they force upon you are unfair and do not guarantee success of finding a place to live. This project aims to relieve some pain by giving you insights of the offers at several agencies. By collecting and comparing this data, you can pick an agency that is best suited for your needs. Saving you time and potentially money. Usage You can run the estate crawler by executing the crawler.py file. Below is an example with Python3 and pipenv installed on your OS: If you have the luxury of Docker available on your system, you can run the crawler without installing any dependencies like so: Results of your crawl run are available in ./build/results.json after a successful run. You can change this path by passing a --output-file argument. Note that the output file does not contain valid json, only valid json lines.","default_branch":null,"files":null,"tree":[],"storefront":"/r/nstapelbroek","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/nstapelbroek/estate-crawler/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}