{"repo":"kaijchang/USNews-College-Scraper","free":true,"listed":false,"github":"https://github.com/kaijchang/USNews-College-Scraper","clone":"git clone https://github.com/kaijchang/USNews-College-Scraper.git","description":"US News College Rankings Scraper","language":"Python","stars":23,"topics":["us-news","college","scraper"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"US News College Scraper Really simple and modifiable scraper for US News' College Rankings. The included data.csv should have all the data you need, but you can modify the FIELDS variable in main.py to get other desired fields or remove unwanted fields. Default fields: Look at the items array in the data field of the search results (https://www.usnews.com/best-colleges/api/search? sort=schoolName& sortDirection=asc& page=1) to look at the structure to find the fields. If the DETAILED flag in main.py is set to true, the scraper will also scrape the page for each individual school for more data instead of just the aggregated search pages. This makes the scraping process about 10x slower, but adds the DETAIL FIELDS . The included data-detailed.csv was run with DETAILED on. Detail fields:","default_branch":null,"files":null,"tree":[],"storefront":"/r/kaijchang","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/kaijchang/USNews-College-Scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}