{"repo":"desiquant/news_scraper","free":true,"listed":false,"github":"https://github.com/desiquant/news_scraper","clone":"git clone https://github.com/desiquant/news_scraper.git","description":"Scrapes indian market news data","language":"Python","stars":16,"topics":["indian-stock-market","scrapy","scrapy-crawler"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"DesiQuant: News Scraper A scrapy crawler that scrapes market news from Indian financial news outlets A scrapy crawler that scrapes market news from Indian financial news outlets Publisher Sitemap Type --------------------------------------------------------------- ------------------------------------------------------------------------------------------------ News 18 Daily The Hindu Daily The Hindu Business Line Daily Business Today Daily Money Control Monthly Business Standard Monthly Economic Times Monthly Firstpost Daily NDTV Profit Daily Free Press Journal Daily Outlook India Daily Zee News Monthly Financial Express Daily Indian Express Daily CNBCTV18 Daily Data Usage You can readily consume the data without setting up any infrastructure. The data is publicly accessible and updated every 1 hour. The entire data dump is around 5 GB and increases by 10 MB everyday. Data Files The entire consolidated data is accessible at s3://desiquant/data/news.parquet The individual news publisher data files are accessible at s3://desiquant/data/news/cnbctv18.csv . To view a list of all available publishers you can check out below Pandas Usage Data Preview title author description url article text date modified date published scrapy scraped at scrapy parsed at --------------------------------------------------------------- ------------- -------------------------------------------------------------------------- -------------------------------------------------------------------------------","default_branch":null,"files":null,"tree":[],"storefront":"/r/desiquant","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/desiquant/news_scraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}