{"repo":"Mahdisadjadi/arxivscraper","free":true,"listed":false,"github":"https://github.com/Mahdisadjadi/arxivscraper","clone":"git clone https://github.com/Mahdisadjadi/arxivscraper.git","description":"A python module to scrape arxiv.org for a date range and category","language":"Python","stars":338,"topics":["python","arxiv-api","arxiv","arxiv-analytics","api-wrapper","scraper"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"arXivScraper An ArXiV scraper to retrieve records from given categories and date range. Install Use pip (or pip3 for python3): or download the source and use setup.py : To update the module using pip : Usage Basic Example Import arxivscraper and create a scraper to fetch preprints from a category within a date range: Parameters The Scraper class accepts the following parameters: - category (str): The arXiv category code (e.g., 'cs' , 'math' , 'cond-mat' , 'stat' , etc.). Supports both base categories and subcategories in multiple formats: - Base categories: 'cs' , 'math' , 'stat' , etc. - Subcategories with dot notation: 'cs.AI' , 'cs.SE' , etc. - Subcategories with colon notation: 'cs:AI' , 'stat:ML' , etc. - Physics legacy format: 'physics:cond-mat' , 'physics:astro-ph' , etc. - date from (str, optional): Starting date in format 'YYYY-MM-DD' . Defaults to the first day of the current month. - date until (str, optional): End date in format 'YYYY-MM-DD' . Defaults to today's date. - t (int, optional): Waiting time in seconds between retries on HTTP 503 errors. Default: 30 . - timeout (int, optional): Maximum time in seconds for the entire scraping operation. Default: 300 . - filters (dict, optional): Dictionary to filter results. Keys can be: 'title' , 'abstract' , 'author' , 'categories' , or 'affiliation' . Values are lists of words to match (logical OR). Default: {} (no filtering). Output The scrape() method returns a list of dictionaries. Each dictionary represents a pape","default_branch":null,"files":null,"tree":[],"storefront":"/r/Mahdisadjadi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Mahdisadjadi/arxivscraper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}