{"repo":"omidcodes/wiley-open-access-pdf-downloader","free":true,"listed":false,"github":"https://github.com/omidcodes/wiley-open-access-pdf-downloader","clone":"git clone https://github.com/omidcodes/wiley-open-access-pdf-downloader.git","description":"Download Open-Access PDFs from Wiley Online Library using SRU queries - filters results, saves files locally, and extracts author/email information.","language":"Python","stars":10,"topics":["academic-research","api","parser","python","research-scraper","web-scraping"],"license":"MIT","category":"scrapers-browser-automation","readme_excerpt":"Wiley Open-Access PDF Downloader Local-only tool to query the Wiley Online Library SRU endpoint by keyword(s), filter Open Access results, download the PDFs to ./downloads/ , and heuristically extract the principal author/email from the PDF text. - ✅ Pure local filesystem output - ✅ Pytest unit tests --- Features - 🔎 Keyword search via Wiley SRU with browser-like headers (helps reduce 403s) - 🧭 Pagination via SRU nextRecordPosition - ✅ Open-Access filtering - 📄 PDF download + simple heuristic extraction of author name and email from text - 💾 Files saved under ./downloads/ at the project root - 🧪 Tests that mock network/IO (no real HTTP, no DB) --- Requirements - Python 3.9+ - A virtual environment is recommended Install dependencies: --- Run locally Basic run: Optional start page: Note: You can adjust batch size and total items by editing publisher settings.py → BATCH SIZE , MAX ARTICLES . You’ll see logs like: All PDFs land in: --- How it works (high level) 1. Build a Wiley SRU query for your keywords. 2. Fetch a page of records; normalize essential fields (DOI, title, landing URL, subjects, year). 3. Keep only Open-Access items. 4. Resolve a PDF URL and download it (using cloudscraper/requests ). 5. Extract a principal author/email (best-effort heuristic). 6. Save the PDF to ./downloads/ using utils.save pdf() . --- Testing Run the test suite: Tests use monkeypatch /mocks so: No network calls are made No DB is required File writes go to temporary locations during tests","default_branch":null,"files":null,"tree":[],"storefront":"/r/omidcodes","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/omidcodes/wiley-open-access-pdf-downloader/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}