{"repo":"joshterrill/paywall-reader","free":true,"listed":false,"github":"https://github.com/joshterrill/paywall-reader","clone":"git clone https://github.com/joshterrill/paywall-reader.git","description":"A web app that lets you read articles on popular news sites that get hidden behind paywalls","language":"JavaScript","stars":56,"topics":["bypass","bypass-paywalls","paywall","scraper"],"license":null,"category":"scrapers-browser-automation","readme_excerpt":"# Paywall Reader A web app that lets you read articles on popular news sites that get hidden behind paywalls. URL: https://reader.dangerous.dev Supported Sites New York Times (nytimes.com) New York Times Cooking (cooking.nytimes.com) The New Yorker (newyorker.com) The Economist (economiste.com) Washington Post (washingtonpost.com) LA Times (latimes.com) The Athletic (theathletic.com) Business Insider (businessinsider.com) Bloomberg (bloomberg.com) Vogue (vogue.com) The Atlantic (theatlantic.com) Forbes (forbes.com) Wired (wired.com) Prerequisites 1. Register a custom Google search engine by going to https://developers.google.com/custom-search/v1/introduction and pressing \"Get A Key\" 2. As per their site: Once it is created, you can find the engine's ID in the Setup Basics Search Engine ID section of the Control Panel This is where you will configure what sites your search will search in. For the purposes of this app in its current state, we will just use bloomberg.com ( .bloomberg.com/ ) and newyorker.com ( .newyorker.com/ ) Take note of your API key and Search Engine ID. Installation Running npm test will check all supported sites for output verification, making sure that the selectors that extract the text from the sites have not changed. Adding More Sites Pull requests would gladly be accepted for adding support for more sites. If you can't submit a pull request, open a Github issue and I'll get to it when I have time. Todo Fix relative and absolute links in embedded html ","default_branch":null,"files":null,"tree":[],"storefront":"/r/joshterrill","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/joshterrill/paywall-reader/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}