{"repo":"esotericpig/nhkore","free":true,"listed":false,"github":"https://github.com/esotericpig/nhkore","clone":"git clone https://github.com/esotericpig/nhkore.git","description":"🇯🇵📰🗻 NHK News Web (Easy) word frequency (core list) scraper for Japanese language learners.","language":"Ruby","stars":16,"topics":["nhk","nhk-easy-news","japanese","japanese-language","japanese-study","news","nhk-news-web","japanese-language-learners","cli","nokogiri"],"license":"LGPL-3.0","category":"cli-tools","readme_excerpt":"NHKore A CLI app that scrapes NHK News Web Easy to create a list of each word and its frequency (how many times it was used) for Japanese language learners. This is similar to a core word/vocabulary list, hence the name NHKore. Contents - For Non-Power Users - Installing - Using - The Basics - Unlimited Powah! - Get Command - Sift Command - Sakura Fields Forever - Search Command - News Command - Using the Library - Hacking - Updating - Releasing - License For Non-Power Users ^ For non-Power Users, you are probably just interested in the data. Click here for a big HTML file of the final result from all of the current articles scraped. Click here to go to the latest release and download nhkore-core.zip from the Assets . It contains all of the links scraped, all of the data scraped per article, and a final CSV file. If you'd like to try using the app, please download and install Ruby and then follow the instructions below. You'll need to be able to use the command line. Installing ^ Pick your poison... With the RubyGems package manager: $ gem install nhkore Manually: If there are errors running nhkore , you may need to also install Nokogiri manually, which is used for scraping HTML. Using ^ The Basics ^ The most useful thing to do is to simply scrape one article and then study the most frequent words before reading that article. First, scrape the article: $ nhkore news easy -u 'https://www3.nhk.or.jp/news/easy/k10011862381000/k10011862381000.html' If your internet is slow, there","default_branch":null,"files":null,"tree":[],"storefront":"/r/esotericpig","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/esotericpig/nhkore/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}