{"repo":"heyseth/wikiquote-parser","free":true,"listed":false,"github":"https://github.com/heyseth/wikiquote-parser","clone":"git clone https://github.com/heyseth/wikiquote-parser.git","description":"Parser that converts Wikiquote dumps into structured JSON","language":"Python","stars":27,"topics":["json","database","quotes","wikimedia","wikiquote","xml","parser"],"license":"MIT","category":"databases-storage","readme_excerpt":"wikiquote-parser There aren't many large, public datasets of quotes online, so I created my own by parsing and cleaning up a Wikiquote data dump. Setup Usage Download a data dump of wikiquote: wget https://dumps.wikimedia.org/enwikiquote/latest/enwikiquote-latest-pages-articles.xml.bz2 Extract the archive: bzip2 -d enwikiquote-latest-pages-articles.xml.bz2 Run the program: ./parse xml.py enwikiquote-latest-pages-articles.xml There are two optional parameters: quote cutoff length, and desired language. The default cutoff length is 100 characters, and the default language is English. The language must be specified as an ISO Language Code. For instance, if you wanted quotes only in Spanish, and less than 50 characters in length, you would enter the following: ./parse xml.py enwikiquote-latest-pages-articles.xml 50 es Alternatively, if you don't want to specify a language, enter \"all\" (no quotes) for the language parameter. This will massively shorten the time it takes the program to run. Analysis Tools The repository also includes two scripts for analyzing and visualizing the quote data: Statistical Analysis Performs statistical analysis on the quotes using NumPy and Pandas: - Calculates quote length statistics (mean, median, standard deviation) - Groups quotes by first word and provides aggregated statistics - Handles JSON files structured as {\"author\": [\"quote1\", \"quote2\", ...], ...} Usage: ./stats analysis.py path/to/quotes.json Data Visualization Creates visualizations using","default_branch":null,"files":null,"tree":[],"storefront":"/r/heyseth","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/heyseth/wikiquote-parser/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}