{"repo":"gambolputty/wiktionary-de-parser","free":true,"listed":false,"github":"https://github.com/gambolputty/wiktionary-de-parser","clone":"git clone https://github.com/gambolputty/wiktionary-de-parser.git","description":"Extract data from German Wiktionary XML files.","language":"Python","stars":26,"topics":["wiktionary","wiktionary-parser","german","nlp","german-language","data-extraction","wiktionary-dump","dewiktionary"],"license":"MIT","category":"machine-learning","readme_excerpt":"wiktionary-de-parser A Python library (3.13+) that extracts structured data from German Wiktionary XML dumps: IPA, hyphenation, inflection tables, part-of-speech tags, lemma references, rhymes, and meanings. Features - Streams compressed XML dumps memory-efficiently. - Yields one structured entry per language and part of speech (a single Wiktionary page often holds several). - Optional multiprocessing mode for full-dump throughput. Installation The project uses uv for development; any standard pip /PyPI install works for consumers. Usage Locating the dump file Parsing entries (serial) Parsing entries (parallel) For full-dump runs use iter parsed . XML iteration stays on the main process while parsing is sharded over a worker pool. workers defaults to os.cpu count() - 1 . Pass workers=1 to skip multiprocessing entirely (useful with pdb ). Output schema All result containers are @dataclass(slots=True) . The full schema lives in wiktionary de parser/models.py . Inflection keys Inflection-table parameter names are token-translated to English lowercase + underscore: \"Nominativ Singular\" → \"nominative singular\" , \"Präsens er, sie, es\" → \"present 3sg\" . Unknown tokens are kept verbatim (lowercased). Lemma references If the entry is an inflected form or alternative spelling, lemma holds the canonical target and reference records the type: Development License MIT © Gregor Weichbrodt","default_branch":null,"files":null,"tree":[],"storefront":"/r/gambolputty","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/gambolputty/wiktionary-de-parser/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}