{"repo":"SomeOddCodeGuy/OfflineWikipediaTextApi","free":true,"listed":false,"github":"https://github.com/SomeOddCodeGuy/OfflineWikipediaTextApi","clone":"git clone https://github.com/SomeOddCodeGuy/OfflineWikipediaTextApi.git","description":"This small API downloads and exposes access to NeuML's txtai-wikipedia and full wikipedia datasets, taking in a query and returning full article text","language":"Python","stars":106,"topics":["self-hosted","selfhosted","wikipedia"],"license":"Apache-2.0","category":"self-hosted-apps","readme_excerpt":"Offline Wikipedia Text API Welcome to the Offline Wikipedia Text API! This project provides a simple way to search and retrieve Wikipedia articles from an offline dataset using the txtai library. The API offers three endpoints to get full articles by title, full articles by search prompt, and summary snippets of articles by search prompt. Features - Offline Access : All Wikipedia article texts are stored offline, allowing for fast and private access. - Search Functionality : Uses the powerful txtai library to search for articles by prompts. Requirements This project requires a minimum of 70GB of free disk space during installation (the two datasets together are 67GB after download). After the install completes you can optionally delete the .git folders inside each dataset directory to reclaim roughly half of that space. This project utilizes Git to pull down the needed datasets (https://git-scm.com/downloads) This can be skipped by downloading the datasets into their respective folders in the project directory. \"wiki-dataset\" folder: https://huggingface.co/datasets/NeuML/wikipedia-20260401 \"txtai-wikipedia\" folder: https://huggingface.co/NeuML/txtai-wikipedia The existence of the two dataset folders should skip the git calls, bypassing their need. This project is a Python project, and requires Python to run. Important Notes Scripts are provided for Linux ( run linux.sh ), MacOS ( run macos.sh ), and Windows ( run windows.bat ). Each one runs a pre-flight check for git , git-l","default_branch":null,"files":null,"tree":[],"storefront":"/r/SomeOddCodeGuy","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/SomeOddCodeGuy/OfflineWikipediaTextApi/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}