{"repo":"openzim/sotoki","free":true,"listed":false,"github":"https://github.com/openzim/sotoki","clone":"git clone https://github.com/openzim/sotoki.git","description":"StackExchange websites to ZIM scraper","language":"Python","stars":242,"topics":["stackoverflow","stackexchange","zim","scraper"],"license":"GPL-3.0","category":"scrapers-browser-automation","readme_excerpt":"Sotoki ====== Sotoki ( Stack Overflow to Kiwix ) is an openZIM scraper to create offline versions of Stack Exchange websites such as Stack Overflow. It is based on Stack Exchange's Data Dumps hosted by The Internet Archive. Usage Sotoki works off a dump of a StackExchange website, as regularly created by StackExchange team. You must provide a --mirror to use to download this dump and the --domain you want to scrape. For instance, to download Sports StackExchange website as of August 2024 and based on dump hosted on archive.org, you have to use --mirror https://archive.org/download/stackexchange 20240829 --domain sports.stackexchange.com . Value of mirror is hence continuously updated as new dumps are published by StackExchange team. Other CLI parameters are mandatory: - --title : ZIM title, must be less than 30 chars. E.g. Gardening and Landscaping - --description : ZIM description, must be less than 80 chars Docker Installation sotoki is a Python3 software. If you are not using the Docker image, you are advised to use it in a virtual environment to avoid installing software dependencies on your system. Developers Anybody is welcome to improve the Sotoki. See CONTRIBUTING.md for setup instructions, code style guidelines, and changelog requirements. Users You don't have to make your own ZIM files of Stack Exchange's Web sites. Updated ZIM files are built on a regular basis for all of them. Look at https://library.kiwix.org/?category=stack exchange to download them.","default_branch":null,"files":null,"tree":[],"storefront":"/r/openzim","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/openzim/sotoki/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}