{"repo":"rouralberto/zim-llm","free":true,"listed":false,"github":"https://github.com/rouralberto/zim-llm","clone":"git clone https://github.com/rouralberto/zim-llm.git","description":"Kiwix ZIM-to-vector RAG system for local, offline LLM knowledge retrieval","language":"Python","stars":30,"topics":["docker-model-runner","kiwix","knowledge-base","llm","prepper","shtf","xapian","zim"],"license":null,"category":"ai-agents","readme_excerpt":"Dynamic ZIM Library to Vector Database RAG System This project provides a comprehensive system for processing ZIM files (compressed Wikipedia/offline content databases) and creating a vector database for Retrieval-Augmented Generation (RAG) with Large Language Models, effectively having an offline knowledge base. This is an good solution for running local LLMs on underpowered computers while providing access to extensive knowledge bases. By leveraging pre-compressed ZIM files and efficient vector search, you can have a powerful AI assistant with encyclopedic knowledge without requiring high-end hardware or constant internet connectivity. Architecture Overview Features - Dynamic ZIM Library : Automatically discovers and processes multiple ZIM files from a dedicated library directory - Multi-format ZIM Support : Supports libzim, zimply, and CLI-based ZIM file reading - Flexible Vector Databases : Choose between ChromaDB and FAISS for storage - Local LLM Support : Docker Model Runner for offline LLM capabilities - Smart Text Processing : Automatic text chunking and preprocessing with source attribution - RAG Pipeline : Complete retrieval-augmented generation pipeline with multi-source answers - CLI Interface : Easy-to-use command-line interface with library management commands - Export Functionality : Export articles from multiple ZIM files to JSON - Source Tracking : Maintains source information for all extracted content Quick Start 1. Install Dependencies 2. Add ZIM Files to L","default_branch":null,"files":null,"tree":[],"storefront":"/r/rouralberto","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/rouralberto/zim-llm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}