{"repo":"matthiasnordwig/pdf-struct-chunker","free":true,"listed":false,"github":"https://github.com/matthiasnordwig/pdf-struct-chunker","clone":"git clone https://github.com/matthiasnordwig/pdf-struct-chunker.git","description":"LLM-free, layout-aware PDF chunking for RAG pipelines. Preserves document structure via regex and font heuristics. Written in pure Rust.","language":"Rust","stars":24,"topics":["chunking","edge-ai","llm-free","nlp","pdf","pdf-parsing","rag","regex","rust","text-extraction"],"license":"MIT","category":"media-processing","readme_excerpt":"pdf-struct-chunker Split PDFs into semantically meaningful chunks — without LLMs, without APIs, without cloud dependencies. 🌐 Author: Matthias Nordwig · programmiere.de --- The Problem Most RAG chunkers blindly split documents by token count or character limit. This destroys document structure — headings, sections, and paragraphs get ripped apart. The result: your vector search returns incoherent fragments with no context about where they came from. pdf-struct-chunker solves this by analyzing the actual layout of a PDF: X/Y coordinates, font sizes, and bold detection. It understands where a heading starts, where a paragraph ends, and where a new section begins. Each chunk carries structured metadata ( section , heading , page ) so your RAG pipeline knows exactly what it's looking at. No LLM needed. No API calls. Runs offline. Written in pure Rust. Before & After ❌ Standard RAG (Fixed-size overlap) Result: Words are cut in half, headings are disconnected from their content. ✅ pdf-struct-chunker (Layout-aware) Result: Clean, semantic chunks with perfect metadata. --- Performance / Benchmark Built for speed and Edge-AI scenarios: - No GPU required (pure CPU processing) - Extremely fast : Processes a 100-page PDF in Path to the input PDF file Required -p, --profile Path to a JSON profile with custom regex rules (see below) Built-in defaults -o, --output Output file path stdout --format Output format: jsonl or json jsonl --pretty Pretty-print JSON output false --stats Print chunk","default_branch":null,"files":null,"tree":[],"storefront":"/r/matthiasnordwig","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/matthiasnordwig/pdf-struct-chunker/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}