{"repo":"GiovanniPasq/chunky","free":true,"listed":false,"github":"https://github.com/GiovanniPasq/chunky","clone":"git clone https://github.com/GiovanniPasq/chunky.git","description":"Open-source toolkit for reliable RAG pipelines: convert PDFs to Markdown, clean documents, inspect chunks, compare chunking strategies, and enrich metadata for LLM applications.","language":"Python","stars":165,"topics":["chunking","rag","retrieval-augmented-generation","chunk-validation","document-processing","markdown","pdf-processing","rag-evaluation","rag-pipeline","chonkie"],"license":"MIT","category":"ai-agents","readme_excerpt":"Chunky – RAG Chunking & Markdown Processing Toolkit Convert PDFs, clean Markdown, inspect chunks, and enrich metadata for reliable RAG pipelines. If you like this project, a star ⭐️ would mean a lot :) --- Overview Chunky is a local, open-source workspace for preparing documents for Retrieval-Augmented Generation (RAG). It combines PDF-to-Markdown conversion, Markdown cleanup, chunk visualization, chunking strategy comparison, and LLM-powered enrichment in one workflow. Most RAG failures start before retrieval: broken tables, scrambled layouts, noisy Markdown, or chunks that look fine in code but fail in context. Chunky makes those steps visible so you can inspect and fix the document before it reaches your vector store. As NVIDIA's research shows, no chunking strategy wins universally. Chunky helps you compare strategies on the actual document instead of treating chunking as a hidden parameter. New to RAG? Check out Agentic RAG for Dummies — a hands-on implementation of Agentic RAG. --- Features --- --- 📄 Document review workspace Compare PDF, Markdown, and chunks side by side before indexing ✨ Multiple conversion engines PyMuPDF, Docling, MarkItDown, LiteParse, VLM, and Cloud API support 📦 Batch processing Convert, enrich, and chunk multiple documents from the sidebar ✂️ Chunking strategy comparison Test LangChain, Chonkie, and Docling splitters with configurable size and overlap 💾 Saved chunk versions Persist and reload chunk sets by Markdown source and splitter configu","default_branch":null,"files":null,"tree":[],"storefront":"/r/GiovanniPasq","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/GiovanniPasq/chunky/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}