{"repo":"metawake/ragtune","free":true,"listed":false,"github":"https://github.com/metawake/ragtune","clone":"git clone https://github.com/metawake/ragtune.git","description":"EXPLAIN ANALYZE for RAG retrieval — inspect, debug, benchmark, and tune your retrieval layer","language":"Go","stars":13,"topics":["benchmarking","chroma","cli","developer-tools","embeddings","evaluation","llm","metrics","pgvector","pinecone"],"license":"MIT","category":"analytics","readme_excerpt":"RagTune Debug, benchmark, and monitor your RAG retrieval layer. EXPLAIN ANALYZE for production RAG. Quickstart • Commands • Why RagTune • Ecosystem • Concepts • FAQ --- I want to... Command -------------- --------- Debug a single query ragtune explain \"my query\" --collection prod Run batch evaluation ragtune simulate --collection prod --queries queries.json Get confidence intervals ragtune simulate --queries queries.json --bootstrap 20 Set up CI/CD quality gates ragtune simulate --ci --min-recall 0.85 Detect regressions ragtune simulate --baseline runs/latest.json --fail-on-regression Compare embedders ragtune compare --embedders ollama,openai --docs ./docs Evaluate external chunkers ragtune ingest ./chunks/ --collection test --pre-chunked Find missed answer content ragtune simulate --queries needles.json (with needle annotations) Quick health check ragtune audit --collection prod --queries queries.json --- Quickstart No API keys needed with Ollama (runs locally). Evaluate External Chunkers (POMA, Unstructured, LlamaIndex) Already chunked your documents with an external tool? Use --pre-chunked to ingest them as-is — one file per chunk, no re-splitting: Already using PostgreSQL with pgvector? Skip Docker entirely. Use your existing database: Build Your Test Suite Each --save adds the query to golden-queries.json . --- What You'll See explain — Debug a Query simulate — Batch Metrics NeedleCoverage — Find What Recall Misses Recall@K tells you whether the right document was retri","default_branch":null,"files":null,"tree":[],"storefront":"/r/metawake","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/metawake/ragtune/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}