{"repo":"AstraBert/diRAGnosis","free":true,"listed":false,"github":"https://github.com/AstraBert/diRAGnosis","clone":"git clone https://github.com/AstraBert/diRAGnosis.git","description":"Diagnose the performance of your RAG🩺","language":"Python","stars":43,"topics":["docker","evaluation-framework","fastapi","gradio","llamaindex","llm","python-package","qdrant","rag","retrieval"],"license":"MIT","category":"ai-agents","readme_excerpt":"diRAGnosis🩺 Diagnose the performance of your RAG If you find diRAGnosis useful, please consider to donate and support the project: diRAGnosis is a lightweight framework, built with LlamaIndex, that allows you to evaluate the performance of LLMs and retrieval models in RAG frameworks with your documents. It can be used as an application (thanks to FastAPI + Gradio) running locally on your machine, or as a python package. Installation and usage As an application Clone the application: Docker (recommended)🐋 Required: Docker and docker compose - Launch the Docker application: Or, if you prefer: You will see the application running on http://localhost:8000/dashboard and you will be able to use it. Depending on your connection and on your hardware, the set up might take some time (up to 30 mins to set up) - but this is only for the first time your run it! Source code 🗎 Required: Docker, docker compose and conda - Set up diRAGnosis app using the dedicated script: - Or you can do it manually, if you prefer: You will see the application running on http://localhost:8000/dashboard and you will be able to use it. As a python package As a python package, you will be able to install diRAGnosis using pip : Once you have installed it, you can import the four functions (detailed in the dedicated reference file) available for diRAGnosis like this: Once you imported them, this is an example of how you can use them: How it works diRAGnosis takes care of the evaluation of LLM and retrieval mod","default_branch":null,"files":null,"tree":[],"storefront":"/r/AstraBert","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/AstraBert/diRAGnosis/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}