{"repo":"Otman404/local-rag-llamaindex","free":true,"listed":false,"github":"https://github.com/Otman404/local-rag-llamaindex","clone":"git clone https://github.com/Otman404/local-rag-llamaindex.git","description":"Local llamaindex RAG to assist researchers quickly navigate research papers","language":"Python","stars":133,"topics":["fastapi","llamaindex","llm","rag"],"license":null,"category":"ai-agents","readme_excerpt":"RAG: Research-assistant This project aims to help researchers find answers from a set of research papers with the help of a customized RAG pipeline and a powerfull LLM, all offline and free of cost. For more details, please checkout the blog post about this project. How it works 1. Download some research papers from Arxiv 2. Use Llamaindex to load, chunk, embed and store these documents to a Qdrant database 3. FastAPI endpoint that receives a query/question, searches through our documents and find the best matching chunks 4. Feed these relevant documents into an LLM as a context 5. Generate an easy to understand answer and return it as an API response alongside citing the sources Running the project Quick Start (Docker Compose) This project now uses Docker and Docker Compose for easier setup and reproducibility: You can visit this blog article to learn more: Dockerizing a RAG Application with FastAPI, LlamaIndex, Qdrant and Ollama 1. Clone the Repo 2. Build the Docker images This will: Build a rag-base-image containing shared dependencies (LlamaIndex, llama-index, etc.) Build the api service (FastAPI backend) using Dockerfile in api/ Build the data ingestion service used for downloading and indexing research papers using Dockerfile in data/ 3. Run All Services This starts: API server (FastAPI on port 8000 ) Qdrant vector DB (port 6333 ) Ollama LLM server (port 11434 ) 4. Download & Ingest Papers To ingest new research papers into Qdrant: --query : search keyword for downloadi","default_branch":null,"files":null,"tree":[],"storefront":"/r/Otman404","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Otman404/local-rag-llamaindex/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}