{"repo":"umbertogriffo/rag-chatbot","free":true,"listed":false,"github":"https://github.com/umbertogriffo/rag-chatbot","clone":"git clone https://github.com/umbertogriffo/rag-chatbot.git","description":"RAG (Retrieval-augmented generation) ChatBot that provides answers based on contextual information extracted from a collection of Markdown files.","language":"Python","stars":438,"topics":["chatbot","chromadb","gpu","lamacpp","rag","vector-database","llama3","llm","qwen3-5","sqlite"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"RAG (Retrieval-augmented generation) ChatBot Check out the todo list to see the next steps and improvements we want to implement in this project here. [!IMPORTANT] Disclaimer: The code has been tested on: Ubuntu 22.04.2 LTS running on a Lenovo Legion 5 Pro with twenty 12th Gen Intel® Core™ i7-12700H and an NVIDIA GeForce RTX 3060 . MacOS Sonoma 14.3.1 running on a MacBook Pro M1 (2020). If you are using another Operating System or different hardware, and you can't load the models, please take a look at the official llama.cpp's GitHub issue. [!WARNING] It's important to note that the large language model sometimes generates hallucinations or false information. Table of contents - Introduction - Prerequisites - Install Poetry - Bootstrap Environment - How to use the make file - Environment - Set the Open-Source LLM Model - Set the Embedding Model - Set the Response Synthesis strategy - Build the memory index - Run the Chatbot - References Introduction This project combines the power of llama.cpp and Chroma to build: a Conversation-aware Chatbot (ChatGPT like experience). a RAG (Retrieval-augmented generation) ChatBot. The RAG Chatbot works by taking a collection of Markdown files as input and, when asked a question, provides the corresponding answer based on the context provided by those files. [!NOTE] We decided to grab and refactor the RecursiveCharacterTextSplitter class from LangChain to effectively chunk Markdown files without adding LangChain as a dependency. The Memory B","default_branch":null,"files":null,"tree":[],"storefront":"/r/umbertogriffo","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/umbertogriffo/rag-chatbot/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}