{"repo":"jack-ai-dev/rag-chatbot","free":true,"listed":false,"github":"https://github.com/jack-ai-dev/rag-chatbot","clone":"git clone https://github.com/jack-ai-dev/rag-chatbot.git","description":"RAG (Retrieval-augmented generation) ChatBot that provides answers based on contextual information extracted from a collection of Markdown files.","language":"Python","stars":22,"topics":["chatbot","gpu","lamacpp","llm","rag","vector-database","stremit","chromedb","llama3"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"RAG (Retrieval-augmented generation) ChatBot [!IMPORTANT] Disclaimer: The code has been tested on: Ubuntu 22.04.2 LTS running on a Lenovo Legion 5 Pro with twenty 12th Gen Intel® Core™ i7-12700H and an NVIDIA GeForce RTX 3060 . MacOS Sonoma 14.3.1 running on a MacBook Pro M1 (2020). If you are using another Operating System or different hardware, and you can't load the models, please take a look at the official Llama Cpp Python's GitHub issue. [!WARNING] - lama cpp pyhon doesn't use GPU on M1 if you are running an x86 version of Python . More info here. - It's important to note that the large language model sometimes generates hallucinations or false information. Table of contents - Introduction - Prerequisites - Install Poetry - Bootstrap Environment - How to use the make file - Using the Open-Source Models Locally - Supported Models - Supported Response Synthesis strategies - Example Data - Build the memory index - Run the Chatbot - Run the RAG Chatbot - How to debug the Streamlit app on Pycharm - References Introduction This project combines the power of Lama.cpp, Chroma and Streamlit to build: a Conversation-aware Chatbot (ChatGPT like experience). a RAG (Retrieval-augmented generation) ChatBot. The RAG Chatbot works by taking a collection of Markdown files as input and, when asked a question, provides the corresponding answer based on the context provided by those files. [!NOTE] We decided to grab and refactor the RecursiveCharacterTextSplitter class from LangChain to ef","default_branch":null,"files":null,"tree":[],"storefront":"/r/jack-ai-dev","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jack-ai-dev/rag-chatbot/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}