{"repo":"amithkoujalgi/ollama-pdf-bot","free":true,"listed":false,"github":"https://github.com/amithkoujalgi/ollama-pdf-bot","clone":"git clone https://github.com/amithkoujalgi/ollama-pdf-bot.git","description":"A bot that accepts PDF docs and lets you ask questions on it.","language":"Python","stars":214,"topics":["bot","chat-bot","llama","llama2","llm","ollama","pdf","pdf-bot"],"license":null,"category":"media-processing","readme_excerpt":"PDF Bot with Ollama A bot that accepts PDF docs and lets you ask questions on it. The LLMs are downloaded and served via Ollama. Table of Contents - Requirements - How to run - Demo - Improvements - Contributing - Credits Requirements [![][shield]][site] [![][maketool-shield]][maketool-site] [site]: https://docs.docker.com/compose/ [shield]: https://img.shields.io/badge/Docker Compose-Installation-blue.svg?style=for-the-badge&labelColor=gray [maketool-site]: https://www.gnu.org/software/make/ [maketool-shield]: https://img.shields.io/badge/Make-Tool-blue.svg?style=for-the-badge&labelColor=gray How to run CPU version GPU version When the server is up and running, access the app at: http://localhost:8501 Switch to a different model by changing the MODEL env variable in the docker-compose.yaml. Check out the available models from here. Note: - It takes a while to start up since it downloads the specified model for the first time. - If your hardware does not have a GPU and you choose to run only on CPU, expect high response time from the bot. - Only Nvidia is supported as mentioned in Ollama's documentation. Others such as AMD isn't supported yet. Read how to use GPU on Ollama container and docker-compose. - Make sure to have Nvidia drivers setup on your execution environment for the best results. Image on DockerHub: https://hub.docker.com/r/amithkoujalgi/pdf-bot Demo https://github.com/amithkoujalgi/ollama-pdf-bot/assets/1876165/40dc70e6-9d35-4171-9ae6-d82247dbaa17 Sample PDFs H","default_branch":null,"files":null,"tree":[],"storefront":"/r/amithkoujalgi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/amithkoujalgi/ollama-pdf-bot/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}