{"repo":"JackBekket/Hellper","free":true,"listed":false,"github":"https://github.com/JackBekket/Hellper","clone":"git clone https://github.com/JackBekket/Hellper.git","description":"Telegram bot which can work with both openAI and LocalAI modes, it also uses UncensoredGPT models like Wizard-Uncensored. It can be launch at ordinary gamer PC without specific ai-gpu hardware","language":"Go","stars":22,"topics":["ai","local-ai","telegram-bot","uncensored"],"license":null,"category":"media-processing","readme_excerpt":"Helper Possibilities - image generation - local-ai integration - langchain integration (support memory and context) - voice recognition and translation - multi-modal LLM's support (can understand images) - hugginface auto-download models files - vectorstores and RAG integration (can chat with document collection (as QA)) - can be used as a lib We are under heavy development! it may work unexpectedly https://github.com/mudler/LocalAI -- original repo of local ai golang node How to run? simply run docker-compose up --build (with -d for deattach) -- it will create two containers -- local-ai and this bot if your local-ai node is already running, then you can just build this bot as docker build -t helper-bot . and then docker run -d --name helper-bot --restart=always -p 8085:8085 helper-bot add -p 8080:8080 for web UI How to setup bot to work with your models locally with localai? Download models and set-up promt templates 1. download your models: I am using wizard-llm-uncensored with 13b and 30b parameters and I download them into local folder Notes: 1. 30 billion parameters require 22Gb ram minumum, 13b = 13Gb RAM min 2. You can download models directly from hugginface 3. You need .gguf format and optimised quntisation choice 4. Wizard Uncensored LLM's are basically the same wizard-vicuna models but they are was trained at edited dataset, in which was removed biased answers 5. I am using stable-diffusion for image generation, for more info see localai stablediffusion https://loc","default_branch":null,"files":null,"tree":[],"storefront":"/r/JackBekket","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/JackBekket/Hellper/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}