{"repo":"innightwolfsleep/llm_telegram_bot","free":true,"listed":false,"github":"https://github.com/innightwolfsleep/llm_telegram_bot","clone":"git clone https://github.com/innightwolfsleep/llm_telegram_bot.git","description":"LLM telegram bot","language":"Python","stars":134,"topics":["large-language-models","llm","telegram-bot","aiogram","bot","exllama","llamacpp","telegram","text-generation-webui"],"license":"MIT","category":"ai-agents","readme_excerpt":"- wrAPPer for llama.cpp(default), exllama or transformers. - wrAPPer for ollama (config example - config/ollama config.json) - wrAPPer for llama.cpp server (config example - config/llamacpp server.json) - an EXTension for oobabooga/text-generation-webui.s Provide telegram chat with various additional functional like buttons, prefixes, voice/image generation. --------------- HOW TO INSTALL ( standalone app ): 1) clone this repo 2) install requirements. HOW TO RUN ( standalone app ): 1) get bot token from https://t.me/BotFather 2) copy bot token to configs\\telegram token.txt 3) move your model file to models\\ 4) set model path to your model in configs\\app config.json 5) start run.cmd (windows) or run.sh (linux). (optional) to use exllama: (optional) to use exllamav2: (optional) to use llama.cpp with GPU acceleration reinstall abetlen/llama-cpp-python by guide: llama-cpp-python#installation-with-hardware-acceleration or this guide for windows --------------- HOW TO INSTALL ( extension mode ): 1) obviously, install oobabooga/text-generation-webui first, add model, set all options you need 2) run cmd windows.bat or cmd linux.sh to enable venv 3) clone this repo to \"text-generation-webui\\extensions\" git clone https://github.com/innightwolfsleep/llm telegram bot extensions\\telegram bot 4) install requirements pip install -r extensions\\telegram bot\\requirements ext.txt HOW TO USE ( extension mode ): 1) get bot token from https://t.me/BotFather 2) add your bot token in extensions\\tele","default_branch":null,"files":null,"tree":[],"storefront":"/r/innightwolfsleep","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/innightwolfsleep/llm_telegram_bot/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}