{"repo":"ChiefGyk3D/FrankenLLM","free":true,"listed":false,"github":"https://github.com/ChiefGyk3D/FrankenLLM","clone":"git clone https://github.com/ChiefGyk3D/FrankenLLM.git","description":"Stitched-together GPUs, but it lives! Run different LLM models optimally across multiple NVIDIA GPUs","language":"Shell","stars":19,"topics":["ai","cuda","docker","llm","gemma","gemma3","linux","networking","nvidia","privacy"],"license":null,"category":"ai-agents","readme_excerpt":"🧟 FrankenLLM Stitched-together GPUs, but it lives! Run separate LLM models on each of your NVIDIA GPUs simultaneously. Perfect for multi-GPU setups where you want to maximize utilization. --- ✨ Features - 🎯 Per-GPU Model Serving - Run different models optimized for each GPU's VRAM - 🚀 Zero Interference - Each GPU has its own Ollama instance on separate ports - 🔧 Easy Management - Simple scripts for installation, service control, and testing - 🌐 Local & Remote - Works on localhost or remote servers via SSH - ⚙️ Systemd Services - Automatic startup, monitoring, and restart on failure - 🔥 Auto-Warmup - Models automatically load into GPU memory on boot - 🩺 GPU Health Monitor - Auto-fix driver issues on boot with intelligent retry and alerts - ⚡ Configurable - Support for 1+ GPUs with flexible model selection - 🖥️ Headless Ready - Designed for Ubuntu Server 24.04 (tested with Linux 6.14 + NVIDIA 580 drivers) --- 📁 Project Structure --- 🚀 Quick Start 🤔 Choose Your Workflow Feature 🚀 Super Installer 🛠️ Manual Mode --------- ------------------- ----------------- Command ./setup-frankenllm.sh ./configure.sh → ./install.sh Best For Most users, fresh installs Advanced users, automation Detects Existing ✅ Docker, Ollama, services ❌ Overwrites Sudo Caching ✅ Enter password once ❌ Multiple prompts Flexible GPUs ✅ Auto-detects 1+ GPUs ✅ Manual configuration Reinstall Options ✅ Keep/upgrade/skip ❌ Always reinstalls Interactive ✅ Guided wizard ✅ Step-by-step Config Review ⚠️ No (","default_branch":null,"files":null,"tree":[],"storefront":"/r/ChiefGyk3D","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ChiefGyk3D/FrankenLLM/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}