{"repo":"NidAll/TranslateGemma-Studio","free":true,"listed":false,"github":"https://github.com/NidAll/TranslateGemma-Studio","clone":"git clone https://github.com/NidAll/TranslateGemma-Studio.git","description":"Local TranslateGemma UI with a thin llama.cpp adapter, streaming translations, long-text chunking, and a clean light/dark interface all running offline on your PC.","language":"JavaScript","stars":16,"topics":["gemma","gguf","llama-cpp","local-ai","nextjs","offline","translate","translation"],"license":"Apache-2.0","category":"saas-starters-boilerplates","readme_excerpt":"TranslateGemma Local Local translation UI for google/translategemma-4b-it running on llama.cpp. What this does - Starts a thin adapter API that forwards text translation requests to llama.cpp. - If llama.cpp is not running, it auto-starts with: llama-server -hf mradermacher/translategemma-4b-it-GGUF:Q6 K --jinja -c 0 --host 127.0.0.1 --port 8033 --flash-attn on - Serves a Next.js web UI on http://127.0.0.1:3000 . Installation and setup Requirements - Node.js 18+ and npm - llama.cpp with llama-server - A TranslateGemma GGUF model file - Optional: fastText language ID model for auto detection Quick setup script Windows (PowerShell): Linux: The setup script checks for llama-server , offers a flash attention toggle, selects a quantization based on VRAM (or manual choice), and downloads the GGUF model into models/ . 1) Get the model Download a GGUF build of TranslateGemma from: https://huggingface.co/mradermacher/translategemma-4b-it-GGUF Choose a quantization that fits your VRAM (Q4, Q5, Q6, etc). 2) Install llama.cpp If you want to know how to install it visit: https://github.com/ggml-org/llama.cpp?tab=readme-ov-file#quick-start 3) Install dependencies 4) (Optional) Enable auto language detection This app can auto-detect the source language using fastText. Install fastText and download the model: - Windows: python -m pip install fasttext-wheel and use scripts/fasttext.cmd . - Linux: install the fastText CLI (package or build from source). - Download lid.176.bin from https://fast","default_branch":null,"files":null,"tree":[],"storefront":"/r/NidAll","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/NidAll/TranslateGemma-Studio/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}