{"repo":"asallay/godot-llm","free":true,"listed":false,"github":"https://github.com/asallay/godot-llm","clone":"git clone https://github.com/asallay/godot-llm.git","description":"Experimental Godot 4.7 project running Gemma 4 inference entirely in GDScript and Vulkan compute shaders","language":"GDScript","stars":44,"topics":["godot","llm"],"license":null,"category":"ai-agents","readme_excerpt":"Gemma 4 in Godot [!WARNING] This is not a game-ready project. It is an experiment to see whether LLM inference can run directly in Godot without external dependencies (only gdscript and compute shaders). It is about an order of magnitude slower than a real inference stack such as llama.cpp with CUDA kernels, so it should only be treated as an experiment. This Godot 4.7 project runs exactly one model: gemma-4-E2B-it-Q4 K M.gguf . The transformer executes in compute shaders; GDScript handles the model's GGUF metadata, tokenizer, sampling, cache, and chat UI. There is no external inference process, native extension, HTTP service, model catalog, or runtime model selection. Model file Keep the model directly in models/ : Open the project and run node 2d.tscn . An exported build looks for the same exact filename at models/gemma-4-E2B-it-Q4 K M.gguf beside the executable, then falls back to the project resource during development. The model path cannot be overridden at runtime. The runtime is llm/gemma/Gemma4E2BQ4KRuntime.gd , backed by llm/gemma/GemmaGpuPipeline.gd . Shared code under llm/common/ exists only for the GGUF representation, tokenizer, sampler, prefill cache, quantized tensor reads, and GPU operations required by this Gemma artifact. Benchmark The benchmark follows the same message-template flow and sampling defaults as the chat UI. It asks two related questions, carries the first answer into the second round, reports reusable-prefix and GPU timing metrics, and checks t","default_branch":null,"files":null,"tree":[],"storefront":"/r/asallay","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/asallay/godot-llm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}