{"repo":"engeldlgado/toshllm","free":true,"listed":false,"github":"https://github.com/engeldlgado/toshllm","clone":"git clone https://github.com/engeldlgado/toshllm.git","description":"Run large language models locally on Intel Macs with AMD GPUs - native macOS app with Metal acceleration","language":"Swift","stars":118,"topics":["amd-gpu","hackintosh","intel-mac","llama-cpp","llm","local-ai","macos","metal","swiftui"],"license":"GPL-3.0","category":"ai-agents","readme_excerpt":"ToshLLM Run large language models locally on Intel Macs with AMD GPUs. Native macOS app · Metal acceleration · No cloud, no accounts, no per-token costs -lightgrey) ⬇️ Download the latest release · 📝 Changelog Versión en español más abajo --- What is ToshLLM? ToshLLM lets you run modern open LLMs entirely on your own Mac — your chats never leave the machine, there are no accounts, and there's nothing to pay per token. Most local-LLM tools on macOS only target Apple Silicon. Intel Macs with discrete AMD GPUs — including Hackintosh builds — get left behind: the stock engines produce corrupted output on AMD dGPUs and read model weights over PCIe at a fraction of the possible speed. ToshLLM fixes that. It bundles llama.cpp built with AMD-specific patches and wraps it in a polished native SwiftUI app — so a card like the RX 6700 XT goes from unusable to genuinely fast: Stock llama.cpp on AMD dGPU ToshLLM --- --- --- Output corrupted correct Qwen3-8B generation 0.6–2.6 t/s 61 t/s Qwen3.6-35B (MoE) generation unusable 24 t/s , flat on long runs It opens, detects your hardware, and recommends models that will actually run well — no guesswork. Features - Native chat — multiple persistent conversations, full Markdown with code-copy, regenerate, system prompt, live tokens/sec, file attachments, conversation forking and per-message metrics - Agent tools and MCP — the model can read, edit and run files and commands with per-step permission, run JavaScript in a sandbox, and use tools from","default_branch":null,"files":null,"tree":[],"storefront":"/r/engeldlgado","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/engeldlgado/toshllm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}