{"repo":"dmitryryabkov/local-ai-mac","free":true,"listed":false,"github":"https://github.com/dmitryryabkov/local-ai-mac","clone":"git clone https://github.com/dmitryryabkov/local-ai-mac.git","description":"Practical guide to running LLMs locally on Apple Silicon, with a focus on architecture, memory scaling, and agent workflows.","language":null,"stars":70,"topics":["agentic-ai","agentic-workflow","agentic-workflows","apple-silicon","claude-code","llama-cpp","llamacpp","lm-studio","local-ai","local-llm"],"license":"MIT","category":"ai-agents","readme_excerpt":"Running (and coding with) Local AI on a Mac This is a comprehensive guide on how to run AI models and coding agents locally on a Mac. I gathered various bits and pieces of information scattered across the internet into a single resource. If you have a spare Mac lying around, you can turn it into an “LLM server” and use it instead of paying for OpenAI, Claude, etc. You’ll need a decent amount of RAM for this to work. Around 32GB is where things start getting interesting. I’m currently running 30B-class models with the same 128K context window as OpenAI Codex on an M3 MacBook Pro with 36GB of RAM — all locally. ⚠️ This guide assumes familiarity with LLM concepts, inference engines, and basic system configuration. It is a good starting point for anyone who is building local AI systems or is experimenting with agent workflows. Why? Because it works — and surprisingly well. But more importantly: there are cost and privacy benefits of running AI locally. The architecture of Apple’s M-series chips suits this type of workload. AI models benefit from GPUs with access to large amounts of memory. Macs, with their unified memory architecture — where GPU cores can access nearly all available RAM — become a viable alternative to consumer GPUs (which often ship with much less memory). Even NVIDIA has started moving in this direction with systems like DGX Spark. Standalone GPUs still have more raw compute throughput, to set expectations correctly. But for many advanced workflows, Apple Silic","default_branch":null,"files":null,"tree":[],"storefront":"/r/dmitryryabkov","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/dmitryryabkov/local-ai-mac/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}