{"repo":"carolinacherry/local-ai","free":true,"listed":false,"github":"https://github.com/carolinacherry/local-ai","clone":"git clone https://github.com/carolinacherry/local-ai.git","description":"Run Qwen3.5 on your iPhone. No cloud. No API keys. No subscriptions. 100% on-device.","language":"Swift","stars":21,"topics":["apple","huggingface","ios","iphone","local-llm","mit-license","mlx","offline","on-device-ai","privacy"],"license":"MIT","category":"mobile-apps","readme_excerpt":"4B Run Qwen3.5 entirely on your iPhone. No cloud. No API keys. No subscriptions. https://github.com/user-attachments/assets/63a70984-d895-4f31-821f-1fafa32a89e7 iPhone 17 Pro, airplane mode, zero internet. 26 tok/s. Why Two years ago, GPT-4o cost $20/month and required a datacenter. Today, the same quality runs on your iPhone for free. Permanently. \"According to benchmarks Qwen3.5 4B is as good as GPT 4o. GPT 4o came out 2 years ago (May 2024). Qwen 3.5 4B runs easily on modern mobile devices. So the gap between frontier intelligence in a datacenter and running a model of equal quality on your iPhone could be 2-3 years.\" — Awni Hannun, co-creator of MLX Models Model Size Speed Notes ------- ------ ------- ------- Qwen3.5 4B 2.9 GB 26 tok/s Default. GPT-4o quality per benchmarks. Qwen3.5 2B 1.5 GB 55 tok/s Fast. Good for older devices. Qwen3.5 0.8B 0.6 GB 80 tok/s Fastest. Simple tasks only. Qwen3.5 9B 5.6 GB 20 tok/s Best quality. Requires 8 GB RAM. All models are 4-bit quantized via MLX from Hugging Face. Features - 100% on-device inference via Apple MLX - Web search via Brave Search API (optional, API key stored in Keychain) - Conversation persistence across app restarts - Repetition detection and auto-stop - Model switcher with download manager - Voice input via on-device speech recognition - Dark mode toggle (System / Light / Dark) - Haptic feedback on send and generation complete - Markdown rendering, copy button, tok/s stats Requirements - iPhone 15 Pro or later (8+ GB ","default_branch":null,"files":null,"tree":[],"storefront":"/r/carolinacherry","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/carolinacherry/local-ai/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}