{"repo":"john-rocky/EdgeLLM","free":true,"listed":false,"github":"https://github.com/john-rocky/EdgeLLM","clone":"git clone https://github.com/john-rocky/EdgeLLM.git","description":"Simple LLM package for ios devices.","language":"Swift","stars":37,"topics":["ai","chatgpt","claude","gemma","ios","llm","mlc-llm","mobile","qwen","swift"],"license":"Apache-2.0","category":"mobile-apps","readme_excerpt":"EdgeLLM EdgeLLM Run Large Language Models on iOS devices with just one line of code Note : EdgeLLM is now fully functional! Supports multiple models including Qwen, Gemma, and Phi-3. Quick Start Fictional penguin article summarised offline. Features - Dead Simple - Chat with LLMs in one line - iOS Optimized - Metal GPU acceleration for blazing speed - Privacy First - Everything runs on-device - Easy Install - Swift Package Manager ready - Streaming Support - Real-time token-by-token responses - System Prompts - Set context and personality - Multi-Turn Conversations - Full conversation history support - SwiftUI Ready - Observable wrapper for SwiftUI apps - Model Management - Download, cache, and manage models - Custom Models - Bring your own MLC-compiled models Installation Swift Package Manager In Xcode: 1. File - Add Package Dependencies 2. Enter URL: https://github.com/john-rocky/EdgeLLM 3. Select version and click \"Add Package\" Or add to your Package.swift : Supported Models Model Enum Size Best For ------- ------ ------ ---------- Qwen 0.6B .qwen06b 1.2 GB Fastest responses, low-end devices Gemma 2B .gemma2b 2.5 GB Balanced speed & quality Phi-3.5 Mini .phi3 mini 3.8 GB Best quality, reasoning tasks Models are automatically downloaded on first use (WiFi recommended). Usage Simplest Example Streaming Responses System Prompts Multi-Turn Conversations Generation Options SwiftUI Integration Model Management Custom Models Bring your own MLC-compiled models when using a custom ","default_branch":null,"files":null,"tree":[],"storefront":"/r/john-rocky","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/john-rocky/EdgeLLM/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}