{"repo":"Epistates/pmetal","free":true,"listed":false,"github":"https://github.com/Epistates/pmetal","clone":"git clone https://github.com/Epistates/pmetal.git","description":"PMetal: high-performance Apple Silicon framework for local LLM inference, LoRA/QLoRA fine-tuning, serving, quantization, and MLX/Metal acceleration.","language":"Rust","stars":308,"topics":["ai","llm-inference","llm-training","metal","mlx","ane","distillation","tui","apple-silicon","deep-learning"],"license":null,"category":"machine-learning","readme_excerpt":"PMetal Powdered Metal — An ML SDK, framework, and application suite for Apple Silicon, written in Rust. PMetal is a complete machine learning platform for Apple Silicon — from low-level Metal GPU kernels and Apple Neural Engine integration to high-level training APIs, a terminal TUI, and a full desktop GUI. Ship fine-tuned models without leaving the Apple ecosystem. Use PMetal Your Way Desktop GUI A full Tauri + Svelte desktop application for visual model management, training, and inference. 10 pages: Dashboard, Models, Datasets, Training, Distillation, GRPO, Inference, Merging, Quantize, and Settings. Download models from HuggingFace, configure LoRA training with live loss metrics, chat with models, merge weights, and quantize — all from the GUI. Training runs in-process with real-time progress updates. Terminal TUI A full-featured terminal control center with 9 tabs. Tab Description ----- ------------- Dashboard Live loss curves (braille), LR schedule, throughput sparklines, timing breakdown gauges Device GPU/ANE info, Metal feature detection, memory gauge, kernel tuning, UltraFusion topology Models Browse cached models, HuggingFace Hub search ( S ), memory fit estimation, download Datasets Scan and preview local datasets (JSONL, Parquet, CSV) with line counts Training Configure and launch SFT/LoRA/QLoRA training runs with sectioned parameter forms Distillation Configure knowledge distillation (online, offline, progressive) GRPO Configure GRPO/DAPO reasoning training with r","default_branch":null,"files":null,"tree":[],"storefront":"/r/Epistates","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Epistates/pmetal/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}