{"repo":"lmstudio-ai/mlx-engine","free":true,"listed":false,"github":"https://github.com/lmstudio-ai/mlx-engine","clone":"git clone https://github.com/lmstudio-ai/mlx-engine.git","description":"LM Studio Apple MLX engine","language":"Python","stars":1155,"topics":["mlx","python"],"license":"MIT","category":"machine-learning","readme_excerpt":"mlx-engine - Apple MLX LLM Engine for LM Studio mlx-engine MLX engine for LM Studio Built with - mlx-lm - Apple MLX inference engine (MIT) - Outlines - Structured output for LLMs (Apache 2.0) - mlx-vlm - Vision model inferencing for MLX (MIT) How to use in LM Studio LM Studio 0.3.4 and newer for Mac ships pre-bundled with mlx-engine. Download LM Studio from here Standalone Demo Prerequisites - macOS 14.0 (Sonoma) or greater. - python3.11 - The requirements.txt file is compiled specifically for python3.11. python3.11 is the python version bundled within the LM Studio MLX runtime - brew install python@3.11 is a quick way to add python3.11 to your path that doesn't break your default python setup Install Steps To run a demo of model load and inference: 1. Clone the repository 2. Create a virtual environment (optional) 3. Install the required dependency packages Text Model Demo Download models with the lms CLI tool. The lms CLI documentation can be found here: https://lmstudio.ai/docs/cli Run the demo.py script with an MLX text generation model: mlx-community/Meta-Llama-3.1-8B-Instruct-4bit - 4.53 GB This command will use a default prompt. For a different prompt, add a custom --prompt argument like: mlx-community/Mistral-Small-Instruct-2409-4bit - 12.52 GB Vision Model Demo Run the demo.py script with an MLX vision model: Currently supported vision models include: - Llama-3.2-Vision - lms get mlx-community/Llama-3.2-11B-Vision-Instruct-4bit - Pixtral - lms get mlx-community/pixtr","default_branch":null,"files":null,"tree":[],"storefront":"/r/lmstudio-ai","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lmstudio-ai/mlx-engine/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}