{"repo":"cubist38/mlx-openai-server","free":true,"listed":false,"github":"https://github.com/cubist38/mlx-openai-server","clone":"git clone https://github.com/cubist38/mlx-openai-server.git","description":"A high-performance API server that provides OpenAI-compatible endpoints for MLX models. Developed using Python and powered by the FastAPI framework, it provides an efficient, scalable, and user-friendly solution for running MLX-based vision and language models locally with an OpenAI-compatible interface.","language":"Python","stars":357,"topics":["mlx","mlx-vlm","fastapi","mlx-lm","queue","apple-silicon","vision-api","openai-compatible","speech-recognition","flux"],"license":"MIT","category":"machine-learning","readme_excerpt":"mlx-openai-server OpenAI-compatible API server for local MLX models on Apple Silicon. It serves text, multimodal, image, embedding, and Whisper models through familiar OpenAI SDK endpoints. Requires macOS on Apple Silicon and Python 3.11+. Contents - Feature Launch - Install - Start a Server - API Usage - Server Options - Multi-Model Config - Long Context and Metal OOM - Advanced LM Options - Troubleshooting - Examples and Demos Feature Launch Darwin 36B Opus is now available in MLX format for local text inference: - Original model: FINAL-Bench/Darwin-36B-Opus - MLX text-only 8-bit conversion: GiaHuy/Darwin-36B-Opus-mlx-text-only-8bit Launch it with the required reasoning and tool-call parsers: Darwin 36B Opus should be served with both --reasoning-parser qwen3 moe and --tool-call-parser qwen3 coder ; without them, reasoning and tool-call output will not be parsed correctly. Install Install from GitHub instead: Whisper transcription also needs ffmpeg: Start a Server Text model: Point OpenAI-compatible clients to: Use any non-empty API key, for example not-needed . Common launch modes: Supported model types: Type Backend Endpoint family ------ --------- ----------------- lm mlx-lm chat, responses multimodal mlx-vlm chat, responses image-generation mflux image generation image-edit mflux image editing embeddings mlx-embeddings embeddings whisper mlx-whisper audio transcription Image --config-name values: - Generation: flux-schnell , flux-dev , flux-krea-dev , flux2-klein-4b , f","default_branch":null,"files":null,"tree":[],"storefront":"/r/cubist38","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/cubist38/mlx-openai-server/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}