{"repo":"TrevorS/voxtral-mini-realtime-rs","free":true,"listed":false,"github":"https://github.com/TrevorS/voxtral-mini-realtime-rs","clone":"git clone https://github.com/TrevorS/voxtral-mini-realtime-rs.git","description":"Voxtral ASR & TTS running natively and in the browser. A Rust implementation of Mistral's Voxtral mini realtime ASR / TTS using the Burn ML framework","language":"Rust","stars":815,"topics":["asr","burn","mistral","rust","voxtral-mini-realtime","wasm","audio","q4","speech","tts"],"license":"Apache-2.0","category":"media-processing","readme_excerpt":"Voxtral Mini 4B Realtime (Rust) Streaming speech recognition and text-to-speech running natively and in the browser. A pure Rust implementation of Mistral's Voxtral Mini 4B Realtime (ASR) and Voxtral 4B TTS models using the Burn ML framework. Benchmarks NVIDIA DGX Spark (GB10, LPDDR5x). ASR (Speech Recognition) 16s test audio, 3-run average: Path Encode Decode Total RTF Tok/s Memory ------ -------- -------- ------- ----- ------- -------- Q4 GGUF native 1021 ms 5578 ms 6629 ms 0.416 19.4 703 MB BF16 native 887 ms 23689 ms 24607 ms 1.543 4.6 9.2 GB Q4 GGUF WASM — — 225 s 14.1 0.5 (browser) - 8.49% WER on FLEURS English (647 utterances), vs. Mistral's reported 4.90% at f32 TTS (Text-to-Speech) \"The quick brown fox jumps over the lazy dog\" (9 tokens), casual female voice: Path Euler Steps Gen Time Audio RTF Model Size ------ ------------- ---------- ------- ----- ------------ Q4 GGUF native 3 3.7s 3.84s 0.97 2.67 GB Q4 GGUF native 4 5.0s 4.96s 1.01 2.67 GB BF16 native 3 10.4s 2.72s 3.82 8 GB BF16 native 8 20.6s 2.96s 6.97 8 GB Q4 GGUF WASM 8 367s 3.52s 104 2.67 GB - RTF buffers 2. 4 GB address space — Two-phase loading: parse weights, drop reader, then finalize 3. 1.5 GiB embedding table — Q4 embeddings on GPU + CPU-side row lookups 4. No sync GPU readback — All tensor reads use into data async().await 5. 256 workgroup invocation limit — Patched cubecl-wgpu to cap reduce kernel workgroups Building Feature Flags Feature Description --------- ------------- wgpu (default) GPU backen","default_branch":null,"files":null,"tree":[],"storefront":"/r/TrevorS","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/TrevorS/voxtral-mini-realtime-rs/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}