{"repo":"jamjamjon/usls","free":true,"listed":false,"github":"https://github.com/jamjamjon/usls","clone":"git clone https://github.com/jamjamjon/usls.git","description":"A Rust library integrated with ONNXRuntime, providing a collection of Computer Vison and Vision-Language models such as YOLO, FastVLM, and more.","language":"Rust","stars":439,"topics":["cuda","tensorrt","yolov8","ocr","yolo","rust-yolo","yolo-rs","yolo-rust","sam","grounding-dino"],"license":"MIT","category":"media-processing","readme_excerpt":"usls usls is a cross-platform Rust library powered by ONNX Runtime for efficient inference of SOTA vision and vision-language models ( typically under 1B parameters ). (Generated by Seedream4.5) 🌟 Highlights - ⚡ High Performance : Multi-threading, SIMD, and CUDA-accelerated processing - ✨ Cross-Platform : Linux, macOS, Windows with ONNX Runtime execution providers (CUDA, TensorRT, CoreML, OpenVINO, DirectML, etc.) - 🎯 Precision Support : FP32, FP16, INT8, UINT8, Q4, Q4F16, BNB4, and more - 🛠️ Full-Stack Suite : DataLoader , Annotator , and Viewer for complete workflows - 🏗️ Unified API : Single Model trait inference with run() / forward() / encode images() / encode texts() and unified Y output - 📥 Auto-Management : Automatic model download (HuggingFace/GitHub), caching and path resolution - 📦 Multiple Inputs : Image, directory, video, webcam, stream and combinations - 🌱 Model Ecosystem : 50+ SOTA vision and VLM models 🚀 Quick Start Run the YOLO-Series demo to explore models with different tasks, precision and execution providers: - Tasks : detect , segment , pose , classify , obb - Versions : v5 , v6 , v7 , v8 , v9 , v10 , 11 , 12 , v13 , 26 - Scales : n , s , m , l , x - Precision : fp32 , fp16 , q8 , int8 , q4 , q4f16 , bnb4 , and more - Execution Providers : CPU , CUDA , TensorRT , TensorRT-RTX , CoreML , OpenVINO , and more CPU Nvidia CUDA + CUDA Image Processor Nvidia TensorRT + CUDA Image Processor Nvidia TensorRT-RTX + CUDA Image Processor Apple Silicon CoreML ","default_branch":null,"files":null,"tree":[],"storefront":"/r/jamjamjon","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/jamjamjon/usls/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}