{"repo":"floneum/kalosm","free":true,"listed":false,"github":"https://github.com/floneum/kalosm","clone":"git clone https://github.com/floneum/kalosm.git","description":"Instant, controllable, local pre-trained AI models in Rust","language":"Rust","stars":2221,"topics":["ai","llm","rust","llamacpp","kalosm","candle","llama","mistral","floneum-v3","dioxus"],"license":"Apache-2.0","category":"ai-agents","readme_excerpt":"Kalosm Kalosm is an ecosystem of crates that make it easy to develop applications that use local or remote AI models. There are try main projects in this repo: - Kalosm: A simple interface for pre-trained models in rust - Fusor: A runtime for quantized ML inference. Fusor uses WGPU to run models on any accelerator natively or in the browser Kalosm Kalosm is a simple interface for pre-trained models in Rust. It makes it easy to interact with pre-trained, language, audio, and image models. Model Support Kalosm supports a variety of models. Here is a list of the models that are currently supported: Model Modality Size Description Quantized GPU Accelerated Example ---------------- -------- ---------- -------------------------------------- --------- --------------- --------------------------------------------------------------------- Llama Text 1b-70b General purpose language model ✅ ✅ llama 3 chat Mistral Text 7-13b General purpose language model ✅ ✅ mistral chat Phi Text 2b-4b Small reasoning focused language model ✅ ✅ phi 3 chat Whisper Audio 20MB-1GB Audio transcription model ✅ ✅ live whisper transcription Segment Anything Image 50MB-400MB Image segmentation model ✅ ✅ Image Segmentation Bert Text 100MB-1GB Text embedding model ✅ ✅ Semantic Search Utilities Kalosm also supports a variety of utilities around pre-trained models. These include: - Extracting, formatting and retrieving context for LLMs: Extract context from txt/html/docx/md/pdf chunk that context then search for rel","default_branch":null,"files":null,"tree":[],"storefront":"/r/floneum","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/floneum/kalosm/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}