{"repo":"Tencent/AngelSlim","free":true,"listed":false,"github":"https://github.com/Tencent/AngelSlim","clone":"git clone https://github.com/Tencent/AngelSlim.git","description":"Model compression toolkit engineered for enhanced usability, comprehensiveness, and efficiency.","language":"Python","stars":1532,"topics":["llm","llm-compression","quantization","speculative-decoding","diffusion","vlm","hunyuan","deepseek","qwen","fp4"],"license":null,"category":"ai-agents","readme_excerpt":"English 简体中文 A more accessible, comprehensive, and efficient toolkit for large model compression. ✒️ TechnicalReport &nbsp&nbsp &nbsp&nbsp 📖 Documentation &nbsp&nbsp &nbsp&nbsp🤗 Hugging Face &nbsp&nbsp &nbsp&nbsp🤖 ModelScope 💬 WeChat &nbsp&nbsp🫨 Discord 📣Latest News - [26/07/29] We have open-sourced AngelSpec , a torch-native, disaggregated speculative-decoding training framework with support for a variety of draft methods, led by DFly and MTP + TTT , and released the MTP and DFly drafter weights for Hy3-A21B — DFly delivers up to 2.40× average end-to-end speedup over AR, and D-cut adds up to +15.7% throughput at high concurrency. [[Paper]](https://arxiv.org/abs/2607.25852) [[GitHub]](https://github.com/Tencent/AngelSpec) [[Docs]](https://angelspec.readthedocs.io/) [[Hugging Face]](https://huggingface.co/collections/AngelSlim/angelspec) 🔥🔥🔥 - [26/07/20] We now support scale-only quantization-aware distillation on Megatron-Core for Qwen3-MoE and Hy3, with TP/EP/CP/SP distributed training. [[Docs]](docs/source/features/qad/mcore qad.md) - [26/07/06] We now support FP8-Static quantization , SmoothQuant for Hy3 (MoE A21B).[[Docs]](https://github.com/Tencent/AngelSlim/tree/main/scripts/ptq) - [26/06/04] We have released Stem , a sparse attention algorithm that accelerates the Prefill stage of long-context LLMs by dynamically selecting top-k key blocks for block-sparse attention, significantly reducing latency while preserving generation quality. [[Docs]](https://angelslim","default_branch":null,"files":null,"tree":[],"storefront":"/r/Tencent","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Tencent/AngelSlim/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}