{"repo":"PrunaAI/pruna","free":true,"listed":false,"github":"https://github.com/PrunaAI/pruna","clone":"git clone https://github.com/PrunaAI/pruna.git","description":"Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.","language":"Python","stars":1272,"topics":["ai","computer-vision","deep-learning","llm","machine-learning","optimization","python","speech-recognition","diffusion-models","diffusers"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Simply make AI models faster, cheaper, smaller, greener! [ ][documentation]   [ ][api dashboard] [ ][website] [ ][x] [ ][devto] [ ][reddit] [ ][discord] [ ][huggingface] [ ][replicate] Introduction Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead. It provides a comprehensive suite of compression algorithms including caching, quantization, pruning, distillation and compilation techniques to make your models: - Faster : Accelerate inference times through advanced optimization techniques - Smaller : Reduce model size while maintaining quality - Cheaper : Lower computational costs and resource requirements - Greener : Decrease energy consumption and environmental impact The toolkit is designed with simplicity in mind - requiring just a few lines of code to optimize your models. It supports various model types including LLMs, Diffusion and Flow Matching Models, Vision Transformers, Speech Recognition Models and more. Installation Pruna is currently available for installation on Linux, MacOS and Windows. However, some algorithms impose restrictions on the operating system and might not be available on all platforms. Before installing, ensure you have: - Python 3.9 or higher - Optional: CUDA toolkit for GPU support Option 1: Install Pruna using pip Pruna is available on PyPI, so you can install it using pip: Option 2: Install Pruna from source You can also install Pruna directly from source","default_branch":null,"files":null,"tree":[],"storefront":"/r/PrunaAI","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/PrunaAI/pruna/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}