{"repo":"bentoml/BentoDiffusion","free":true,"listed":false,"github":"https://github.com/bentoml/BentoDiffusion","clone":"git clone https://github.com/bentoml/BentoDiffusion.git","description":"BentoDiffusion: A collection of diffusion models served with BentoML","language":"Python","stars":389,"topics":["ai","diffusion-models","fine-tuning","kubernetes","lora","model-serving","stable-diffusion"],"license":"Apache-2.0","category":"machine-learning","readme_excerpt":"Self-host Diffusion Models with BentoML This repository contains a series of BentoML example projects, demonstrating how to deploy different models in the Stable Diffusion (SD) family, which is specialized in generating and manipulating images or video clips based on text prompts. See here for a full list of BentoML example projects. The following guide uses SDXL Turbo as an example. Prerequisites If you want to test the Service locally, we recommend you use an Nvidia GPU with at least 12GB VRAM. Install dependencies Run the BentoML Service We have defined a BentoML Service in service.py . Run bentoml serve in your project directory to start the Service. The server is now active at http://localhost:3000. You can interact with it using the Swagger UI or in other different ways. CURL Python client For detailed explanations of the Service code, see Stable Diffusion XL Turbo. Deploy to BentoCloud After the Service is ready, you can deploy the application to BentoCloud for better management and scalability. Sign up if you haven't got a BentoCloud account. Make sure you have logged in to BentoCloud. Deploy it to BentoCloud. Once the application is up and running on BentoCloud, you can access it via the exposed URL. Note : For custom deployment in your own infrastructure, use BentoML to generate an OCI-compliant image. Choose another diffusion model To deploy a different diffusion model, go to the corresponding subdirectories of this repository. - FLUX.1 - Stable Diffusion 3 Medium ","default_branch":null,"files":null,"tree":[],"storefront":"/r/bentoml","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bentoml/BentoDiffusion/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}