{"repo":"beam-cloud/beta9","free":true,"listed":false,"github":"https://github.com/beam-cloud/beta9","clone":"git clone https://github.com/beam-cloud/beta9.git","description":"Ultrafast serverless GPU inference, sandboxes, and background jobs","language":"Go","stars":1746,"topics":["gpu","ml-platform","cuda","fine-tuning","generative-ai","large-language-models","llm","distributed-computing","llm-inference","self-hosted"],"license":"AGPL-3.0","category":"ai-agents","readme_excerpt":"Run AI Workloads at Scale Beam is a fast, open-source runtime for serverless AI workloads. It gives you a Pythonic interface to deploy and scale AI applications with zero infrastructure overhead. ✨ Features - Fast Cold Starts : Launch containers in under a second using a custom container runtime, scheduler, and embedded caching - Parallelization and Concurrency : Fan out workloads to 100s of containers - First-Class Developer Experience : Hot-reloading, webhooks, and scheduled jobs - Scale-to-Zero : Workloads are serverless by default - Volume Storage : Mount distributed storage volumes - GPU Support : Run on our cloud (4090s, H100s, and more) or bring your own GPUs 📦 Installation ⚡️ Quickstart 1. Create an account here 2. Follow our Getting Started Guide Creating a sandbox Spin up isolated containers to run LLM-generated code: Deploy a serverless inference endpoint Create an autoscaling endpoint for your custom model: Run background tasks Schedule resilient background tasks (or replace your Celery queue) by adding a simple decorator: ## Self-Hosting vs Cloud Beta9 is the open-source engine powering Beam, our fully-managed cloud platform. You can self-host Beta9 for free or choose managed cloud hosting through Beam. 👋 Contributing We welcome contributions big or small. These are the most helpful things for us: - Submit a feature request or bug report - Open a PR with a new feature or improvement ❤️ Thanks to Our Contributors","default_branch":null,"files":null,"tree":[],"storefront":"/r/beam-cloud","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/beam-cloud/beta9/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}