{"repo":"danielgafni/dagster-ray","free":true,"listed":false,"github":"https://github.com/danielgafni/dagster-ray","clone":"git clone https://github.com/danielgafni/dagster-ray.git","description":"Ray integration for Dagster","language":"Python","stars":68,"topics":["dagster","kubernetes","orchestration","ray","dagster-pipes"],"license":"Apache-2.0","category":"workflow-automation","readme_excerpt":"dagster-ray --- Ray integration for Dagster. dagster-ray enables working with distributed Ray compute from Dagster pipelines, combining Dagster's excellent orchestration capabilities and Ray's distributed computing power together. [!NOTE] This project is ready for production use, but some APIs may change between minor releases. Learn more in the docs 🚀 Key Features - 🎯 Run Launchers & Executors : Submit Dagster runs or individual steps by submitting Ray jobs - 🔧 Ray Resources : Automatically create and destroy ephemeral Ray clusters and connect to them in client mode - 📡 Dagster Pipes Integration : Submit external scripts as Ray jobs, stream back logs and rich Dagster metadata - ☸️ KubeRay Support : Utilize RayJob and RayCluster custom resources in client or job submission mode (tutorial) - 🏭 Production Ready : Tested against a matrix of core dependencies, integrated with Dagster+ - ⚡ Instant Startup : Leverage RayCluster with Cluster Sharing for lightning-fast development cycles with zero cold start times (intended for development environments) 📦 Installation 📚 Docs 📖 Full Documentation - Tutorial : Step-by-step guide with examples - API Reference : Complete API reference - Changelog : History of changes and links to docs for older dagster-ray releases. 👥 Who is using dagster-ray ? These happy users are running dagster-ray in production: - Anam - kaiko - Sanas - IPRally 🤝 Contributing Contributions are very welcome! See CONTRIBUTING.md for details.","default_branch":null,"files":null,"tree":[],"storefront":"/r/danielgafni","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/danielgafni/dagster-ray/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}