{"repo":"PayLead/dagster-nomad","free":true,"listed":false,"github":"https://github.com/PayLead/dagster-nomad","clone":"git clone https://github.com/PayLead/dagster-nomad.git","description":"Nomad launcher/executor for Dagster","language":"Python","stars":22,"topics":["dagster","nomad"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Dagster Nomad This is an example Dagster project with the dagster-nomad integration. Setup 1. Install a Nomad cluster following the Nomad documentation. 2. Install Terraform following the Terraform documentation. 3. Install just for launching commands Just documentation. 4. Install Dagster and dagster-nomad in a python virtual environment: 5. Install Docker compose Run example Build an image for the RunLauncher to use and adjust the tag in tf/dagster-executor.hcl In a terminal run the following Create a bucket dagster in minio In another terminal run the following. Open in your browser dagster-webserver and nomad-ui Multiple Code Locations example Following the convention for the DockerRunLauncher and K8sRunLauncher , the DAGSTER CURRENT IMAGE environment variable can used to specify the Docker image for the NomadRunLauncher to use. Build the different images for your code locations. Launch the multiple code locations: Uncomment the load from.grpc server in the workspace.yaml files","default_branch":null,"files":null,"tree":[],"storefront":"/r/PayLead","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/PayLead/dagster-nomad/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}