{"repo":"philiporlando/dagster-and-r","free":true,"listed":false,"github":"https://github.com/philiporlando/dagster-and-r","clone":"git clone https://github.com/philiporlando/dagster-and-r.git","description":"Interfacing Dagster and R","language":"Python","stars":24,"topics":["dagster","python","r","r-language","reticulate"],"license":null,"category":"data-pipelines","readme_excerpt":"[!IMPORTANT] This repository is no longer maintained. It was an early experiment in integrating Dagster with R. For a proper implementation of the Dagster Pipes protocol in R, see {dagsterpipes} . dagster and r Exploring the synergy between Dagster, a modern data orchestrator, and R, a powerful statistical programming language. This project showcases how business logic written in R can be integrated seamlessly within the Dagster framework. Key Features - Docker Integration : Execute R code in isolated environments using Docker container ops. - Dagster Pipes : Run R scripts within a subprocess, leveraging Dagster's experimental Pipes feature. - Reticulate Bridge : Utilize the {reticulate} R package to create a bridge between Python and R, enhancing interoperability. Getting started To begin exploring the integration of Dagster and R: 1. Clone the Repository 2. Navigate to Directory 3. Install Dependencies Using poetry, install the package and its dependencies: 4. Set RETICULATE PYTHON environment variable Determine the path to the python binary associated with this project's poetry environment. Create a new .Renviron file at the root of the project and set the RETICULATE PYTHON variable to this path. 5. Launch the Dagster UI Start the Dagster web server: Access the UI at http://localhost:3000 in your browser. 6. Materialize Assets Click the \"Materialize all\" button in the top right of the UI. Each of the assets within this project should materialize without error. 7. Inspect t","default_branch":null,"files":null,"tree":[],"storefront":"/r/philiporlando","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/philiporlando/dagster-and-r/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}