{"repo":"noleme/noleme-flow","free":true,"listed":false,"github":"https://github.com/noleme/noleme-flow","clone":"git clone https://github.com/noleme/noleme-flow.git","description":"A library enabling DAG structuring of data processing programs such as ETLs","language":"Java","stars":18,"topics":["java","workflow","workflow-engine","dag","etl-pipeline","dataflow"],"license":"MIT","category":"workflow-automation","readme_excerpt":"Noleme Flow This library provides features enabling DAG structuring of data processing programs such as ETLs. Note (2025-12): Looking back on this project, I remain convinced that there are quite a few \"nuggets of truth\" in this library's design ; I got bogged down when attempting to fix some of its core internals, but its composition model is still something I find myself longing for in most of my projects. I plan to restore it and work on its shortcomings in a hopefully not too far future, possibly by relying on concurrency APIs provided by newer JDKs, and most likely with a more marked focus on observability features I. Installation Add the following in your pom.xml : II. Notes on Structure and Design The core idea behind this library is to structure the program as a DAG of \"actions\" to perform, then compile that graph into concrete runnable instance which properties will depend on the implementation. These actions can be of three different types, mirroring an ETL process: Extractor for introducing data into the flow, they would typically be connectors for a variety of data sources Transformer for manipulating data and returning an altered version of it, or new data inferred from the input Loader for dumping data out of the flow Additionally, there are two actions related to stream flows: Generator for gradually introducing data into the flow, they can be iterating through a Collection , reading off an InputStream or generating data on-the-fly Accumulator for doing the rev","default_branch":null,"files":null,"tree":[],"storefront":"/r/noleme","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/noleme/noleme-flow/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}