{"repo":"n0rdy/pippin","free":true,"listed":false,"github":"https://github.com/n0rdy/pippin","clone":"git clone https://github.com/n0rdy/pippin.git","description":"Go library to create and manage data pipelines on your machine","language":"Go","stars":14,"topics":["async","asynchronous","data","data-engineering","data-pipeline","data-processing","go","golang","golang-library","golang-package"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Pippin Pippin is a simple, lightweight, and (hopefully) easy to use Go library for creating and managing data pipelines on your machine. The library heavily relies on goroutines and channels, but this complexity is hidden from the user behind a simple API. Basically, this is the main purpose why I implemented this library in the first place. It has no external dependencies except for the two Go standard library experimental packages: - golang.org/x/exp - golang.org/x/sync and one external dependency for testing goroutine leaks: - go.uber.org/goleak Please, note that the library is still in the early development stage, so the API might change in the future. There still might be some bugs, so please, feel free to report them. But we already have [insert library here]! We've had one, yes. But what about second breakfast library? Table of contents Installation Usage Simple example More detailed example Documentation Concepts Pipeline Creation Configuration Manual start Interrupting Stage Transformation Aggregation Future Configuration Installation Usage Simple example More detailed example Documentation Find the full documentation here. Concepts The main concepts of Pippin are: - pipeline - stage Pipeline Pipeline is a sequence of stages. It is the first and the key object in the library. Its API provides a possibility to interrupt the entire pipeline. The user can see the pipeline current status by accessing the Status field. Please, note that the status is updated asynchronousl","default_branch":null,"files":null,"tree":[],"storefront":"/r/n0rdy","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/n0rdy/pippin/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}