{"repo":"licaonfee/selina","free":true,"listed":false,"github":"https://github.com/licaonfee/selina","clone":"git clone https://github.com/licaonfee/selina.git","description":"ETL/Pipeline library","language":"Go","stars":18,"topics":["etl","pipeline","golang"],"license":"MIT","category":"data-pipelines","readme_excerpt":"selina Simple Pipeline for go, inspired on ratchet Unstable API, please use go modules - selina - Installation - Usage - Graphviz - Builtin workers - Design - Pipeline - Node - Worker - Conventions for workers - Codec - Command line Usage - Autocompletion - Get json-shema - VIM - VSCode Installation Usage Graphviz Optionally you can render a graph of your pipeline With te previous code you get a .dot graph Renderized with graphviz Builtin workers By default selina has this workers implemented - csv.Encoder : Transform data from json to csv - csv.Decoder : Transform csv data into json - custom.Function : Allow to execute custom functions into a pipeline node - ops.Cron : Allow scheduled messages into a pipeline - ops.TimeSerie: Generate time series data - random.Random : Generate random byte slices - regex.Filter : Filter data using a regular expresion - remote.Server : Listen for remote data - remote.Client : Send data to a remote pipeline - sql.Reader : Execute a query against a database and return its rows as json objects - sql.Writer : Insert rows into a table from json objects - text.Reader : Use any io.Reader and read its contents as text - text.Writer : Write text data into any io.Writer - filesystem.Reader : Use afero.Fs to read arbitrary files - filesystem.Writer : Use afero.Fs to write to arbitrary files Design Selina have three main components - Pipeline - Node - Worker Some utility functions are provided to build pipelines, chain all nodes in same order as their ar","default_branch":null,"files":null,"tree":[],"storefront":"/r/licaonfee","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/licaonfee/selina/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}