{"repo":"smartive/proc-that","free":true,"listed":false,"github":"https://github.com/smartive/proc-that","clone":"git clone https://github.com/smartive/proc-that.git","description":"proc(ess)-that - easy extendable ETL tool for Node.js. Written in TypeScript.","language":"TypeScript","stars":39,"topics":["etl","extractor","loader","transformer","typescript","observables","rxjs","node"],"license":"MIT","category":"data-pipelines","readme_excerpt":"proc-that proc(ess)-that - easy extendable etl tool for nodejs written in typescript. Basically instantiate the Etl class and add extractors (which pull data from a datasource), transformers (which process the extracted data) and loaders (they load the results into a sink). A basic, hypothetic example could be: \"Load data from a JSON array, snake case all properties and store those objects into a mongoDB.\" The package is written in typescript but can be used in plain javascript as well A bunch of badges Usage After all objects are extracted, transformed and loaded, the .start() observable completes and the process is finished. Below is a list if extractors and loaders that are already implemented. Feel free to implement your own extractor / transformer / loader and contribute it to this list with a PR. Extractors Name Description Link -------------------------- --------------------------------- ---------------------------------------------------- proc-that-rest-extractor Extract objects from GET requests https://github.com/smartive/proc-that-rest-extractor Loaders Name Description Link -------------------------- ------------------------------------------- ---------------------------------------------------- proc-that-elastic-loader Load transformed objects into elasticsearch https://github.com/smartive/proc-that-elastic-loader Implement your own To ease up implementing your own extractors / transformers or loaders, just create a new repository and install proc-that as a dev-d","default_branch":null,"files":null,"tree":[],"storefront":"/r/smartive","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/smartive/proc-that/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}