{"repo":"ankiano/etl","free":true,"listed":false,"github":"https://github.com/ankiano/etl","clone":"git clone https://github.com/ankiano/etl.git","description":"Extract transform load CLI tool for extracting small and middle data volume from sources (databases, csv files, xls files, gspreadsheets) to target (databases, csv files, xls files, gspreadsheets) in free combination.","language":"Python","stars":11,"topics":["etl","data-engineering","data-pipeline","datapipeline","etl-job","etl-process","extract-transform-load","extractor","usql","database"],"license":null,"category":"data-pipelines","readme_excerpt":"Extract transform load CLI tool for extracting small and middle data volume between sources (databases, csv, xls, parquet, json, xml, gspreadsheets, stdin, stdout). For documentation and full examples, please see the documentation. Installation: pipx install \"git+https://github.com/ankiano/etl #core, minimal set of dependencies pipx install \"etl[postgres] @ git+https://github.com/ankiano/etl\" pipx install \"etl[clickhouse] @ git+https://github.com/ankiano/etl\" pipx install \"etl[all] @ git+https://github.com/ankiano/etl\" #all dependencies pipx inject etl pymssql #to add extra driver pip install git+https://github.com/ankiano/etl.git -U #for user install sudo -H pip3 install git+https://github.com/ankiano/etl.git -U #global install Quick examples of usage: etl --help etl --list etl --source 'https://raw.githubusercontent.com/mwaskom/seaborn-data/master/titanic.csv??sep=,' --target input/titanic.xlsx etl --source 'sqlite:////home/user/my-local.db' --extract my-query.sql --target result.csv etl --source db alias2 --extract my-query-template.sql --user sql parameter 123 --target output/result.xlsx etl --source db alias3 --extract my-query.sql --target gsheet --load some-gsheet-workbook!my-sheet etl --source input/titanic.xlsx --target 'sqlite:///local.db' --load main.titanic Options syntax scheme: Configurating: Example of .etl.yml : local: 'sqlite:///local.db' #relative path, e.x. in the same dir where etl runs db alias1: 'sqlite:////home/user/workspace/folder/some.db' #absolute p","default_branch":null,"files":null,"tree":[],"storefront":"/r/ankiano","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ankiano/etl/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}