{"repo":"bruin-data/ingestr","free":true,"listed":false,"github":"https://github.com/bruin-data/ingestr","clone":"git clone https://github.com/bruin-data/ingestr.git","description":"ingestr is a CLI tool to copy data between any databases with a single command seamlessly.","language":"Go","stars":3843,"topics":["bigquery","copy-database","data-ingestion","data-integration","data-pipeline","duckdb","ingestion-pipeline","mssql","postgresql","snowflake"],"license":null,"category":"data-pipelines","readme_excerpt":"Copy data from any source to any destination without any code --- ingestr is a command-line app that allows you to ingest data from any source into any destination using simple command-line flags, no code necessary. - ✨ copy data from your database into any destination - ➕ incremental loading: append , merge or delete+insert - 🐍 single-command installation ingestr takes away the complexity of managing any backend or writing any code for ingesting data, simply run the command and watch the data land on its destination. Installation You can install ingestr using the install script: Alternatively, you can install it with pip: The pip package can also be used from Python. Install the SDK extra for Python data ingestion: Python rows, generators, and DataFrames are sent to the ingestr CLI binary as Arrow IPC streams by default. The pip package downloads and caches the matching GitHub release binary on first use: DataFrames and yielded data use the same Arrow stream transport: For push-style code, omit the data argument and use ingest as a context manager. The context value accepts the same shapes as ingestr.ingest(data, ...) : For very large already-materialized data, use the existing mmap Arrow IPC file transport: For full CLI pass-through, use ingestr.run([\"ingest\", \"--source-uri\", \"...\", \"--dest-uri\", \"...\", \"--source-table\", \"...\"]) , or ingestr.run cli(...) for keyword arguments that map to CLI flags. Quickstart That's it. This command: - gets the table public.some data from ","default_branch":null,"files":null,"tree":[],"storefront":"/r/bruin-data","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/bruin-data/ingestr/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}