{"repo":"PeerDB-io/peerdb","free":true,"listed":false,"github":"https://github.com/PeerDB-io/peerdb","clone":"git clone https://github.com/PeerDB-io/peerdb.git","description":"Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage","language":"Go","stars":3239,"topics":["etl","sql","bigquery","cloud-native","distributed-systems","kafka","postgres","postgresql","realtime","rust"],"license":"AGPL-3.0","category":"databases-storage","readme_excerpt":"Frustratingly simple ETL for Postgres PeerDB At PeerDB, we are building a fast, simple and the most cost effective way to stream data from Postgres to Data Warehouses, Queues and Storage engines. If you are running Postgres at the heart of your data-stack and move data at scale from Postgres to any of the above targets, PeerDB can provide value. We support different modes of streaming - log based (CDC), cursor based (timestamp or integer) and XMIN based. Performance wise, we are 10x faster than existing tools. Features wise, we support native Postgres features such as comprehensive set of data-types incl. jsonb/arrays/geospatial, efficiently streaming TOAST columns, schema changes and so on. Mirror type deprecation notice: CDC is the recommended and actively-maintained mirror type. The Query Replication (QRep) and XMIN mirror types are deprecated and no longer actively maintained; they remain fully functional, and no code is currently being removed. Connector deprecation notice: The Snowflake, BigQuery, ElasticSearch, Kafka (including Confluent and Redpanda variants), Azure Event Hubs, Google Pub/Sub, and S3 destination connectors are deprecated and no longer actively maintained. They remain fully functional in the current and all prior releases, and no code is currently being removed. The actively-maintained paths going forward are Postgres → ClickHouse, Postgres → ClickHouse Cloud, and Postgres → Postgres. This deprecation applies to the destination role only — BigQuery rem","default_branch":null,"files":null,"tree":[],"storefront":"/r/PeerDB-io","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/PeerDB-io/peerdb/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}