{"repo":"replicase/pgcapture","free":true,"listed":false,"github":"https://github.com/replicase/pgcapture","clone":"git clone https://github.com/replicase/pgcapture.git","description":"A scalable Netflix DBLog implementation for PostgreSQL","language":"Go","stars":285,"topics":["dblog","postgresql","cdc","netflix-dblog","postgres","database","replication","logical-replicas","pglogical","grpc"],"license":"Apache-2.0","category":"databases-storage","readme_excerpt":"pgcapture A scalable Netflix DBLog implementation for PostgreSQL Features DDL commands are also captured One unified gRPC Streaming API for consuming the latest changes and on-demand dumps The changes and dumps are streamed in Postgres Binary Representation to save bandwidth Improvements to Netflix DBLog Dumps are neither queried from source database nor injected into the source CDC stream. Instead, They are dumped from the logical replicas and are injected into the selected downstreams by the grpc gateway service. Therefore, the on-demand dump process can be scaled by adding more logical replicas and consumers. And most importantly, dumps process will not have impact to source database as well as other downstream consumers who don't need those dumps. Primary keys of tables aren't limited to be a single numeric column, because dumps are performed by PostgreSQL TID Scan instead of performed on the primary key. Use cases Robust Microservice Event Queueing Data synchronization, Moving data to other databases (ex. for OLAP) Upgrade PostgreSQL with minimum downtime Decode Plugin The decode plugin is a shared library that can be loaded into PostgreSQL to decode logical changes. Currently, pgcapture can work with the following plugins: 1. pglogical output The pglogical output plugin is come from pglogical which can support binary representation of the changes. In order to use pglogical output plugin, you must install pglogical extension first. Also, pgcapture would not create pglogi","default_branch":null,"files":null,"tree":[],"storefront":"/r/replicase","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/replicase/pgcapture/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}