{"repo":"disneystreaming/pg2k4j","free":true,"listed":false,"github":"https://github.com/disneystreaming/pg2k4j","clone":"git clone https://github.com/disneystreaming/pg2k4j.git","description":"Postgresql To Kinesis For Java","language":"Java","stars":80,"topics":["kinesis","kinesis-stream","replication","logical-replication","cdc","postgresql","java"],"license":null,"category":"databases-storage","readme_excerpt":"This project is no longer actively maintained by Disney Streaming Services You are welcome to use and fork this project, and we may occasionally review and merge pull requests submitted from contributors or dependabot/Snyk. However we no longer use this internally and therefore support will be limited. pg2k4j Postgresql To Kinesis For Java A tool for publishing inserts, updates, and deletes made on a Postgresql database to an Amazon Kinesis Stream. pg2k4j may be run as a stand-alone application from the command line, or used as a Java library where its functionality can be extended and customized. Getting Started First, setup your Postgres database to support logical replication and create an AWS Kinesis Stream. Run pg2k4j as a Stand-alone Application Download Docker and login with your docker credentials to gain access to the pg2k4j docker repository. Then run the command below. When you observe the below log, pg2k4j is set to publish changes to Kinesis. Use as a Java Library pg2k4j artifacts are published to maven central Maven Gradle SBT To initialize and begin publishing database changes to Kinesis, create a SlotReaderKinesisWriter and call its runLoop method. Why We Wrote pg2k4j pg2k4j is an implementation of a powerful design pattern called Change Data Capture. By using pg2k4j, anyone can know the state of your database at any point in time by consuming from the Kinesis Stream. At DSS we have rapidly changing datasets that many teams need to access and process in their ","default_branch":null,"files":null,"tree":[],"storefront":"/r/disneystreaming","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/disneystreaming/pg2k4j/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}