{"repo":"Trendyol/go-pq-cdc","free":true,"listed":false,"github":"https://github.com/Trendyol/go-pq-cdc","clone":"git clone https://github.com/Trendyol/go-pq-cdc.git","description":"go-pq-cdc is lightweight and efficient Change Data Capture (CDC) system designed for PostgreSQL","language":"Go","stars":200,"topics":["cdc","postgresql","go","golang"],"license":"MIT","category":"databases-storage","readme_excerpt":"go-pq-cdc go-pq-cdc is designed to provide efficient and lightweight Change Data Capture (CDC) for PostgreSQL databases. The architecture leverages PostgreSQL's built-in logical replication capabilities to capture changes in the database and stream these changes to downstream systems, such as Kafka, Elasticsearch etc. The entire system is written in Golang, ensuring low resource consumption and high performance. Debezium vs go-pq-cdc benchmark Snapshot Feature Capture existing data before starting CDC! The new snapshot feature enables initial data synchronization, ensuring downstream systems receive both historical and real-time data. ✨ Key Highlights: - Zero Data Loss : Consistent point-in-time snapshot using PostgreSQL's pg export snapshot() - Chunk-Based Processing : Memory-efficient processing of large tables - Smart Partitioning : Auto-selects optimal strategy (Integer Range, CTID Block, or Offset) - Multi-Instance Support : Parallel processing across multiple instances - Crash Recovery : Automatic resume from failures - No Duplicates : Seamless transition from snapshot to CDC - Snapshot Only Mode : One-time data export without CDC (no replication slot required) - Protocol Flexibility : pgoutput proto version 1 and 2 support - Safe Streaming TX Handling : Streamed rollback transactions are discarded correctly 📚 Read Full Documentation for detailed architecture, configuration, and best practices. 📚 Protocol Version & Streaming Transactions for proto version behavior and","default_branch":null,"files":null,"tree":[],"storefront":"/r/Trendyol","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Trendyol/go-pq-cdc/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}