{"repo":"scylladb/scylla-cdc-source-connector","free":true,"listed":false,"github":"https://github.com/scylladb/scylla-cdc-source-connector","clone":"git clone https://github.com/scylladb/scylla-cdc-source-connector.git","description":"A Kafka source connector capturing Scylla CDC changes","language":"Java","stars":58,"topics":["kafka","kafka-connect","apache-kafka","kafka-producer","cdc","change-data-capture","debezium","event-streaming","scylla","nosql"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Scylla CDC Source Connector Overview Scylla CDC Source Connector is a source connector capturing row-level changes in the tables of a Scylla cluster. It is a Debezium connector, compatible with Kafka Connect (with Kafka 2.6.0+) and built on top of scylla-cdc-java library. The connector reads the CDC log for specified tables and produces Kafka messages for each row-level INSERT , UPDATE or DELETE operation. The connector is able to split reading the CDC log accross multiple processes: the connector can start a separate Kafka Connect task for reading each Vnode of Scylla cluster allowing for high throughput. You can limit the number of started tasks by using tasks.max property. Scylla CDC Source Connector seamlessly handles schema changes and topology changes (adding, removing nodes from Scylla cluster). The connector is fault-tolerant, retrying reading data from Scylla in case of failure. It periodically saves the current position in Scylla CDC log using Kafka Connect offset tracking (configurable by offset.flush.interval.ms parameter). If the connector is stopped, it is able to resume reading from previously saved offset. Scylla CDC Source Connector has at-least-once semantics. The connector has the following capabilities: - Kafka Connect connector using Debezium framework - Replication of row-level changes from Scylla using Scylla CDC: - INSERT - UPDATE - DELETE (single row deletes) - High scalability - able to split work accross multiple Kafka Connect workers - Fault tolera","default_branch":null,"files":null,"tree":[],"storefront":"/r/scylladb","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/scylladb/scylla-cdc-source-connector/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}