{"repo":"vnvo/deltaforge","free":true,"listed":false,"github":"https://github.com/vnvo/deltaforge","clone":"git clone https://github.com/vnvo/deltaforge.git","description":"A versatile, high-performance Change Data Capture (CDC) engine built in Rust. Streams database changes into downstream systems like Kafka, Redis, NATS and etc, giving you full control over routing, transformation, and delivery.","language":"Rust","stars":22,"topics":["cdc","change-data-capture","event-sourcing","kafka","redis","data-engineering","schema-registry","data-platform","etl","mysql"],"license":null,"category":"data-pipelines","readme_excerpt":"A versatile, high-performance Change Data Capture (CDC) engine built in Rust. ⚠️ Status: Active development. APIs, configuration, and semantics may change. DeltaForge streams database changes into downstream systems like Kafka, Redis, NATS, and S3 object storage - giving you full control over routing, transformation, and delivery. Built-in schema discovery automatically infers and tracks the shape of your data as it flows through, including deep inspection of nested JSON structures. DeltaForge is not a DAG based stream processor. It is a focused CDC engine meant to replace tools like Debezium when you need a lighter, cloud-native, and more customizable runtime. Quick Start Get DeltaForge running in under 3 minutes: Minimal Pipeline Config Run it with Docker Deploy on Kubernetes See the Helm chart README for full configuration. That's it! DeltaForge streams changes from mydb.users to Kafka. Want Debezium-compatible output? Output: {\"schema\":null,\"payload\":{...}} 📘 Full docs · Configuration reference The Tech Built with Sources Processors Sinks Encodings Output Formats :---: :---: :---: :---: :---: :---: Rust MySQL · PostgreSQL JavaScript · Outbox · Flatten · Filter Kafka · Redis · NATS · HTTP · S3 · ClickHouse JSON · Avro Native · Debezium · CloudEvents Features - Sources - MySQL binlog CDC with GTID support - PostgreSQL logical replication via pgoutput - Initial snapshot/backfill for existing tables (MySQL and PostgreSQL) - resumes at table granularity after interruption, wi","default_branch":null,"files":null,"tree":[],"storefront":"/r/vnvo","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/vnvo/deltaforge/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}