{"repo":"KafScale/platform","free":true,"listed":false,"github":"https://github.com/KafScale/platform","clone":"git clone https://github.com/KafScale/platform.git","description":"KafScale delivers Kafka-compatible data streaming on S3. Scale infinitely, stateless brokers and processors.","language":"Go","stars":58,"topics":["golang","kafka","connect","kafscale","stream-processing","data-pipelines","etl-framework","iceberg","postgresql"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"KafScale KafScale is a Kafka-protocol compatible streaming platform built around a simple premise: durable logs belong in object storage, not in stateful brokers . Traditional Kafka couples durability, replication, and compute into long-lived broker processes. This made sense in a disk-centric world. It becomes an operational and economic liability once object storage is available. KafScale separates concerns cleanly. Brokers are stateless and ephemeral. Durability lives in S3. The Kafka protocol remains intact. KafScale is open source under the Apache 2.0 license and implemented in Go. (KafScale is not a registered trademark.) --- Why KafScale Exists Most Kafka deployments are not event-driven transaction engines. They are durable pipes: producers write, consumers read, teams rely on replay when something breaks. Despite this, traditional Kafka clusters still require: - Stateful brokers with local disks - Replica rebalancing and leader movement - Overprovisioning for peak load - Continuous operational intervention These costs are structural, not accidental. Object storage changes the failure model, the scaling model, and the economics of durable logs. Once durability is externalized, broker state stops being an asset and becomes a liability. KafScale targets this common case by: - Keeping brokers stateless - Writing immutable segments directly to S3 - Preserving compatibility with existing Kafka clients and tooling KafScale is used in production environments, but there are n","default_branch":null,"files":null,"tree":[],"storefront":"/r/KafScale","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/KafScale/platform/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}