{"repo":"f-rustrated/EastGuard","free":true,"listed":false,"github":"https://github.com/f-rustrated/EastGuard","clone":"git clone https://github.com/f-rustrated/EastGuard.git","description":"Fullstack Messaging Platform Written In Rust","language":"Rust","stars":19,"topics":["distributed-systems","event-streaming","high-availability","kafka","message-broker","pulsar","raft","rust","swim-protocol"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"EastGuard A zero-controller messaging system built for the scale that breaks Kafka. Kafka's architecture was revolutionary in 2011. But its monolithic controller, static partitions, and coarse-grained replication units create hard ceilings that no amount of tuning can fix. EastGuard removes those ceilings by separating concerns that Kafka entangles: metadata consensus, failure detection, data storage, and replication are independent subsystems that scale independently. Inspired by LinkedIn's Northguard architecture. Why EastGuard The Kafka Problem Kafka routes all metadata through a single controller (or KRaft quorum). Every partition reassignment, every leader election, every ISR change funnels through one bottleneck. At hundreds of thousands of partitions, controller failover takes minutes. Rebalancing requires external tooling. A slow broker degrades the entire ISR, and operators must manually intervene. Architectural Comparison: Kafka vs. Pulsar vs. EastGuard Feature Apache Kafka Apache Pulsar EastGuard :--- :--- :--- :--- Metadata Control Plane Centralized (Single Controller or KRaft Quorum). Centralized (ZooKeeper). Decentralized (DS-RSM): Dynamically-sharded Raft groups. Metadata throughput scales linearly as you add brokers. Partitioning Static partitions. Requires manual reassignment to scale. Static partitions at the broker level (backed by dynamic ledgers). Dynamic Ranges: Ranges split and merge automatically based on traffic load without manual intervention. Repli","default_branch":null,"files":null,"tree":[],"storefront":"/r/f-rustrated","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/f-rustrated/EastGuard/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}