{"repo":"Mahir101/Rafka","free":true,"listed":false,"github":"https://github.com/Mahir101/Rafka","clone":"git clone https://github.com/Mahir101/Rafka.git","description":"Rafka is a blazing-fast, experimental distributed asynchronous message broker inspired by Apache Kafka. Built with Rust and leveraging Tokio's async runtime, it delivers exceptional performance through its peer-to-peer mesh architecture and custom in-memory database for unparalleled scalability and low-latency message processing.","language":"Rust","stars":34,"topics":["distributed-systems","kafka","memory-safe","message-broker","optimized","rafka","rust","rust-lang","networking","p2p"],"license":"Apache-2.0","category":"networking-infra","readme_excerpt":"Rafka A High-Performance Distributed Message Broker Built in Rust Rafka is a blazing-fast, experimental distributed asynchronous message broker inspired by Apache Kafka. Built with Rust and leveraging Tokio's async runtime, it delivers exceptional performance through its peer-to-peer mesh architecture and custom in-memory database for unparalleled scalability and low-latency message processing. 🚀 Key Features - High-Performance Async Architecture : Built on Tokio for maximum concurrency and throughput - gRPC Communication : Modern protocol buffers for efficient inter-service communication - Partitioned Message Processing : Hash-based partitioning for horizontal scalability - Disk-based Persistence : Write-Ahead Log (WAL) for message durability - Consumer Groups : Load-balanced message consumption with partition assignment - Replication : Multi-replica partitions with ISR tracking for high availability - Log Compaction : Multiple strategies (KeepLatest, TimeWindow, Hybrid) for storage optimization - Transactions : Two-Phase Commit (2PC) with idempotent producer support - Comprehensive Monitoring : Health checks, heartbeat tracking, and circuit breakers - Real-time Metrics : Prometheus-compatible metrics export with latency histograms - Stream Processing : Kafka Streams-like API for message transformation and aggregation - Offset Tracking : Consumer offset management for reliable message delivery - Retention Policies : Configurable message retention based on age and size - Mod","default_branch":null,"files":null,"tree":[],"storefront":"/r/Mahir101","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Mahir101/Rafka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}