{"repo":"oliveigah/klife","free":true,"listed":false,"github":"https://github.com/oliveigah/klife","clone":"git clone https://github.com/oliveigah/klife.git","description":"Kafka client for elixir","language":"Elixir","stars":71,"topics":["elixir","kafka"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Klife Klife is a modern, ergonomic and high-performance Kafka client built from the ground up with minimal dependencies. - Modern : Built for today's Kafka. It supports Kafka = 4.0 and implements the next generation of the consumer rebalance protocol (KIP-848), providing a simpler and more efficient consumer group experience. - Ergonomic : Designed to feel natural in Elixir projects (e.g. Ecto-like transactions, Klife.Record struct, testing utilities, consumer callbacks, etc.) and also provides capabilities to better handle Kafka workflows like automatic retry counting and batch size limits. - High Performance : Batching architecture that delivers exceptional throughput. Most requests destined for the same broker are batched into a single TCP request, maximizing network efficiency. In benchmarks against other community Kafka clients, this approach has shown massive throughput improvements while minimizing the Kafka cluster resource usage. Key Features - Consumer Group : The new KIP-848 rebalance protocol introduced in Kafka 4.0. - Custom Consumer Configuration : Per-topic consumer settings within the same group. - Static Membership : Stable consumer identity via instance id . - Backpressure : Fetch rate naturally regulated by processing speed, with multiple configurable controls. - Graceful Shutdown : In-flight records are processed and offsets committed before leaving the group. - Direct Fetch : Fetch a specific topic/partition/offset combinations without consumer coordinati","default_branch":null,"files":null,"tree":[],"storefront":"/r/oliveigah","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/oliveigah/klife/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}