{"repo":"lovoo/goka","free":true,"listed":false,"github":"https://github.com/lovoo/goka","clone":"git clone https://github.com/lovoo/goka.git","description":"Goka is a compact yet powerful distributed stream processing library for Apache Kafka written in Go.","language":"Go","stars":2537,"topics":["goka","stream","processing","kafka","golang","microservices"],"license":"BSD-3-Clause","category":"data-pipelines","readme_excerpt":"Goka Goka is a compact yet powerful distributed stream processing library for [Apache Kafka] written in Go. Goka aims to reduce the complexity of building highly scalable and highly available microservices. Goka extends the concept of Kafka consumer groups by binding a state table to them and persisting them in Kafka. Goka provides sane defaults and a pluggable architecture. Features Message Input and Output Goka handles all the message input and output for you. You only have to provide one or more callback functions that handle messages from any of the Kafka topics you are interested in. You only ever have to deal with deserialized messages. Scaling Goka automatically distributes the processing and state across multiple instances of a service. This enables effortless scaling when the load increases. Fault Tolerance In case of a failure, Goka will redistribute the failed instance's workload and state across the remaining healthy instances. All state is safely stored in Kafka and messages delivered with at-least-once semantics. Built-in Monitoring and Introspection Goka provides a web interface for monitoring performance and querying values in the state. Modularity Goka fosters a pluggable architecture which enables you to replace for example the storage layer or the Kafka communication layer. Documentation This README provides a brief, high level overview of the ideas behind Goka. Package API documentation is available at [GoDoc] and the Wiki provides several tips for configu","default_branch":null,"files":null,"tree":[],"storefront":"/r/lovoo","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/lovoo/goka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}