{"repo":"saabeilin/kafkian","free":true,"listed":false,"github":"https://github.com/saabeilin/kafkian","clone":"git clone https://github.com/saabeilin/kafkian.git","description":"An opinionated Kafka producer/consumer built on top of confluent-kafka-python/librdkafka","language":"Python","stars":28,"topics":["kafka","kafka-producer","kafka-consumer"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"kafkian [//]: # ([![codecov](https://codecov.io/gh/saabeilin/kafkian/branch/master/graph/badge.svg)](https://codecov.io/gh/saabeilin/kafkian)) kafkian is a opinionated a high-level consumer and producer on top of confluent-kafka-python/librdkafka and partially inspired by confluent kafka helpers. It is intended for use primarily in CQRS/EventSourced systems when usage is mostly limited to producing and consuming encoded messages. kafkian partially mimics Kafka JAVA API, partially is more pythonic, partially just like the maintainer likes it. Instead of configuring all the things via properties, most of the things are planned to be configured explicitely and, wneh possible, via dependency injection for easier testing. The configuration dictionaries for both producer and consumer are passed-through directly to underlying confluent producer and consumer, hidden behind a facade. The library provides a base serializer and deserializer classes, as well as their specialized Avro subclasses, AvroSerializer and AvroDeserializer . This allows having, say, a plain string key and and avro-encoded message, or vice versa. Quite often an avro-encoded string is used as a key, for this purpose we provide AvroStringKeySerializer . Unlike the Confluent library, we support supplying the specific Avro schema together with the message, just like the Kafka JAVA API. Schemas could be automatically registered with schema registry, also we provide three SubjectNameStrategy , again comp","default_branch":null,"files":null,"tree":[],"storefront":"/r/saabeilin","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/saabeilin/kafkian/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}