{"repo":"Spinoco/fs2-kafka","free":true,"listed":false,"github":"https://github.com/Spinoco/fs2-kafka","clone":"git clone https://github.com/Spinoco/fs2-kafka.git","description":"Kafka client for functional streams for scala (fs2)","language":"Scala","stars":80,"topics":["scala","kafka-driver","fs2-kafka","asynchronous","scodec","kafka","kafka-client","streaming","stream-processing"],"license":"MIT","category":"data-pipelines","readme_excerpt":"fs2-kafka Kafka client implemented with fs2 library Overview fs2-kafka is a simple client for consuming and publishing messages from / to Apache Kafka. It has minimalistic functionality and is fully implemented without any dependency on kafka native driver. It is fully asynchronous and non-blocking. Thanks to fs2, it comes with full backpressure and streaming support out of the box, and plays well with other fs2 libraries such as fs2-http. fs2-kafka was built with minimal dependencies (apart from fs2, only scodec and shapeless is used). fs2-kafka only supports a subset of features compared to the native kafka client. There is for example no support for creating/administering topics and partitions, or for Kafka Connect / Kafka Streams. The reason for that is that we wanted the client to be as simple as possible, thus leaving all non-essential functionality to other solutions. Please note there is also no support for SASL Kafka protocol now. Features - Subscribe to topic / partition, with configurable pre-fetch behaviour. - Publish to topic / partition - Query metadata from kafka cluster - Query offset range for topic / partition For the compression of messages fs2-kafka supports GZIP and Snappy compression. fs2-kafka supports versions between 0.8.2 and 0.10.2 of kafka cluster with respective protocols. The protocols are cross-tested against the different versions of Kafka (i.e. 0.10.2 is tested to wrok ok with 0.8.2, 0.9.1, 0.10, 0.10.1 and 0.10.2 protocols). SBT Add this to y","default_branch":null,"files":null,"tree":[],"storefront":"/r/Spinoco","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Spinoco/fs2-kafka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}