{"repo":"floydspace/effect-kafka","free":true,"listed":false,"github":"https://github.com/floydspace/effect-kafka","clone":"git clone https://github.com/floydspace/effect-kafka.git","description":"📨 Effectful Kafka","language":"TypeScript","stars":34,"topics":["confluent-kafka","ecosystem","effect","effect-ts","kafka","kafka-client","kafka-consumer","kafka-producer","kafkajs","typescript"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Effect Kafka effect-kafka is a Kafka client for Effect. It provides a purely functional interface to the Kafka client and integrates effortlessly with Effect ecosystem. Effect Website: https://www.effect.website Effect API Reference: https://effect-ts.github.io/effect Effect Kafka Website: https://effect-kafka.website Effect Kafka API Reference: https://floydspace.github.io/effect-kafka Installation Choose your preferred package manager and run one of the following commands in your terminal: - Using npm: - Using pnpm: - Using yarn: Next install one of kafka engine packages: - KafkaJS - Fully JavaScript implementation. - @confluentinc/kafka-javascript - JavaScript interface for C++ librdkafka implementation, which is more performant, but requires native bindings. - @platformatic/kafka - New pure JavaScript Kafka client implementation with ambition to replace KafkaJS Note: You can use any of the above Kafka engine packages, depending on your preference. Usage Let's write a simple Kafka producer and consumer using effect-kafka . Before everything, we need a running instance of Kafka. We can do that by saving the following docker-compose script in the docker-compose.yml file and run docker-compose up : Now, we can run our effect-kafka application: See more examples in the examples directory. Roadmap - [x] Consumer - [x] Producer - [x] Consumer Streams - [ ] Producer Streams - [x] Acknowledge management - [ ] Transactions Contributing Guidelines Thank you for considering contribut","default_branch":null,"files":null,"tree":[],"storefront":"/r/floydspace","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/floydspace/effect-kafka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}