{"repo":"BT-OpenSource/crafka","free":true,"listed":false,"github":"https://github.com/BT-OpenSource/crafka","clone":"git clone https://github.com/BT-OpenSource/crafka.git","description":"Kafka library for Crystal. Uses librdkafka.","language":"Crystal","stars":20,"topics":["crystal","crystal-lang","kafka","librdkafka"],"license":"MIT","category":"data-pipelines","readme_excerpt":"crafka Detailed documentation: https://crystaldoc.info/github/BT-OpenSource/crafka/main/index.html Installation Add this to your application's shard.yml : Usage Producing All available args to #produce : topic , payload , key , timestamp . Auto Polling librdkafka recommends that rd kafka poll is called at regular intervals to serve queued callbacks. This functionality is built in to Crafka. By default after each #produce , a Kafka::Producer will call poll if it hasn't polled in the last 5 seconds. You can configure this with the poll interval argument: To disable auto polling, set poll interval to 0. Debug Statistics To enable capturing of the statistics described here you can pass a stats path argument to Kafka::Producer.new containing the location of a file to be written to. Also ensure that you set the statistics.interval.ms in your producer config. --- Consuming Subscribing to multiple topics Development Running Tests Releasing 1. Update shard.yml and src/crafka.cr with new version number 2. Update CHANGELOG.md with changes 3. Commit and tag commit Credits Originally forked from: https://github.com/CloudKarafka/kafka.cr","default_branch":null,"files":null,"tree":[],"storefront":"/r/BT-OpenSource","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/BT-OpenSource/crafka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}