{"repo":"konqi/schematic-kafka","free":true,"listed":false,"github":"https://github.com/konqi/schematic-kafka","clone":"git clone https://github.com/konqi/schematic-kafka.git","description":"Protocol agnostic typescript implementation to encode and decode kafka messages using the Confluent Schema Registry","language":"TypeScript","stars":10,"topics":["kafka","schema","schema-registry","typescript","avro","protobuf","json"],"license":"MIT","category":"data-pipelines","readme_excerpt":"schematic-kafka This package provides a schema type agnostic kafka message encoder/decoder. It works fine with whatever protocol you may want to use, but it doesn't take care of this aspect. Have a look at the code sample below to understand what this means. Quickstart Install Use For more examples, take a look at src/kafka-registry-helper.testcontainersspec.ts . How this library works This is how a kafka message looks like when you send or receive it. The first byte being a zero tells us that the following four bytes contain the schema id. With this schema id we can request the schema type (AVRO, PROTOBUF or JSON) and schema (serialized representation of the schema for the corresponding schema type) from the schema registry. This library can decodes whole kafka message header and then calls the appropriate decoder that you provide with the schema as argument. Documentation The package exports the following things - KafkaRegistryHelper is the wrapper that handles encoding/decoding of messages, it also registeres your payload schemas if the registry doesn't know about them yet - SchemaRegistryClient is the low level api client that communicates with the schema-registry - SchemaType Is an enum containing the available schema types (AVRO, PROTOBUF, JSON) KafkaRegistryHelper applies a cache for some of the schema registry requests of SchemaRegistryClient to go easy on the network traffic and load. Client SSL authentication This library uses node's http/https request. As such you ","default_branch":null,"files":null,"tree":[],"storefront":"/r/konqi","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/konqi/schematic-kafka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}