{"repo":"christian-edelsbrunner/kafka-connect-transform-tojsonstring","free":true,"listed":false,"github":"https://github.com/christian-edelsbrunner/kafka-connect-transform-tojsonstring","clone":"git clone https://github.com/christian-edelsbrunner/kafka-connect-transform-tojsonstring.git","description":"transform-to-json-string is a Single Message Transformation (SMT) for Apache Kafka® Connect to convert a given Connect Record to a single JSON String. It's an UNOFFICIAL community project.","language":"Java","stars":35,"topics":["kafka","kafka-connect","apache-kafka","smt","transformations"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"kafka-connect-transform-tojsonstring - A simple Record to JSON String SMT This is a very simple Kafka Connect SMT which takes the entire key or value record and transforms it to a new record which contains exactly one field with a JSON representation of the origin record. Blog Post describing how we ended up developing this SMT can be found here Use Cases The reason why this SMT was built is the known limitation of the JDBC Sink Connector tohandle nested arrays. If you have schema which contains arrays you cannot really use the JDBC Sink Connector because this connector only supports primitive Data Types. But sometimes you just need also some arrays from the schema in the RDBMS. If your RDBMS is able to handle JSON Strings this SMT might be the saviour. You can use it to transform the whole record into a single JSON String which can be mapped by the JDBC Sink connector. Afterwards you can use the tools offered by the RDBMS to parse and process the JSON String. But for sure there are also other use cases out there where this SMT might be helpful. Restrictions This SMT was built to transform Records with a Schema to a new Record with a Schema but with only one field. So this SMT does not work for Schemaless records. It also was only tested with Avro Schemas backed by Confluent Schema Registry (but most likely will work for other schema variants too because the deserializer already converted the record to a Connect Record before so it shouldn't be schema specific) Configuration ","default_branch":null,"files":null,"tree":[],"storefront":"/r/christian-edelsbrunner","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/christian-edelsbrunner/kafka-connect-transform-tojsonstring/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}