{"repo":"ivangfr/springboot-kafka-connect-debezium-ksqldb","free":true,"listed":false,"github":"https://github.com/ivangfr/springboot-kafka-connect-debezium-ksqldb","clone":"git clone https://github.com/ivangfr/springboot-kafka-connect-debezium-ksqldb.git","description":"Experiment with Kafka, Debezium, and ksqlDB. research-service: Performs MySQL record manipulation. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors and kafka-research-consumer: Listen to Kafka, insert/update Elasticsearch. ksqlDB-Server: Listens to Kafka, performs joins, and pushes new messages to new Kafka topics.","language":"Java","stars":84,"topics":["spring-boot","kafka","debezium","kafka-connect","schema-registry","mysql","elasticsearch","avro","confluent","ksqldb"],"license":null,"category":"data-pipelines","readme_excerpt":"springboot-kafka-connect-debezium-ksqldb The goal of this project is to explore Kafka , Debezium , and ksqlDB . The project includes: research-service , which performs CRUD operations on records in MySQL ; Source Connectors that monitor changes in MySQL and push related messages to Kafka; Sink Connectors and kafka-research-consumer that listen to Kafka messages and update documents in Elasticsearch ; and ksqlDB-Server , which listens to Kafka topics, performs joins, and pushes new messages to Kafka. Proof-of-Concepts & Articles On ivangfr.github.io, I have compiled my Proof-of-Concepts (PoCs) and articles. You can easily search for the technology you are interested in by using the filter. Who knows, perhaps I have already implemented a PoC or written an article about what you are looking for. Additional Readings - \\[ Medium \\] Streaming MySQL changes to Elasticsearch using Kafka Connect - \\[ Medium \\] Enhancing a MySQL-KafkaConnect-Elasticsearch Setup with Spring Boot Applications Project Diagram Applications - ### research-service Monolithic Spring Boot application that exposes a REST API to manage Institutes , Articles , Researchers and Reviews . The data is saved in MySQL . - ### kafka-research-consumer Spring Boot application that listens messages from the topic reviews researchers institutes articles (that is one of ksqlDB outputs) and save the payload of those messages (i.e, reviews with detailed information) in Elasticsearch . Prerequisites - Java 25 or higher; - A con","default_branch":null,"files":null,"tree":[],"storefront":"/r/ivangfr","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ivangfr/springboot-kafka-connect-debezium-ksqldb/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}