{"repo":"ivangfr/springboot-kafka-connect-jdbc-streams","free":true,"listed":false,"github":"https://github.com/ivangfr/springboot-kafka-connect-jdbc-streams","clone":"git clone https://github.com/ivangfr/springboot-kafka-connect-jdbc-streams.git","description":"Project goal: Explore Kafka, Kafka Connect, and Kafka Streams. Components: store-api: Inserts/updates MySQL records. Source Connectors: Monitor MySQL changes, push messages to Kafka. Sink Connectors: Listen to Kafka, insert/update Elasticsearch docs. store-streams: Listens to Kafka, processes with Kafka Streams, pushes new messages to Kafka.","language":"Java","stars":125,"topics":["spring-boot","kafka","kafka-connect","kafka-streams","mysql","elasticsearch","spring-cloud-stream","schema-registry","avro","json"],"license":null,"category":"data-pipelines","readme_excerpt":"springboot-kafka-connect-jdbc-streams The main goal of this project is to explore Kafka , Kafka Connect , and Kafka Streams . The project includes: store-api , which inserts/updates records in MySQL ; Source Connectors that monitor these records in MySQL and push related messages to Kafka ; Sink Connectors that listen to messages from Kafka and insert/update documents in Elasticsearch ; and store-streams , which listens to messages from Kafka , processes them using Kafka Streams , and pushes new messages back to Kafka . Proof-of-Concepts & Articles On ivangfr.github.io, I have compiled my Proof-of-Concepts (PoCs) and articles. You can easily search for the technology you are interested in by using the filter. Who knows, perhaps I have already implemented a PoC or written an article about what you are looking for. Additional Readings - \\[ Medium \\] Streaming MySQL changes to Elasticsearch using Kafka Connect - \\[ Medium \\] Enhancing a MySQL-KafkaConnect-Elasticsearch Setup with Spring Boot Applications Project Diagram Applications - ### store-api Monolithic Spring Boot application that exposes a REST API to manage Customers , Products and Orders . The data is stored in MySQL . - ### store-streams Spring Boot application that connects to Kafka and uses Kafka Streams API to transform some \"input\" topics into a new \"output\" topic in Kafka . Prerequisites - Java 25 or higher; - A containerization tool (e.g., Docker , Podman , etc.) (De)Serialization formats In order to run this pr","default_branch":null,"files":null,"tree":[],"storefront":"/r/ivangfr","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/ivangfr/springboot-kafka-connect-jdbc-streams/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}