{"repo":"sanjuthomas/kafka-connect-marklogic","free":true,"listed":false,"github":"https://github.com/sanjuthomas/kafka-connect-marklogic","clone":"git clone https://github.com/sanjuthomas/kafka-connect-marklogic.git","description":"Kafka Sink Connect MarkLogic","language":"Java","stars":19,"topics":["apache","kafka","marklogic","java","rest","kafka-connect","kafka-connector","kafka-sink"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Overview Kafka Connect MarkLogic is a sink-only connector that pulls messages from Kafka and stores them in MarkLogic as JSON documents. Consider using the Kafka MarkLogic Sync Connector for the following use cases. 1. Near real-time ingestion requirements. 2. Regulate the traffic towards MarkLogic. 3. Requirement to maintain the order of the messages. 4. A Kafka ecosystem exists. 5. Replay messages using an offset. High-Level Architecture Diagram This project is about the component marked in green. Refer here to see the available list of source connectors. Prerequisites Apache ZooKeeper and Apache Kafka are installed and running on your machine. Please refer to respective sites to download and start ZooKeeper and Kafka. What is MarkLogic? The MarkLogic is a multi-model schemaless NoSQL database to store, manage, and search JSON, XML, and RDF triples. For more details, please refer to MarkLogic's official website. What is Apache Kafka? Apache Kafka is an open-source stream processing platform written in Scala and Java by the Apache Software Foundation. The project aims to provide a unified, high-throughput, low-latency platform for handling real-time data feeds. For more details, please refer to the kafka home page. Implementation details To send data to MarkLogic, this connector uses MarkLogic REST API. By default, the /v1/documents endpoint at port 8000 is used. You may change that in the marklogic-sink.properties file. You may use your own REST/Service extension instead of","default_branch":null,"files":null,"tree":[],"storefront":"/r/sanjuthomas","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/sanjuthomas/kafka-connect-marklogic/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}