{"repo":"salesforce/mirus","free":true,"listed":false,"github":"https://github.com/salesforce/mirus","clone":"git clone https://github.com/salesforce/mirus.git","description":"Mirus is a cross data-center data replication tool for Apache Kafka","language":"Java","stars":210,"topics":["kafka","kafka-connect","mirroring"],"license":"BSD-3-Clause","category":"data-pipelines","readme_excerpt":"Mirus A tool for distributed, high-volume replication between Apache Kafka clusters based on Kafka Connect. Designed for easy operation in a high-throughput, multi-cluster environment. Features - Dynamic Configuration: Uses the Kafka Connect REST API for dynamic API-driven configuration - Precise Replication: Supports a regex whitelist and an explicit topic whitelist - Simple Management for Multiple Kafka Clusters: Supports multiple source clusters with one Worker process - Continuous Ingestion: Continues consuming from the source cluster while flushing and committing offsets - Built for Dynamic Kafka Clusters: Able to handle topics and partitions being created and deleted in source and destination clusters - Scalable: Creates a configurable set of worker tasks that are distributed across a Kafka Connect cluster for high performance, even when pushing data over the internet - Fault tolerant: Includes a monitor thread that looks for task failures and optionally auto-restarts - Monitoring: Includes custom JMX metrics for production ready monitoring and alerting Overview Mirus is built around Apache Kafka Connect, providing SourceConnector and SourceTask implementations optimized for reading data from Kafka source clusters. The MirusSourceConnector runs a KafkaMonitor thread, which monitors the source and destination Apache Kafka cluster partition allocations, looking for changes and applying a configurable topic whitelist. Each task is responsible for a subset of the matching p","default_branch":null,"files":null,"tree":[],"storefront":"/r/salesforce","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/salesforce/mirus/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}