{"repo":"DataDog/kafka-kit","free":true,"listed":false,"github":"https://github.com/DataDog/kafka-kit","clone":"git clone https://github.com/DataDog/kafka-kit.git","description":"Kafka storage rebalancing, automated replication throttle, cluster API and more","language":"Go","stars":501,"topics":["kafka","kafka-topic-management","golang","rack-aware","kafka-kit","storage","rebalance"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Kafka topic management tools Read the blog post: Introducing Kafka-Kit: Tools for Scaling Kafka This repository contains several services and tools for that help better operate Kafka. See the README for each tool for further details. topicmappr Topicmappr replaces and extends the kafka-reassign-partition tool bundled with Kafka. It allows for minimal movement broker replacements, cluster storage rebalancing / partition bin-packing, leadership optimization, many-at-once topic management, and more—all with rack awareness support. README registry A gRPC+HTTP API service for Kafka that allows granular resource (topics, brokers) lookup and management with custom tagging support. README autothrottle A service that automatically paces Kafka replication/recovery throttle rates, powered with metrics using the Datadog API. README metricsfetcher A utility that fetches metrics via the Datadog API for Kafka storage rebalancing and partition mapping with topicmappr. README Building All tools/services will likely build on recent versions of MacOS and Go: go install ./cmd/... . A Docker based environment is available for repeatable linux builds and local testing. This will setup a Kafka environment with a running Registry instance from which all other Kafka-Kit tools will be available: When finished, make stop-compose will tear down the environment. Development See the Development Guide for testing and contributing changes.","default_branch":null,"files":null,"tree":[],"storefront":"/r/DataDog","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/DataDog/kafka-kit/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}