{"repo":"openzipkin-contrib/zipkin-storage-kafka","free":true,"listed":false,"github":"https://github.com/openzipkin-contrib/zipkin-storage-kafka","clone":"git clone https://github.com/openzipkin-contrib/zipkin-storage-kafka.git","description":"Kafka-based storage for Zipkin.","language":"Java","stars":38,"topics":["zipkin","kafka","kafka-streams","zipkin-storage","zipkin-server"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Zipkin Storage: Kafka [EXPERIMENTAL] Kafka-based storage for Zipkin. Spans collected via different transports are partitioned by traceId and stored in a partitioned spans Kafka topic. Partitioned spans are then aggregated into traces and then into dependency links, both results are emitted into Kafka topics as well. These 3 topics are used as source for local stores (Kafka Stream stores) that support Zipkin query and search APIs. Design Configuration Use-cases Replacement for batch-oriented Zipkin dependencies A limitation of zipkin-dependencies module, is that it requires to be scheduled with a defined frequency. This batch-oriented execution causes out-of-date values until processing runs again. Kafka-based storage enables aggregating dependencies as spans are received, allowing a (near-)real-time calculation of dependency metrics. To enable this, other components could be disabled. There is a profile prepared to enable aggregation and search of dependency graphs. This profile can be enable by adding Java option: -Dspring.profiles.active=kafka-only-dependencies Docker image includes a environment variable to set the profile: To try out, there is a Docker compose configuration ready to test. If an existing Kafka collector is in place downstreaming traces into an existing storage, another Kafka consumer group id can be used for zipkin-storage-kafka to consume traces in parallel. Otherwise, you can forward spans from another Zipkin server to zipkin-storage-kafka if Kafka trans","default_branch":null,"files":null,"tree":[],"storefront":"/r/openzipkin-contrib","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/openzipkin-contrib/zipkin-storage-kafka/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}