{"repo":"Telefonica/prometheus-kafka-adapter","free":true,"listed":false,"github":"https://github.com/Telefonica/prometheus-kafka-adapter","clone":"git clone https://github.com/Telefonica/prometheus-kafka-adapter.git","description":"Use Kafka as a remote storage database for Prometheus (remote write only)","language":"Go","stars":401,"topics":["prometheus","kafka","prometheus-adapter","kafka-producer","cdco"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"prometheus-kafka-adapter Prometheus-kafka-adapter is a service which receives Prometheus metrics through remote write , marshal into JSON and sends them into Kafka. output It is able to write JSON or Avro-JSON messages in a kafka topic, depending on the SERIALIZATION FORMAT configuration variable. JSON timestamp and value are reserved values, and can't be used as label names. name is a special label that defines the name of the metric and is copied as name to the top level for convenience. Avro JSON The Avro-JSON serialization is the same. See the Avro schema. configuration prometheus-kafka-adapter There is a docker image telefonica/prometheus-kafka-adapter:1.9.1 available on Docker Hub. Prometheus-kafka-adapter listens for metrics coming from Prometheus and sends them to Kafka. This behaviour can be configured with the following environment variables: - KAFKA BROKER LIST : defines kafka endpoint and port, defaults to kafka:9092 . - KAFKA TOPIC : defines kafka topic to be used, defaults to metrics . Could use go template, labels are passed (as a map) to the template: e.g: metrics.{{ index . \" name \" }} to use per-metric topic. Two template functions are available: replace ( {{ index . \" name \" replace \"message\" \"msg\" }} ) and substring ( {{ index . \" name \" substring 0 5 }} ) - KAFKA COMPRESSION : defines the compression type to be used, defaults to none . - KAFKA BATCH NUM MESSAGES : defines the number of messages to batch write, defaults to 10000 . - SERIALIZATION FORMAT : ","default_branch":null,"files":null,"tree":[],"storefront":"/r/Telefonica","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/Telefonica/prometheus-kafka-adapter/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}