{"repo":"neptune-networks/flow-exporter","free":true,"listed":false,"github":"https://github.com/neptune-networks/flow-exporter","clone":"git clone https://github.com/neptune-networks/flow-exporter.git","description":"Export network flows from Kafka to Prometheus","language":"Go","stars":146,"topics":["prometheus-exporter","kafka","netflow","sflow","ipfix","pmacct"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Flow Exporter Flow exporter is a tool that can take flow data (Netflow, sFlow, IPFIX) from Kafka and export it to Prometheus. These flow records can be helpful to visualize which autonomous systems traffic is coming from and going to. Grafana is a great tool to visualize Prometheus data, and can be used to take the flow data and visualized as so: An in depth guide on setting this up on a Linux-based router can be found here. Usage The exporter can be started with: - --addr : Listening address (default = :9590) - --brokers : A comma separated list of Kafka brokers (with their corresponding ports) to consume flows from - --topic : The Kafka topic to consume flows from - --asn : The autonomous system number that the flows are being monitored from Once running, you can view the data by visiting http://localhost:9590/metrics. An example of the Prometheus metrics you can find are: Flow Exporter automatically finds the name of the ASN and adds it to the metric. Kafka Schema Flow exporter requires a Kafka topic that has events which contain the following JSON attributes: - label : The hostname of the device that the flow came from - as src : The ASN that originated the flow - as dst : The ASN that the flow was destined for - bytes : The number of bytes contained in the flow pmacct Integration Flow Exporter works well with pmacct, a series of tools for monitoring flows in Linux. The following pmacctd configuration can be used to collect flows on Linux, enrich them with BGP ASN data, a","default_branch":null,"files":null,"tree":[],"storefront":"/r/neptune-networks","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/neptune-networks/flow-exporter/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}