{"repo":"epoch8/airflow-exporter","free":true,"listed":false,"github":"https://github.com/epoch8/airflow-exporter","clone":"git clone https://github.com/epoch8/airflow-exporter.git","description":"Airflow plugin to export dag and task based metrics to Prometheus.","language":"Python","stars":279,"topics":["airflow","airflow-exporter","prometheus"],"license":"MIT","category":"data-pipelines","readme_excerpt":"Airflow prometheus exporter Exposes dag and task based metrics from Airflow to a Prometheus compatible endpoint. Compatibility with Airflow versions 3. Versions =2.0.0 will support only Airflow 3.0+ 2. Versions =1.7.0,<2 are compatible with Airflow 2. Development of Airflow 2 compatible version happens from airflow-2 branch Install That's it. You're done. Exporting extra labels to Prometheus It is possible to add extra labels to DAG-related metrics by providing labels dict to DAG params . Example Label env with value test will be added to all metrics related to dummy dag : Metrics Metrics will be available at airflow task status Labels: dag id task id owner status Value: number of tasks in a specific status. airflow dag status Labels: dag id owner status paused Value: number of dags in a specific status. airflow dag run duration Labels: dag id : unique identifier for a given DAG Value: duration in seconds of the longest DAG Run for given DAG. This metric is not available for DAGs that have already finished. airflow dag last status Labels: dag id owner status paused Value: 0 or 1 depending on wherever the current state of each dag id is status . The \"last\" DAG run is the one with the most recent updated at (not logical date , which is NULL for manually triggered runs). License Distributed under the MIT license. See LICENSE for more information.","default_branch":null,"files":null,"tree":[],"storefront":"/r/epoch8","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/epoch8/airflow-exporter/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}