{"repo":"IBM/ada","free":true,"listed":false,"github":"https://github.com/IBM/ada","clone":"git clone https://github.com/IBM/ada.git","description":"ADA is a microservice created to retrieve analytics metrics from an Airflow database instance.","language":"Python","stars":55,"topics":["airflow","airflow-plugin","apache","apache-airflow","api","python","scheduler","workflow","serverless"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Airflow DAG Analytics ADA is a microservice created to retrieve key analytics metrics for task and DAG level from your Airflow database instance. Highly integrated with Airflow, ADA makes you able to retrieve data from your database and get analytical insights from it. By plugging ADA in your instance, you will get metrics that can help you to make decisions based on your DAGs historical behavior. ADA was born to provide a solution for those who want historical data about their DAGs. It can be fully decoupled from your code, which is great when you use an autoscaling tool to host it. Contents - Usage - Metrics - Deployment - Use cases - Stuck pods - DAG Predict - API reference - Engine compatibility - Contributing - License Usage Metrics Using current ADA's SQL queries you can get the following information: Metric Insight ------------ ------------ score Is it taking longer than expected? average What is its average duration? count runs How many times did it run? maximum What is its longest duration? minimum What is its shortest duration? median What is the median duration? standard deviation How often is my duration far from the average? variance How far is my duration from the average? One of the most powerful metric ADA retrieves is the score . It's calculated by:     The score is the main metric you must analyze and rely on when identifying a stuck pod. You can use it as your threshold to decide to take - or not - an action about that run. The factor 1.2 was arbi","default_branch":null,"files":null,"tree":[],"storefront":"/r/IBM","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/IBM/ada/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}