{"repo":"airflow-laminar/airflow-ha","free":true,"listed":false,"github":"https://github.com/airflow-laminar/airflow-ha","clone":"git clone https://github.com/airflow-laminar/airflow-ha.git","description":"High Availability (HA) DAG Utility","language":"Python","stars":11,"topics":["airflow","apache-airflow","dag","high-availability","python","scheduler"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"airflow-ha High Availability (HA) DAG Utility Overview This library provides an operator called HighAvailabilityOperator , which inherits from PythonSensor and runs a user-provided python callable . The return value can trigger the following actions: Return Result Current DAGrun End State :------------------ :------------------------------------------- :----------------------- (PASS, RETRIGGER) Retrigger the same DAG to run again pass (PASS, STOP) Finish the DAG, until its next scheduled run pass (FAIL, RETRIGGER) Retrigger the same DAG to run again fail (FAIL, STOP) Finish the DAG, until its next scheduled run fail ( , CONTINUE) Continue to run the Sensor N/A [!NOTE] Note: if the sensor times out, the behavior matches (Result.PASS, Action.RETRIGGER) . Limiters Arguments to HighAvailabilityOperator can be used to configure finishing behavior outside of the callable: - runtime : A timedelta or int (seconds). The operator will turn off cleanly after dag.start date + runtime ( (PASS, STOP) ) - endtime : A time or str (isoformat time). The operator will turn off cleanly after today + endtime ( (PASS, STOP) ) - maxretrigger : An integer. The operator will turn off after maxretrigger retriggers ( ( [!NOTE] These can be configured as arguments to HighAvailabilityOperator , and will be automatically included as DAG Params. This also allows them to be overridden by the DAG Config during a manual run. There is also a force-run option when running the DAG manually, which will cause the ","default_branch":null,"files":null,"tree":[],"storefront":"/r/airflow-laminar","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/airflow-laminar/airflow-ha/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}