{"repo":"pipeline-tools/gusty","free":true,"listed":false,"github":"https://github.com/pipeline-tools/gusty","clone":"git clone https://github.com/pipeline-tools/gusty.git","description":"Making DAG construction easier","language":"Python","stars":286,"topics":["airflow","data-pipeline","data-etl"],"license":"MIT","category":"data-pipelines","readme_excerpt":"--- gusty allows you to control your Airflow DAGs, Task Groups, and Tasks with greater ease. gusty manages collections of tasks, represented as any number of YAML, Python, SQL, Jupyter Notebook, or R Markdown files. A directory of task files is instantly rendered into a DAG by passing a file path to gusty's create dag function. gusty also manages dependencies (within one DAG) and external dependencies (dependencies on tasks in other DAGs) for each task file you define. All you have to do is provide a list of dependencies or external dependencies inside of a task file, and gusty will automatically set each task's dependencies and create external task sensors for any external dependencies listed. gusty works with all major Airflow versions and has even more features, all of which aim to make the creation, management, and iteration of DAGs more fluid, so that you can intuitively design your DAG and build your tasks. Documentation The official documentation for gusty is hosted here: https://pipeline-tools.github.io/gusty-docs/ What's in gusty? Five Ways to Make Tasks gusty will turn every file in a DAG directory into a task. By default gusty supports five different file types, which offer convenient ways to specify an operator and operator parameters for task creation. File Type How It Works --------- ----------------------------------------------------------------------------------------------------------------------------- .yml Declare an operator and pass in any operator param","default_branch":null,"files":null,"tree":[],"storefront":"/r/pipeline-tools","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/pipeline-tools/gusty/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}