{"repo":"astronomer/airflow-provider-fivetran-async","free":true,"listed":false,"github":"https://github.com/astronomer/airflow-provider-fivetran-async","clone":"git clone https://github.com/astronomer/airflow-provider-fivetran-async.git","description":"A new Airflow Provider for Fivetran, maintained by Astronomer and Fivetran","language":"Python","stars":26,"topics":["airflow","airflow-operator","airflow-provider","apache-airflow","dag","data-orchestration","etl","python","workflow"],"license":"Apache-2.0","category":"data-pipelines","readme_excerpt":"Fivetran Async Provider for Apache Airflow This package provides an async operator, sensor and hook that integrates Fivetran into Apache Airflow. FivetranSensor allows you to monitor a Fivetran sync job for completion before running downstream processes. FivetranOperator submits a Fivetran sync job and polls for its status on the triggerer. Since an async sensor or operator frees up worker slot while polling is happening on the triggerer, they consume less resources when compared to traditional \"sync\" sensors and operators. Fivetran automates your data pipeline, and Airflow automates your data processing. Installation Prerequisites: An environment running apache-airflow . Configuration In the Airflow user interface, configure a Connection for Fivetran. Most of the Connection config fields will be left blank. Configure the following fields: Conn Id : fivetran Conn Type : Fivetran Login : Fivetran API Key Password : Fivetran API Secret Find the Fivetran API Key and Secret in the Fivetran Account Settings, under the API Config section. See our documentation for more information on Fivetran API Authentication. The sensor assumes the Conn Id is set to fivetran , however if you are managing multiple Fivetran accounts, you can set this to anything you like. See the DAG in examples to see how to specify a custom Conn Id . Modules Fivetran Operator Async FivetranOperator submits a Fivetran sync job and monitors it on trigger for completion. FivetranOperator requires that you specify t","default_branch":null,"files":null,"tree":[],"storefront":"/r/astronomer","claimed":false,"request_supported":{"post":"https://gitbuyer.com/r/astronomer/airflow-provider-fivetran-async/request-supported","requests":0},"note":"indexed from public GitHub; nothing is for sale on this page. Clone it from GitHub. Paid listings live at /search."}