Slideshare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our User Agreement and Privacy Policy.

Slideshare uses cookies to improve functionality and performance, and to provide you with relevant advertising. If you continue browsing the site, you agree to the use of cookies on this website. See our Privacy Policy and User Agreement for details.

23.
DAG characteristics
• (almost) All work happens off Airflow machine
• Fairly homogenous operator usage (GCP)
• Idempotent (re-run a DAG at any time)
• ETL DAGs are very small, but there are many of them