Apache Airflow on AWS (MWAA)

Zenler Player

Your course is loading. Hang tight.

Do this first!

1 Airflow Introduction- Comment below Preview
1.5 How much are you committed?
2 Set up Airflow Environment Preview
2.5 Notes and Instructions
3 Mandatory hands on - Airflow - Upload the DAG to S3 bucket
3.5 Before you proceed
4 Mandatory Hands On - Pause & Unpause and Trigger a DAG
4.5 Notes and Instructions
5 Teardown the Airflow Environment

1. Understand the DAG Code Structure
1.5 Before you go ahead
2. Comment - Some Important Concepts - depends on past, catch up, schedule, start date, retry
2.1 Dag Structure and Scheduling
2.2 Recall and Build Now
3. Callbacks - powerful feature of Airflow
3.1 Callbacks and Notifications
3.2 Recall and Build Now
4 DAG Level Dependencies using TriggerDagRun Operator
4.1 Dag Level Dependencies Notes
4.2 Recall and Interview Scenario
5 Comment - Producer Consumer Dependency using Datasets Feature
5.1 Producer Consumer Dependency
5.2 Recall and Reproduce
6 Are you just mugging up or creating your own DAGs or atleast playing with the DAG codes I have provided?

1 Very important Use Case - Sensor Operator
1.1 Sensor Operator Use Case
1.2 Recall and Prepare
2 Comment - XCom
2.1 X-Com Cross Communication
2.2 X-Com Scenario
3 Variables - Comment
3.1 Variables
3.2 Recall the Concept

1. Comment - Branching, Task Group and Trigger Rule
2. Branching, Task Group and Trigger Rule Demo
2.1 Branching Hands On
2.2 Recall the concepts
3 Comment - Architecture of Airflow, MWAA, Celeryexecutor
3.2 Architecture Guide
3.5 Apache Airflow Architecture & Components Overview
4 Get Certified in Airflow - Please leave a 5 Review

After every hands on session, you must tear-down