Core concept
Scheduler + workers + web UI. XCom for inter-task data passing.
Advertisement
How it works
Python code is nice but complexity grows. Airflow itself has ops burden.
Advertisement
Trade-offs + gotchas
Modern Hadoop pipelines. Data science + engineering workflows.