Why do we need Airflow?

Airflow is an open-source workflow management tool. It allows users to programmatically create workflows (data pipelines), schedule them, monitor them with web UI and also trigger alerts during failures.