Apache Airflow

Apache Airflow is an open-source platform to programmatically author, schedule and monitor workflows using Directed Acyclic Graphs (DAGs). It allows you to define complex workflows as code using Python instead of using proprietary graphical user interfaces (GUIs) or scripting languages directly. You can use it to build data pipelines or machine learning workflows easily with built-in support for popular technologies such as Apache Spark or Kubernetes out-of-the-box.

Apache Airflow is an open-source platform to programmatically author, schedule and monitor workflows using Directed Acyclic Graphs (DAGs). It allows you to define complex workflows as code using Python instead of using proprietary graphical user interfaces (GUIs) or scripting languages directly. You can use it to build data pipelines or machine learning workflows easily with built-in support for popular technologies such as Apache Spark or Kubernetes out-of-the-box.