Tag: airflow

Exploring: Data-Aware Orchestration with Apache Airflow Datasets

Exploring: Data-Aware Orchestration with Apache Airflow Datasets

Introduction Welcome to “Exploring: Dataset-aware Orchestration”, where we delve into the power of “Airflow Datasets”. In this post, I invite you to my journey throughout a development-need, and the expansive scope, that led to the following article. Scope At one of the largest companies in Belgium, there arose a need to integrate data from various […]