Empowering Collaborative Data Workflows with Airflow and Cloud Services

Presented by Stanislaw Smyl & Hoa Nguyen at Airflow Summit 2023.
Productive cross-team collaboration between data engineers and analysts is the goal of all data teams, however, fulfilling on that mission can be challenging given the diverse set of skills that each group brings. In this talk we present an example of how one team tackled this topic by creating a flexible, dynamic and extensible framework using Airflow and cloud services that allowed engineers and analysts to jointly create data-centric micro-services to serve up projections and other robust analysis for use in the organization.