Airflow and DataOps

By Matthew Housley

Talk Abstract

As enterprises recognize the value of data agility, DataOps is emerging alongside DevOps as a crucial methodology for business. In this workshop, I will demonstrate the use of Apache Airflow to implement DataOps processes and participants are welcome to follow along in their own environments.

Talk Description

This workshop will combine a talk on DataOps methodology with a hands on lab demonstrating the capabilities of Apache Airflow. I will utilize the Google Cloud Composer managed Airflow service for this lab, but the general principles and processes will apply to any Airflow Environment. Participants can prepare by creating a Google Cloud Platform account with billing enabled.

Notes

I will need a projector and participants will need internet access.