Kubernetes-Powered Multi-Cloud Apache Airflow at Scale: The Astro Architecture by Goutam Tadi

Goutam Tadi explores how to run Apache Airflow at scale across multiple clouds using Kubernetes and the Astro platform. In this talk, Goutam walks through the architecture and operational decisions behind deploying Airflow as a multi-cloud work orchestration engine on Kubernetes. He shares how the Astro platform enables teams to scale Airflow deployments, manage DAGs across environments, and maintain reliability when workloads span multiple cloud providers. If you are a data engineer, DevOps engineer, or platform team working with Airflow or data pipelines in Kubernetes, this talk offers practical insights into building resilient, scalable Airflow infrastructure. Recorded live at Kubernetes Community Days Texas on May 15, 2026, at the TCEA Conference Center in Austin, Texas. Kubernetes Community Days Texas is a community driven CNCF event focused on learning, collaboration, and open source connection across the cloud native ecosystem. Thank you to our sponsors for making this event possible: https://community2.cncf.io/events/det... Learn more about KCD Texas: https://kcdtexas.org Follow KCD Texas: @KCDTexas