The Secret to Becoming a Great Data Engineer with Zach Wilson (DataExpert.io, Facebook, Netflix)

Zach Wilson, an industry virtuoso with experience as a data engineering leader at Facebook, Netflix, and Airbnb, pulls back the curtain on his journey through the world of data in our latest episode. With tales of his ascent from the ranks of Think Big Analytics to pioneering educational practices with DataEngineer.IO, Zach's narrative is a treasure trove for aspiring tech professionals. He not only demystifies the progression from data engineering to software engineering but also shares the trials of career elevation—all served with a hearty side of SQL and backend development insights. The conversation then shifts gears to the buzz around AI's role in data engineering. While LLMs like ChatGPT are adept at churning out SQL queries, Zach asserts that they haven't usurped the throne from human engineers just yet. Distilling the essence of stakeholder communication and conceptual data modeling, he reminds us that the human element is the linchpin in a landscape increasingly guided by algorithms. It’s an eye-opening exploration of how AI might be the trusty sidekick, but data engineers—as the heroes of their own stories—still save the day with their indispensable human touch. Wrapping up, Zach takes us on a tour of the latest innovations shaping the data engineering domain. From analytical patterns to the significance of community within the data sphere, his enthusiasm for the field is infectious. The episode underscores the vital role of collective wisdom and personal experience in navigating the toolkits and methodologies of data engineering. So, buckle up for a ride with a mentor whose insights illuminate the path forward in the ever-evolving tech landscape. What's New In Data is a data thought leadership series hosted by John Kutay who leads data and products at Striim. What's New In Data hosts industry practitioners to discuss latest trends, common patterns for real world data patterns, and analytics success stories.