The AI Workflow for Data Engineering

Get all of my free resources to help you learn: https://skool.com/moderndata/about Work with me to modernize your data architecture: https://bit.ly/kdsconsulting ----- Last weekend I built a sample data pipeline end-to-end in less than 24 hours. Without writing a single line of code myself. It was a wild experience and it's why today I want to talk about AI. And specifically how it applies to us in data engineering. First, I recognize this topic is getting annoying. But the problem is many data people still associate "AI" with simply going back and forth with ChatGPT. Having said that, I also find it's really difficult to wrap your head around some of the more recent stuff until you see it in action yourself. So in today's video I'm going to show you an example of what a new AI-driven workflow actually looks like using common data tools. It's purposely simple, but done in a way that I believe will still drive home the point. I'll walk you through: The example project I built Go step by step through making changes to dbt using Claude Code Discuss ways to think about approaching this going forward Explain why real engineering experience is now more valuable than ever Enjoy! Timestamps: 00:00 The New AI Workflow (Claude, Snowflake, dbt) 00:27 Why - Not Chat GPT 00:50 Start of Demo 01:58 Overview of Project 05:57 Create Different Mart 07:23 dbt Project Review 07:57 New Plan 14:32 Refresh Dash 17:09 Recap of Demo 20:59 Basketball Example