How to Structure an AI Project for Data Engineering

Get all of my free resources to help you learn: https://skool.com/moderndata/about Work with me to modernize your data architecture: https://bit.ly/kdsconsulting ----- Like any data tool, using AI like Claude Code with no structure is a risky play. On one hand, it's exciting and freeing to have unlimited options. It's fun to let the AI take the wheel and watch the magic happen. On the other, that freedom can become a runaway train if you're not paying attention. So how can you leverage this tech while still keeping things under control? This is a big topic and constantly evolving. But in this week's video, we're going to start with the basics. We're going to talk about a critical file in Claude Code called CLAUDE.md. And how it works with the rest of your AI project. We'll cover: How this one file plays a pivotal role in maintaining the structure How this compares to typical AI prompting An example AI project architecture layout (APT/PAT? Framework) Tips to expedite your setup By the end, you'll have a better understanding of how tools like Claude Code (and other AIs) operate. And start thinking more about ways to structure your project going forward. Enjoy! Timestamps: 00:00 Intro 00:20 What is Claude.MD? 02:28 Creating a Framework 04:40 Example - Following Conventions 05:47 Be Mindful of Context 06:26 Example Playbook 07:15 Free Resource - dbt Project 08:03 Example Tool 09:26 Importance of Understanding 09:46 Comparison to dbt