Spark Data Engineering Patterns – Shortcuts and external tables

Fabric Espresso Presents: "Spark Data Engineering Patterns – Shortcuts and external tables" 📌 About This Episode: In today's data-driven world, mastering Spark and Big Data technologies is no longer optional—it's essential. That's why we've invited Daniel Coelho to share his invaluable insights. Daniel is driving Delta Lake at Microsoft Fabric and Azure Synapse Analytics. He's laser-focused on Data Engineering experiences using Spark and Big Data technologies. His work enables BI Analysts, DBAs, Data Engineers, and Data Scientists to shape their data effectively and build incredible solutions. In this episode, we'll dive deep into: 📊 The Difference Between Managed Tables, External Tables, and Views 📊 Why It's Worth Using Delta Format 🛠️ Shortcuts for Optimizing Your Spark Workflows 🗄️ How to Leverage External Tables for Better Data Management ✅ PS. Demos starts from 08:28! :) 🎙 Meet the Speakers: 👤 Guest from Product Group: Daniel Coelho, Principal Product Manager Linkedin:   / danibunny   👤 Host: Estera Kot: Senior Product Manager at Microsoft LinkedIn:   / esterakot   Twitter:   / estera_kot  

Data Science in Microsoft Fabric – Model scoring with PREDICT
▶︎

Data Science in Microsoft Fabric – Model scoring with PREDICT

Spark Data Engineering Patterns Optimizing Delta Tables for Power Bi in Microsoft Fabric
▶︎

Spark Data Engineering Patterns Optimizing Delta Tables for Power Bi in Microsoft Fabric

Spark SQL for Data Engineering 6 :  Difference between Managed table and External table #sparksql
▶︎

Spark SQL for Data Engineering 6 : Difference between Managed table and External table #sparksql

Learn the Fundamentals of Microsoft Fabric in 38 minutes
▶︎

Learn the Fundamentals of Microsoft Fabric in 38 minutes

Microsoft Fabric for Power BI Developers   Where to start
▶︎

Microsoft Fabric for Power BI Developers Where to start

Spark Declarative Pipelines (SDP) Explained in Under 20 Minutes
▶︎

Spark Declarative Pipelines (SDP) Explained in Under 20 Minutes

Delta Lake Table Structure Demystified in Microsoft Fabric
▶︎

Delta Lake Table Structure Demystified in Microsoft Fabric

Medallion Architecture Data Design and Lakehouse Patterns | Microsoft Fabric Data Factory
▶︎

Medallion Architecture Data Design and Lakehouse Patterns | Microsoft Fabric Data Factory

Job Queueing for Notebook in Microsoft Fabric | Spark Compute
▶︎

Job Queueing for Notebook in Microsoft Fabric | Spark Compute

What is this delta lake thing?
▶︎

What is this delta lake thing?

18. External Tables with Synapse SQL in Azure Synapse Analytics
▶︎

18. External Tables with Synapse SQL in Azure Synapse Analytics

Extract and Load from External API to Lakehouse using Data Pipelines (Microsoft Fabric)
▶︎

Extract and Load from External API to Lakehouse using Data Pipelines (Microsoft Fabric)

Saying Yes to Fabric OneLake Shortcuts, No to Duplicate
▶︎

Saying Yes to Fabric OneLake Shortcuts, No to Duplicate

The POWER of shortcuts in Microsoft Fabric
▶︎

The POWER of shortcuts in Microsoft Fabric

Incremental ETL in Microsoft Fabric | Append Only New Data (No SQL, No Dataflow Gen2)
▶︎

Incremental ETL in Microsoft Fabric | Append Only New Data (No SQL, No Dataflow Gen2)

Learn Snowflake – Full 1-Hour Crash Course for Complete Beginners
▶︎

Learn Snowflake – Full 1-Hour Crash Course for Complete Beginners

Building Power BI semantic models with Direct Lake in Microsoft Fabric
▶︎

Building Power BI semantic models with Direct Lake in Microsoft Fabric

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker
▶︎

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker

Learn ETL Pipelines in Databricks in Under 1 Hour | Data Engineering in Databricks
▶︎

Learn ETL Pipelines in Databricks in Under 1 Hour | Data Engineering in Databricks

Learn Snowflake in 2 Hours| High Paying Skills | Step by Step For Beginners
▶︎

Learn Snowflake in 2 Hours| High Paying Skills | Step by Step For Beginners