Multi-Table Transactions with LakeFS and Delta Lake

This is a recording of the live tech talk hosted on August 31, 2021. Join us for a tech talk about LakeFS and Delta Lake. Paul Singman from Treeverse and Denny Lee from Databricks discuss multi-table transactions with LakeFS and Delta Lake. LakeFS enables you to manage your data lake the way you manage your code, allowing for a collaborative development environment and CI/CD deployment of data. Delta Lake is an open-source project that enables building a Lakehouse architecture on top of existing storage systems such as S3, ADLS, GCS, and HDFS. In this session, Paul and Denny will discuss LakeFS and Delta Lake and the integration of LakeFS and Delta Lake simplifies your multi-table pipelines. Speakers: Paul leads DevRel for lakeFS, after several years as a ML engineer at Equinox Fitness. He enjoys contextualizing the latest data trends and technologies in blog posts and talks, instead of getting caught up in the hype surrounding specific tools. Denny Lee is a developer advocate at Databricks, where he works on Delta Lake, Apache Spark, Data Sciences, and Healthcare Life Sciences. He has previously built enterprise DW/BI and big data systems at Microsoft including Azure Cosmos DB, Project Isotope (HDInsight), and SQL Server as well as the Senior Director of Data Sciences Engineering at SAP Concur. Denny holds a Masters in Biomedical Informatics from Oregon Health Sciences University. Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-nam...

Tech Talk | Simon + Denny Build A Thing! Part Four
▶︎

Tech Talk | Simon + Denny Build A Thing! Part Four

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker
▶︎

Turing Award Winner: Disagreeing with Google, Postgres, Future Problems | Mike Stonebraker

Delta Lake - EXPLAINED - Full Tutorial
▶︎

Delta Lake - EXPLAINED - Full Tutorial

Unity Catalog Workshop: Unified, open governance for data and AI (July 2024)
▶︎

Unity Catalog Workshop: Unified, open governance for data and AI (July 2024)

AWS re:Invent 2022 - Building and operating a data lake on Amazon S3 (STG302)
▶︎

AWS re:Invent 2022 - Building and operating a data lake on Amazon S3 (STG302)

What is Databricks? The Story Behind the Modern Data Platform (Visual Explanation)
▶︎

What is Databricks? The Story Behind the Modern Data Platform (Visual Explanation)

AWS re:Invent 2024 - Build large-scale transactional data lakes with open table formats (ANT336)
▶︎

AWS re:Invent 2024 - Build large-scale transactional data lakes with open table formats (ANT336)

DLT Overview: Modern Software Engineering for ETL Processing
▶︎

DLT Overview: Modern Software Engineering for ETL Processing

Jfrog | Jfrog Artifactory | Jfrog Artifactory Tutorial | Artifactory Tutorial | Intellipaat
▶︎

Jfrog | Jfrog Artifactory | Jfrog Artifactory Tutorial | Artifactory Tutorial | Intellipaat

Learn Snowflake – Full 1-Hour Crash Course for Complete Beginners
▶︎

Learn Snowflake – Full 1-Hour Crash Course for Complete Beginners

Lakehouse VS  Warehouse VS  Datamart   The Difference Between The Three Fabric Objects
▶︎

Lakehouse VS Warehouse VS Datamart The Difference Between The Three Fabric Objects

Databricks DAIS 2026 ALL ANNOUNCEMENTS SUMMARIZED | Ontology, Reyden, LTAP, Omnigent & More
▶︎

Databricks DAIS 2026 ALL ANNOUNCEMENTS SUMMARIZED | Ontology, Reyden, LTAP, Omnigent & More

Diving into Delta Lake: Unpacking the Transaction Log
▶︎

Diving into Delta Lake: Unpacking the Transaction Log

Building Trustworthy, High-Quality AI Agents with MLflow
▶︎

Building Trustworthy, High-Quality AI Agents with MLflow

System Design Explained: APIs, Databases, Caching, CDNs, Load Balancing & Production Infra
▶︎

System Design Explained: APIs, Databases, Caching, CDNs, Load Balancing & Production Infra

I Spent 20 Days Building the Cheapest Forest House Alone to Live: Solo Bushcraft (Full)
▶︎

I Spent 20 Days Building the Cheapest Forest House Alone to Live: Solo Bushcraft (Full)

Machine Learning Lessons Learned from the Field: Interview with Brooke Wenig
▶︎

Machine Learning Lessons Learned from the Field: Interview with Brooke Wenig

Designing Data-Intensive Applications: Chapters 1 and 2
▶︎

Designing Data-Intensive Applications: Chapters 1 and 2

Tech Talk | Diving into Delta Lake Part 2: Enforcing and Evolving the Schema
▶︎

Tech Talk | Diving into Delta Lake Part 2: Enforcing and Evolving the Schema

AWS Analytics Bytes: Building Transactional Data Lakes on AWS | Amazon Web Services
▶︎

AWS Analytics Bytes: Building Transactional Data Lakes on AWS | Amazon Web Services