Bucketing in Spark SQL 2 3 with Jacek Laskowski

Bucketing is an optimization technique in Spark SQL that uses buckets and bucketing columns to determine data partitioning. When applied properly bucketing can lead to join optimizations by avoiding shuffles (aka exchanges) of tables participating in the join. The talk will give you the necessary information so you can use bucketing to optimize Spark SQL structured queries. About: Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering and business. Read more here: https://databricks.com/product/unifie... Connect with us: Website: https://databricks.com Facebook:   / databricksinc   Twitter:   / databricks   LinkedIn:   / databricks   Instagram:   / databricksinc   Databricks is proud to announce that Gartner has named us a Leader in both the 2021 Magic Quadrant for Cloud Database Management Systems and the 2021 Magic Quadrant for Data Science and Machine Learning Platforms. Download the reports here. https://databricks.com/databricks-nam...

Lessons from the Field:Applying Best Practices to Your Apache Spark Applications with Silvio Fiorito
▶︎

Lessons from the Field:Applying Best Practices to Your Apache Spark Applications with Silvio Fiorito

A Tale of Three Apache Spark APIs: RDDs, DataFrames, and Datasets - Jules Damji
▶︎

A Tale of Three Apache Spark APIs: RDDs, DataFrames, and Datasets - Jules Damji

From Basic to Advanced Aggregate Operators in Apache Spark SQL 2 2 by Examples and their Catalyst Op
▶︎

From Basic to Advanced Aggregate Operators in Apache Spark SQL 2 2 by Examples and their Catalyst Op

Beginner to T-SQL [Full Course]
▶︎

Beginner to T-SQL [Full Course]

What's new in Apache Spark 3.0: Xiao Li and Denny Lee
▶︎

What's new in Apache Spark 3.0: Xiao Li and Denny Lee

The Parquet Format and Performance Optimization Opportunities Boudewijn Braams (Databricks)
▶︎

The Parquet Format and Performance Optimization Opportunities Boudewijn Braams (Databricks)

Jacek Laskowski Interview | Talk with Big Data Expert
▶︎

Jacek Laskowski Interview | Talk with Big Data Expert

Tricks of the Trade to be an Apache Spark Rock Star - Ted Malaska
▶︎

Tricks of the Trade to be an Apache Spark Rock Star - Ted Malaska

Physical Plans in Spark SQL—continues - David Vrba (Socialbakers)
▶︎

Physical Plans in Spark SQL—continues - David Vrba (Socialbakers)

Delta Lake Deep Dive: Liquid Clustering
▶︎

Delta Lake Deep Dive: Liquid Clustering

RL for Agents Workshop - Deep Dive on Training Agents with RL and Open Source
▶︎

RL for Agents Workshop - Deep Dive on Training Agents with RL and Open Source

Spark + Parquet In Depth: Spark Summit East talk by: Emily Curtin and Robbie Strickland
▶︎

Spark + Parquet In Depth: Spark Summit East talk by: Emily Curtin and Robbie Strickland

Making Apache Spark™ Better with Delta Lake
▶︎

Making Apache Spark™ Better with Delta Lake

The Ultimate SQL Window Functions Course | Complete End-to-End Guide
▶︎

The Ultimate SQL Window Functions Course | Complete End-to-End Guide

Apache Spark Performance Troubleshooting at Scale, Challenges, Tools, and Methods with Luca Canali
▶︎

Apache Spark Performance Troubleshooting at Scale, Challenges, Tools, and Methods with Luca Canali

22 Optimize Joins in Spark & Understand Bucketing for Faster joins |Sort Merge Join |Broad Cast Join
▶︎

22 Optimize Joins in Spark & Understand Bucketing for Faster joins |Sort Merge Join |Broad Cast Join

Learn Basic SQL in 15 Minutes | Business Intelligence For Beginners | SQL Tutorial For Beginners 1/3
▶︎

Learn Basic SQL in 15 Minutes | Business Intelligence For Beginners | SQL Tutorial For Beginners 1/3

Excel 2021 Full Course Tutorial (3+ Hours)
▶︎

Excel 2021 Full Course Tutorial (3+ Hours)

Advanced Apache Spark Training - Sameer Farooqui (Databricks)
▶︎

Advanced Apache Spark Training - Sameer Farooqui (Databricks)

React Tutorial For Beginners [ReactJS] | ReactJS Course | ReactJS For Beginners | Intellipaat
▶︎

React Tutorial For Beginners [ReactJS] | ReactJS Course | ReactJS For Beginners | Intellipaat