ETL2.0 Data Engineering with Azure Databricks with Asanka Padmakumara

Spark and Azure Databricks have become game changing features in data world and processing large volume of data has never been faster. In this session , I will give a introduction to Azure Databricks, Apache Spark and will walk though step by step on how to use Azure Databricks.Additionally I will showcase how to perform ETL operations using Azure Databricks. Asanka Padmakumara Asanka is a BSc Computer Engineer from the University of Paradeniya, currently performing the role of Tech Lead for a BI solution at Fortude. He has worked for more than 8 years in the IT industry and has implemented BI solutions for different industries. He is also a MCSE in Data Management and Analytics. He is passionate about Data Analytic, Business Intelligence and AI related technologies.

Join Today
Making Apache Spark™ Better with Delta Lake
▶︎

Making Apache Spark™ Better with Delta Lake

Optimizing Apache Spark SQL Joins: Spark Summit East talk by Vida Ha
▶︎

Optimizing Apache Spark SQL Joins: Spark Summit East talk by Vida Ha

Continuous Integration and Delivery (CI/CD) in Azure Data Factory with Rayis Imayev
▶︎

Continuous Integration and Delivery (CI/CD) in Azure Data Factory with Rayis Imayev

Azure Data Factory v2 Tutorial for Beginners
▶︎

Azure Data Factory v2 Tutorial for Beginners

Building Advance Analytics pipelines with Azure Databricks - Lace Lofranco
▶︎

Building Advance Analytics pipelines with Azure Databricks - Lace Lofranco

Data Engineering Principles - Build frameworks not pipelines - Gatis Seja
▶︎

Data Engineering Principles - Build frameworks not pipelines - Gatis Seja

Azure Synapse | Azure Synapse Analytics [Full Course] ☁️
▶︎

Azure Synapse | Azure Synapse Analytics [Full Course] ☁️

Introduction and Use cases for working with Azure Databricks
▶︎

Introduction and Use cases for working with Azure Databricks

Cubes in the Cloud Analysis Services in Azure with Alex Whittles
▶︎

Cubes in the Cloud Analysis Services in Azure with Alex Whittles

Shard Attack - Horizontal Scaling in Azure SQL Database with David Postlethwaite
▶︎

Shard Attack - Horizontal Scaling in Azure SQL Database with David Postlethwaite

Building Robust Production Data Pipelines with Databricks Delta
▶︎

Building Robust Production Data Pipelines with Databricks Delta

Azure Databricks: A Brief Introduction
▶︎

Azure Databricks: A Brief Introduction

Apache Spark Core – Practical Optimization Daniel Tomes (Databricks)
▶︎

Apache Spark Core – Practical Optimization Daniel Tomes (Databricks)

Processing Slowly Changing Dimensions with ADF Data Flows
▶︎

Processing Slowly Changing Dimensions with ADF Data Flows

Azure Databricks Tutorial | Data transformations at scale
▶︎

Azure Databricks Tutorial | Data transformations at scale

From ETL to Data Engineering with Azure Data Factory | Simon Whiteley | Business Analytics
▶︎

From ETL to Data Engineering with Azure Data Factory | Simon Whiteley | Business Analytics

Future of Data Engineering
▶︎

Future of Data Engineering

Databricks Tutorial | Databricks Free Edition Tutorial with End-to-End Data + AI Project
▶︎

Databricks Tutorial | Databricks Free Edition Tutorial with End-to-End Data + AI Project

Microsoft Fabric and Power BI - Developer of the Future⚡ [Full Course]
▶︎

Microsoft Fabric and Power BI - Developer of the Future⚡ [Full Course]

Data Wrangling with PySpark for Data Scientists Who Know Pandas - Andrew Ray
▶︎

Data Wrangling with PySpark for Data Scientists Who Know Pandas - Andrew Ray