Apache Spark Architecture - EXPLAINED!

Welcome to the introduction to Apache Spark Architecture, where we will discuss and see how the things really works. Including: Driver and workers Partitions Jobs, stages, tasks Transformations and actions Data Shuffling Optimizations mechanisms in Apache Spark .., and more :)