Apache Spark Architecture - EXPLAINED!

preview_player
Показать описание
Welcome to the introduction to Apache Spark Architecture, where we will discuss and see how the things really works. Including:
* Driver and workers
* Partitions
* Jobs, stages, tasks
* Transformations and actions
* Data Shuffling
* Optimizations mechanisms in Apache Spark
.., and more :)
Рекомендации по теме
Комментарии
Автор

That was really a great explanation, and covering each topic indeeply, I dont see anyone talk about sparkUI and the pwoer of it. Thanks really again

sekhar
Автор

Emil, finally I have fount one comprehensive tutorial about Spark architecture. I have subscribed your channel. Thanks a lot for your unvaluable support!

MassimoManfredino
Автор

This channel will explode in due time, great job! Looking forward to more such videos! (hopefully on spark optimisations soon). Thanks a lot!!

AdityaSingh-psvn
Автор

Amazing content! You've done absolute justice to explaining Spark! The breakdown of concepts is spot on and super easy to follow. Keep up the great work! Thank you!

aazimparwaz
Автор

Very well explained and best part was to include examples for all the concept and explaination. Thanks for such great efforts.

yashshah
Автор

Hi!
Thanks … indeed super thanks for such learning session on Spark. I wonder how many months of learning and understanding been put into 1 hour! I recomend this to all #databricks users to have this understanding of #spark to make life easy with the #development of #datapipeline or #dataanalytics or #dataanalysis or #optimizing your #codes.
Thanks !!

cybersubhendu
Автор

Great video, Please im requesting you please where i get all this 5GB data please provide me link 🙏🙏🙏
I want to use your data which hii have used so i understand eusly 🙏 please provide all 5Gb data

SonuKumar-fngn
Автор

Great work and thanks
Could you please make a similar video like this on delta lake

thamimmo
Автор

i’ve watched many videos and tutorials, none of them are in detailed. Awesome work🫡

rangareddy