Apache Spark Architecture with Spark Context Driver and Executor

preview_player
Показать описание
In this video I talk about how spark works and what is happening when you execute a job.
We look into the Spark Driver program Spark Executors and Tasks. How Spark schedules tasks and how tasks are executed on the executors.
This is a short clip of episode #100.

►Learn Data Engineering with my Data Engineering Academy:

Check out my free 100+ pages data engineering cookbook on GitHub:

Please SUPPORT WHAT YOU LIKE:

- As an Amazon Associate I earn from qualifying purchases from Amazon. Just use this link:

#ApacheSpark #DataEngineering #PlumbersofDataScience #bigdata
Рекомендации по теме
Комментарии
Автор

dude, wht don't you first write a speech and then record the ready text. that would make much better product. improvisation is not your strong point

magneat
Автор

very good video, appreciate it. perhaps a little more enthusiasm would make the video more attractive to watch. cheers!

eljangoolak
Автор

I'm java expert, can i move to data engineer? What is the right path to become a data engineer?

mytechchannel