PySpark | Session-9 | How spark executes a job internally | Stages and Tasks in Spark

#PySparkTutorials #stagesandtasks #WideVsNarrowTransformations #CleverStudies

In this video, we have covered the below topics,

How spark executes a job internally
Stages and Tasks
Type’s of Transformations
Narrow Transformations
Wide Transformations

Follow me on linkedin
-----------------------------------------------------------------------------
Follow this link to join 'Clever Studies' official WhatsApp group:
--------------------------------------------------
Follow this link to join 'Clever Studies' official telegram channel:
--------------------------------------------------
PySpark by Naresh playlist:
--------------------------------------------------
PySpark Software Installation:
--------------------------------------------------
Realtime Interview playlist :
--------------------------------------------------
Apache Spark playlist :
--------------------------------------------------
PySpark playlist:
--------------------------------------------------
Apache Hadoop playlist:
--------------------------------------------------
Bigdata playlist:
--------------------------------------------------
Scala Playlist:
--------------------------------------------------
SQL Playlist:

Hello Viewers,

We ‘Clever Studies’ YouTube Channel formed by group of experienced software professionals to fill the gap in the industry by providing free content on software tutorials, mock interviews, study materials, interview tips, knowledge sharing by Real-time working professionals and many more to help the freshers, working professionals, software aspirants to get a job.

If you like our videos, please do subscribe and share within your friends circle.

Thank you !

[rohitbhawle]

thank you sir you explain very efficient way

[suman]

Thanks for your efforts to Make us understand

[GreatIndia]

Greate Explanation...Great Intention to inject the concept...👌👏

[ps-upmx]

Hi are u provide spark with scala in-depth course.?

[aritrachatterjee]

Thanks for the explanation.
But Sir I need one explanation, why the number of tasks will be 8 if the no of partitions is 2,
Total no of tasks = (no of tasks per stage)* no of stages = 2*2 =4

[venkatd]

I'm unable to join in WhatsApp group, it says group is full