Understanding Stages in Spark UI for a Spark Job | Spark Interview Questions

Hi Friends,

In this video, I have explained Spark internal machanism on how driver creates the logical plan and then how it will turn to the run-time execution plan, how the stages will be created etc details.
Please subscribe to my channel for more interesting learnings.

[vanajar]

Explained clearly. It took me 10 -15 video before reaching to this video and no other video was as clear as your's

[Jay-vhgx]

Thank you Sravana for crystal clear explanation 🎉

[naveennoel]

Explained in a very clear manner. Thanks.

[sonutyagi]

You Channel is Gold Mine to me - Thank you So So Much .

[bhavanivani]

Nice explained, really helpful for interview

[vaishnavidhoke]

Amazingly explained! Thankyou so much for making this, it’s extremely helpful, kudos!!

[sushmamc]

You have explained it so well. Thank you so much

[sriadityab]

Can you please explain more with good example on how to identify time taking jobs and optimizing them?

[technologyexplorer]

Nice explanation.
Could you please explain little bit more on how exactly on what bases tasks are created. For each stage

[Jay-vhgx]

Sravanva, how to get the Databricks UI the one u ur programming, can you please share any reference

[vishnureddym]

Hi @sravana, it was good explanation. I have a doubt in this. In the second job we can see two stages and the first stage is skipped which means it is broadcasted or cached right?. But job 1 executed the same and in the second job again that stage executed or first job itseems cached and using the result as input in the second job second stage?

[dipanjanroy]

Lots of discrepancies' in the explanation

[kubersharma]

You have nailed it . Would be looking to connect with you over Linkedin pls share your LinkedIn profile link

[ittrainingsjobsimmigration]

Very well demonstrated ...if you have any Instagram I'd / fb id please share to clear certain doubts