03. Databricks | PySpark: Transformation and Action

#Databricks, #DatabricksTutorial, #AzureDatabricks
#Databricks
#Pyspark
#Spark
#AzureDatabricks
#AzureADF
#Databricks #LearnPyspark #LearnDataBRicks #DataBricksTutorial
databricks spark tutorial
databricks tutorial
databricks azure
databricks notebook tutorial
databricks delta lake
databricks azure tutorial,
Databricks Tutorial for beginners,
azure Databricks tutorial
databricks tutorial,
databricks community edition,
databricks community edition cluster creation,
databricks community edition tutorial
databricks community edition pyspark
databricks community edition cluster
databricks pyspark tutorial
databricks community edition tutorial
databricks spark certification
databricks cli
databricks tutorial for beginners
databricks interview questions
databricks azure

[vydudraksharam]

Raja Sir, the way come well prepared with workbooks with example according to your explanation is too good. appreciate all your efforts and service to community.

[JayJay-tkgp]

This is a great work. The level of detailing is outstanding with an easy to understand teaching style. I really thank you for your time and effort you put into this video series.

[shalabhkushwaha]

Great work Sir. It was like i am learning since 100s of years. So simple to understand

[srinirow]

Simple and clear to the point explanation, Great work Mr.Raja. You could really help people by putting more real life use cases ( simulations would work too) by showing clear problem statement and the solutions in much optimized way which industry folks are looking for. This way you really could help job less people (especially )and aspiring DEs by launching a paid course. But yes, you may have time constraints too. But think in those lines brother.

[yuvrajchauhan]

Great video, deserves way more views and likes!

[sachinchandanshiv]

Explained in very nice way. Thank you so much Sir🙏

[firazmohiuddin]

It would be better if you linked the files you worked on in the descrition.

[mallikarjun_reddy]

It would be better if you provide the source dataset and databricks notebook in description

[cmeidpt]

Thank you soo much for this series of videos, this channel is so underrated kudos to ur hardwork, this will help me alot with my DE interview, Can u please make a video on the Azure DE project using ADF, ADLS, Databricks and pyspark and how does we deploy those production pipelines. THanks in advaance again

[premamal]

Great Explanation Raja Sir. It would be really helpful if you can share the data files and code if possible so that we can do hands on along with the video.

[krishnakanthlenka]

It's nice session, it would be really great if you provide source data files that you are using.

[Thescienceworld]

at least you should have make one video on how to open databricks notebook

[vinayveerabhadra]

Hi @Raja,
You are executing Action command .count() in cell 12 itself, and on cell 14 you have executed one more action command .collect(). Please correct me if I am wrong. And in cell 14 there is a stage skipped for Job 23, is it because you execute a action command in cell 12

[pcchadra]

Videos are wonderful.Can you please share the noteboos and datasets please

[krishnachaithanyaudayagiri]

Hi Mr.Raja, It's a really good session. It's really good and helpful if you can share the files and scripts that you are using for the sessions.

[sureshkoduru]

Hi Raja, nice explanation in the video transformations list both Wide & Narrow transformation or only wide transformation

[gopichand]

explanation is superb please provide source dataset link for download

[roymou]

Raja Sir, Sorry if i am asking any silly qs. pretty new to spark and databricks.
example used for wide transformation is a count. but as you mentioned previously that count is an action. does that mean all actions needs shuffling of data and those are called wide transformation?thanks

[gowthamsagarkurapati]

Hi Raja, Thanks for the video, to my understanding whenever a wide transformation is performed it should create a new stage, but in the DAG, i don't see any new stage created. please explain if my understanding is wrong.

[saravninja]

Really great explanation on given topic, question- in the demo, count is being used before collect action. Since count is also action then it should execute whole DAG logical plan till count instead execution happens only at collect action. Can you throw some light here.