Master Databricks and Apache Spark Step by Step: Lesson 20 - PySpark Introduction

In this video, we introduce PySpark and explain important concepts you need to understand to be productive with Python on Spark. Specific questions include Can Python do everything? Does it perform well? Why you need to know PySpark and more.

Link to slides:

Deep Dive Apache Spark Interview with Dan Zafar from Databricks

PySpark Documentation

[Darshakramani-krhe]

What a gentlemen you are! I have been watching your videos, you explain to all age group of people very nicely and easy to understand way, from beginner to expert.
I am writing this comment at 2 o'clock midnight watching your all videos from 1st to 20th of this series, will finish the other ones this week. I am so pleased the way you explain, sir, I am 30y old Indian Canadian from Toronto.

I have a small question, how relevant is still this series after 3 years, do we need to modify/update something specific - tool/area to focus on? I know it is wide question but any light would help. I have also read your other above comment of darwin as well. I genuinely wish this channel were big, but these days unfortunately people with shallow knowledge with flashy graphic with little intention to explain are spreading their wings. I wish you good luck sir. you have a grace, wisdom to explain, humbleness to explain common detail which is obvious but you still explain keeping in mind wider audience, no arrogance, again, really pleased with your videos.

[ravitutika]

Great video Bryan Looking forward more videos on Pyspark

[vaibhavvaidya]

Well explained, looking for more videos on pyspark deep down

[darwin]

Hello Bryan, I am newbie to big data for five years only, among apache Spark vs pyspark vs hadoop, which one should learn first? could u give me your view pls