Apache Spark / PySpark Tutorial: Basics In 15 Mins

Subscribe if you enjoyed the video!

Best Courses for Analytics:
---------------------------------------------------------------------------------------------------------

Best Courses for Programming:
---------------------------------------------------------------------------------------------------------

Best Courses for Machine Learning:
---------------------------------------------------------------------------------------------------------

Best Courses for Statistics:
---------------------------------------------------------------------------------------------------------

Best Courses for Big Data:
---------------------------------------------------------------------------------------------------------

More Courses:
---------------------------------------------------------------------------------------------------------

[mongooon]

We use spark for our data pipeline at work -- we have tables with 10+ billion records, and our applications end up moving trillions upon trillions of records of data per month. Unfathomable numbers that spark is capable of. Great video!

[Nedwin]

I'm a freelance data scientist and I really thankful to find this video, Gregg. Can't expect more! Thank you so much. Good luck with everything. 🙏

[AnVinhNguyen]

Your explanation is clear and the examples are practical and useful for beginners. Thanks a lot and keep it up!

[joshuabradshaw]

Thank you for sharing to the world. I'm currently a supply chain analyst and aspiring supply chain data scientist 🙏

[andersborum]

I'm just getting into DataBricks and PySpark and this introductory tutorial was a great starter.

[ashleyb]

Awesome video. I love using spark at work

[mtamjidhossain]

You are awesome. Just delivering the right videos. Subscribed a few days back already but hit notifications on for you rn. Cause I wanna watch all your videos

[dominicaleung]

Greg, thank you so much. I am new to PySpark, and your video is very good in explanation and you did those simple example and I am able to follow you and write in my own Python Notebook to try it out. Will watch your DataFrame basics video next.

[ericcarmichael]

Thanks for sharing, appreciate the quick run down on this stuff

[parvathirajan.n]

No words man! Simply loved it. Appreciate your efforts.

[victorroy]

Just the type of samples we need to begin with. Meaningful content. thnx.

[SpecialGreg]

Hi Greg! Great video, do you have one that explains how you convert spark to dfs and vice versa? We pull millions of rows from csvs and looking to do transformations before dropping into a db.

Also, how does the distributed computing work on a singular computer? Just distributes it across the cpu cores?

[EclipsyChannel]

you are a great teacher... keep doing what you do my man

[BHANUCHAUDHARY-ebul]

Thanks Greg for the wonderful explanation !!

[andrewhancock]

This is an awesome video. I wonder, however, whether you could explain why the end results shows numbers with 12 characters. Didn't you set of numbers only go up to a million, which has 6 digits?

You also referred to your hour-long PySpark course. Would you be able to link to it in the show notes, please? Thanks!

[Vlapstone]

sc command is not working on my Colab as it's working on this vide... can anyone help?

[hsoley]

You are awesome, thanks for sharing your knowledge with the world

@greg, plz share the link of 1 hr video.. I am unable to find it

[yashmodi]

Which big data tools one must learn for beginners and from where to learn( please provide some resources)

[keerthanamurugesan-xemr]

It look like using numpy, pandas what is the difference between this and pyspark.