Tutorial 1-Pyspark With Python-Pyspark Introduction and Installation

Apache Spark is written in Scala programming language. To support Python with Spark, Apache Spark community released a tool, PySpark. Using PySpark, you can work with RDDs in Python programming language also. It is because of a library called Py4j that they are able to achieve this.
Subscribe my vlogging channel
Please donate if you want to support the channel through GPay UPID,

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more

Connect with me here:

[rlmclaughlinmusic]

Everything about this series is perfect. The pace, the information, and the clarity of the descriptions are as good as it gets. I've watched about 4-5 pyspark tutorials, from various instructors, and they don't even come close to the greatness of these videos. Thank you for providing such top notch content and using a no-nonsense approach. I thoroughly enjoyed these and learned a lot.

[lananajera]

I am 9 minutes into the first video and let me tell you it is already better than the last 10 I have tried. It's great for real beginners like me and challenging enough too. Thank you for posting these!!

[AInamedMia]

We can like these videos even before we see them cause we know they are bound to be extremely useful.

[Abhilash]

Was eagerly waiting for this playlist. Thank you so much Krish! 🙂

[amanmehrotra]

Sir ek hi dil hai, kitni baar jeetenge ! Once again hats-off to your efforts in uplifting the entire data science community across the globe.

[deveshkumar]

I desperately needed this course ! Thanks a lot !

[rhevathivijay]

Really When i am doing search in ur encyclopedia playlist, I miss this..Thank you for uploading sir

[prashanthpaul]

So glad that you started this new series, Krish! Looking forward for new videos in this series. Any idea when you would be uploading? :)

[eswaragopal]

Most awaited video from u...
Thanks for the starting this session

[vaibhavtiwari]

I didn't realise when those 16 minutes ended...interactive n smooth!!

[rashmikadre]

Omg!! I have been literally been waiting for this!! Krish u r the man!!!

[ansonnn_]

Have been searching for good PySpark tutorials and this turned up 👍 Thanks!

[hardikvegad]

It's been I had waited for this from you you💥

[vbimjbb]

Thanks for this video. For learning purposes on my own computer, do I need to install apache.spark (spark-3.4.1-bin-hadoop3.tgz) to be able to run spark scripts/notebooks, or just pip install pyspark on my python environment?

[alihaiderabdi]

sir waiting for new playlist from a longtime and here it came!!!!

[hareshmu]

Hi Krish, you are awesome in explaining difficult topics

[ganeshkalbhor]

Hi @krish, I am getting ' RuntimeError: Java gateway process exited before sending its port number ' this error while starting spark session. could you please help me to resolve this

[muhammadsalmanhassan]

What we can divide dataset into multiple chunks in pandas and train the model on it is this good practice or bad practice?

[megaranvirsingh]

Hi Krish..Thanks for starting session on pyspark
Please address below issue: I am using currencies csv file and it has around 40 columns
while using df_currencies.show() -> the df is displaying record, but these records are not readable as they are conjusted as not showing in tabular form.
Please read some df who has around 30-40 columns and check at your end are you getting same, if yes->please share solution of above.

Thanks, hope you will help in this.

[farhaanarshad]

Amazing Playlist. Thanks so much! Was looking for a good tutorial for Introduction into PySpark :)