Tutorial 2-Pyspark With Python-Pyspark DataFrames- Part 1

Apache Spark is written in Scala programming language. To support Python with Spark, Apache Spark community released a tool, PySpark. Using PySpark, you can work with RDDs in Python programming language also. It is because of a library called Py4j that they are able to achieve this.
---------------------------------------------------------------------------------------------------------------------------
Subscribe my vlogging channel
Please donate if you want to support the channel through GPay UPID,

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more

Connect with me here:

[tanishasharma]

I was recently told by my company to learn pyspark and here is your playlist! Thank you so much!!
Btw I have been offered the role of a Data a lot for all your playlists have learnt a lot...keep up the great work!!!

[VikashKumar-tyuy]

Thank you so much for the Pyspark session..Requesting you to kindly complete the playlist as per your availability.
I know you have to put lots of effort for this but it is really helpfull for we people who always thrive to learn something new to come out of the box...and you are the reason for that...

[ayushikaushik]

I feel so lucky that I started learning pyspark yesterday and you started this series as well!! Thank you sir!!

[shrutijain]

This was the most simplest and understandable tutorial for pysparks

[from-chimp-to-champ]

Thanks to all the great teachers on youtube, one of which you are. Very helpful! Good luck and all the best!

[mohitupadhayay]

Why hasn't this guy go 10mn subscribers yet? Kudos to you Bhai!

[yogaandernostlich]

Big data playlist..krish make this as good as ml

[SMHasan]

Your way of teaching is excellent, Krish !

[utsavdatta]

Great series..eagerly waiting for MLib...u deserve more subscribers

[swaraj]

Excellent explanation Krish. Thank you very much.

[stephenmartin]

Thank you for this very clear explanation !

[reenasheoran]

Hey Krish ... what I realized from this is that SQL knowledge will help to learn spark quickly :)

[joeljoseph]

Krish, you're a good human! :) Thank you!

[adshakin]

Amazing, you made it so simple. thanks

[XiwithHighPing]

multiple columns can be renamed using .withColumn Renamed. for example:
covid4=(covid.withColumnRenamed('Country/Region', 'Nation')
.withColumnRenamed('Province/State', 'State')
.withColumnRenamed('Deaths', 'Deceased'))

[kaxxamhinna]

Thank you very much for the pedagogy 🙏

[ritizsaini]

Great content! Thanks for this wonderful series :)

[piyushjain]

good Tutorial Sir, it was really helpful to clear the basics!

[khushboojain]

What I noticed is 'Describe()' function gives the data types of Age and Experience as Strings, not Integer. But 'Describe' method gives the correct data types as Integer. In addition, df_pyspark.describe.show() does not work, but df_pyspark.describe().show() works successfully.

[nikhileshyoutube]

Sir can u give the link description of u r earphones ❤️