Apache Spark & PySpark latest version installation complete guide on Windows 10(2020)

Hi Viewer's follow this video to install apache spark on your system in standalone mode without any external VM's. Follow along and Spark-Shell and PySpark will be up and running.

#Spark #Hadoop #Windows10

[mcdonaldgabriel]

Thanks for sharing this video. It is also important to note that the latest version of spark still runs with Java 11 as against the latest version 16. Ensure you set up the right directory in the System Environment (Windows) for java (e.g C:\Program Files\Java\jdk-11.0.11). Do not include the \bin

[akhilbatchu]

Clear explanation of each and everything from the installation, setting of environment variables to the validation of the tool. Good work my friend 👍👍

[johnmamodu]

awesome video...I have tried to install spark like a week now. And your video just gave me that victory. Thank you

[YogeshKumar-tjte]

I followed everything on the video Spark shell didnt open in cmd. 'spark-shell' is not recognized as internal or external command

[WittCode]

Thanks man! This really helped for my cloud computing class!

[ralfhauenschild]

Very good explanation, Shabbir! You didn't miss anything! :) Thank you!

[vikasronanki]

I am getting error when I am writing pyspark command in command prompt...

[rda]

thank you i exact follow your step but in the command line it gives this error spark-shell' is not recognized as an internal or external command,
operable program or batch file.

[shivadarjani]

Thanks for the video. I got very happy when I saw Spark logo on my cmd

[manishtripathi]

Thanks a very detailed video. It really helped me in installing spark on my WIndows 10

[MaheshKumar-ndgb]

spark was giving error when i installed java version 16.0
then got to know java version 8 to java version 11 only supports spark.
installed java 11.0 and was able to use spark.
thanks for the video.

[sushmitasingh]

When I type pyspark in command shell it does not gives me new line for pyspark code

[fauziadirafrastara]

Thanks Shabbir!

by the way, in 7:36, exist a warning said that: "WARN NativeCodeLoader: Unable to load native-hadoop library for your platform... using builtin-java classes where applicable"
my question: is it normal?
I have the same situation. For the standalone computation, yes it's fine, but for the cluster computation, it doesn't work although all nodes are already well connected.
I don't know whether this warning relates to my problem or not.

[kameshp]

I followed everything as show, but spark has not got installed. when i tried spark command, it's throwing error 'recognized as an internal or external command. Kindly help'

[akashkanojiya]

I have installed java version "16.0.1" and followed all the steps but I'm getting error when I type pyspark-shell "Exception: Java gateway process exited before sending its port number" . Can anyone help?

[dheerajdubey]

Great video bro...my program is running fine and thank you so muchh

[ssbigdata]

Thank-you. Your, video helped installing pyspark.

[josephkim]

Thank you sir. This vid helped me to fix the problem!

[SahilSharma-ldho]

Great video sir....looking forward to see more videos on this👍

[ytubeindia]

I tried the procedure but I'm getting "The System cannot find the path specified".
The environment variables are exactly same as your but still I'm getting this error what to do??
java -version, javac commands works, only spark-shell doesn't work.