Apache Spark Installation on Anaconda video(PySpark)

preview_player
Показать описание
Apache Spark Installation on Anaconda using "conda". Python + Spark
#PySpark #sparkteam #anaconda #conda #spark #python #dataengineering #dataengineeringessentials
Рекомендации по теме
Комментарии
Автор

(pyspark_env) C:\Users\Lenovo>jupyter kernelspec list
'jupyter' is not recognized as an internal or external command,
operable program or batch file.

i am getting this error

BhargavSarikonda
Автор

Hi Manoj, Thanks for the clear instructions. i have followed all the steps but while running "sc = SparkContext.getOrCreate()" iam getting """
RuntimeError: Java gateway process exited before sending its port number """. how to resolve this issue?

saisunilsigiri
Автор

I don't know why, when i execute this:
from pyspark.context import SparkContext
from pyspark.sql.session import SparkSession
sc = SparkContext.getOrCreate()
spark = SparkSession(sc)

the execution doesn't finish and put "Failed to fetch" and i cant use pyspark because of this. I try to do some things but they dont have effect

santiagogil