Deploying Spark Application in the cluster through Shell Script - Part 1 | spark-submit

preview_player
Показать описание
Hi Friends,
In today's video, I have explained the spark-submit command, options and running this command in the cluster. Also I have created a shell script for submitting spark job in the cluster and explained the steps.

Please subscribe to my channel an provide your feedback in the comments section.
Рекомендации по теме
Комментарии
Автор

Hi Sravana,
Thanks for the video,
I am waiting for the 2nd part

abhishekn
Автор

Thanks a lot Sarvana.... really very helpful....

rahulpandit
Автор

sarvana speak loudly while creating videos

vishnukorde
Автор

Thanks Sravana, Do you have part 2 video for Deploying Spark Application in the cluster through Shell Script.

MZakeer
Автор

@Sravana, I tried putting the deploy mode as cluster as a part of spark configuration inside the .py script i.e the application file, but it always run in the client mode ? I don't pass it in the command line

indrajitghosh
Автор

Can we apply for loop on the spark submit command in the shell script?

dhirajmahajan
join shbcf.ru