Apache Spark 2.x Installation in Ubuntu

Documentation:
export HADOOP_CONF_DIR=$HADOOP_HOME/etc/hadoop
export YARN_CONF_DIR=$HADOOP_HOME/etc/hadoop
export SPARK_LOG_DIR=/home/hadoop/work/spark-2.0.0-preview-bin-hadoop2.7/logs
export SPARK_WORKER_DIR=/home/hadoop/work/spark-2.0.0-preview-bin-hadoop2.7/logs/worker_dir

If scala is not installed follow this video and run these script to install scala
#Install Java

sudo add-apt-repository ppa:openjdk-r/ppa
sudo apt-get update
sudo apt-get install openjdk-8-jdk
sudo update-alternatives --config java
sudo update-alternatives --config javac
or
sudo apt-get install openjdk-8-jdk
sudo apt-get install openjdk-8-jre

#Install Scala
cd ~/work
gedit ~/.bashrc

export SCALA_HOME=/home/hadoop/work/scala-2.11.8
export PATH=$SCALA_HOME/bin:$PATH

#Test scala is installed or not?
scala

[esakkisankar]

sir, Please make a series of videos on Spark2.0

[omkarrom]

Make a video to Configuring Hive on Spark

[nareshdulam]

Hi Venu,
Thanks for the video. It would be help grateful a lot . Keep doing good work

[stuti]

sir, where is your lecture on Zeppelin

[RollsRoyceFanatics]

Oh no you gave your AWS Credentials away!