how to integrate PySpark with IPython and Jupyter Notebook video?

This video shows how to integrate PySpark with IPython and Jupyter Notebook.

To get this done on your machine, make sure that you have installed IPython and Jupyter Notebook.

You can get the commands from Spark official site.

$ PYSPARK_DRIVER_PYTHON=ipython ./bin/pyspark
$ PYSPARK_DRIVER_PYTHON=jupyter PYSPARK_DRIVER_PYTHON_OPTS=notebook ./bin/pyspark