Master Databricks and Apache Spark Step by Step: Lesson 8 - Spark SQL DDL on Spark

In this video, you will learn how to use Spark SQL Data Definition Language (DDL) on open-source Apache Spark with Zeppelin Notebook. DDL statements create and maintain database objects. This video explains the differences between using Databricks and Apache Spark for SQL DDL.

Example Notebook at:

You need to unzip the file and import the notebook into Zeppelin - explained in the video.

[JustinTimeNocap]

Great content. Your teaching style is on point..practical and straight to the point. Spark is really blowing up in the market. Regards from Brazil.

[anthonygonsalvis]

@Bryan, I am using the Databricks Community Edition account for this course. However, I am unable to restart a cluster once it's stopped ('terminated') manually or automatically (timed out due to 2+ hours of inactivity). I see the forward pointing triangle (like the 'Play' button) to restart my cluster, but it simply doesn't work. So I end up having to re-create a new cluster every single time... which is OK for learning (CE) environment, but not OK if I were a paying customer. I'm wondering if other CE users have the same experience with their clusters. Any thoughts? Does it even matter in real-world environment? Or does does such termination mean that the user has to re-configure their cluster every time it's terminated either manually or automatically?

[heekim]

Hi Bryan is setting up hdinsight cluster missing? It only lets me choose "Azure subscription1" and won't let me proceed with hdinsight creation?

[phitran]

I am wondering why we are looking at Zeppelin notebook over the Databrick notebook?

[anthonygonsalvis]

@ Bryan, it would be great if you could create a separate video showing detailed steps of installing and running the free version of Zeppelin notebook. Newbies like myself are not too thrilled about paying for services that are not well understood. It's usually a worthwhile investment once we get to play around with the tool and become comfortable using it before starting to pay for it. Hope you'll understand and can help. Thank you in advance for your consideration.