Spark SQL for Data Engineering 6 : Difference between Managed table and External table #sparksql

Spark SQL Tutorial Part 6 : Spark SQL Table , Difference between Managed table and External table

Databricks Notebooks code for Spark SQL :

Spark SQL for Data Engineering 1 : I am going to start spark sql sessions as series.

Spark SQL for Data Engineering 2 : How to register databricks community edition

Spark SQL for Data Engineering 3: What is DataWarehouse? OLTP and OLAP?

Spark SQL for Data Engineering 4 : how to create database in databricks?

Spark SQL for Data Engineering 5 : databricks file system dbfs.

Spark SQL for Data Engineering 6 : Spark SQL Table , Difference between Managed table and External table

Spark SQL for Data Engineering 7 : Spark SQL Views, Different types of views, Temporary views

Spark SQL for Data Engineering 8 : Spark SQL Constraints NOT NULL and CHECK Constraints

Spark SQL for Data Engineering 9: Spark SQL DML Operations INSERT Statement

Spark SQL for Data Engineering 10 : Difference Between Truncate and Delete #sparksql #deltalake #pyspark

Spark SQL for Data Engineering 11 : Spark SQL Delta Delete Operations and delete and restore

Spark SQL for Data Engineering 12 : Spark SQL Delta Update Operations #sparksql #deltalake #pyspark

Spark SQL for Data Engineering 13: Spark SQL Delta Restore Operations #sparksql #deltalake #pyspark

Spark SQL for Data Engineering 14: What is slowly changing dimension #SCD #sparksql #deltalake #pyspark

Spark SQL for Data Engineering15: What is SCD Type 0 and SCD Type 1 #SCD #sparksql #deltalake #pyspark

Spark SQL for Data Engineering 16: What is slowly changing dimension Type 2 and Type 3 #SCD #sparksql

Spark SQL for Data Engineering 17: SQL Select Statement column alias and table alias #select #sparksql

Spark SQL for Data Engineering 18: SQL Order By and Sort By Clauses #select #sparksql

Spark SQL for Data Engineering 19 : SQL Join Types inner join full join semi #select #sparksql

Spark SQL for Data Engineering 20 : SQL Set Operators #sparksql #sqlsetoperators #sql #union

Spark SQL for Data Engineering 21: spark SQL group by clause and having clause

Spark SQL for Data Engineering 22: Advanced Group By Grouping Sets Cube Rollup

Spark SQL for Data Engineering 23 : Spark Sql window ranking functions


sql,
sql tutorial for beginners,
sql interview questions and answers,
sql full course,
sql tutorial,
sql for beginners,
joins in sql,
my sql,
sql interview questions,
sql class 12,
what is sql,
sql course,
sql full course in telugu,
sql joins,
pl sql,
sql injection,
sql full course in hindi,
sql commands,
sql queries,
sql server,
learn sql,
sql queries interview questions and answers,
subquery in sql,
introduction to sql for bigquery and cloud sql,
sql project,
sql server tutorial,
sql playlist hindi,
sql tutorial for beginners in tamil,
sql basics for beginners,
stored procedures sql,

sql for data engineering
spark sql for data engineering
data engineering sql
data engineering spark sql
spark sql for analytics
sql for analytics
sql for data science
spark sql for data science
spark sql dataframe
spark dataframe
pyspark sql
pyspark
spark sql column
spark scala
hive sql
hive
spark sql hive
scala
spark hive
python spark
python
spark sql join
spark sql example
sql join
spark join
spark sql query
spark apache
apache spark sql
spark functions
sql server
spark sql functions
databricks
databricks sql

RISING
spark sql dataframe
spark dataframe
spark scala
hive sql
spark sql hive
scala
python spark
python
spark sql join
sql join
spark join
spark sql query
spark functions
sql server
spark sql functions
databricks
databricks sql
pyspark dataframe
spark sql row
what is spark sql
what is spark
hadoop spark
rdd
rdd spark
sql cast
pyspark sql
pyspark
hive
which
databricks
apache spark
sql server
spark sql functions
spark interview questions
sql interview questions
spark sql interview questions
spark sql tutorial
spark architecture
coalesce in sql
hadoop vs spark
window function in sql
what is data warehouse
broadcast variable in spark
pyspark documentation
apache spark architecture ?
google colab
case class in scala

[akashtripathi]

Thank you for sharing the important concepts. I am also using the community edition but when a new cluster is created then I am not able to see any database in the "Data" tab. Rather it is throwing a message saying " Cluster is unavailable; select another cluster". What to do. Do you also faced this issue.

[arshisiddique]

This episode could have been more better, i am still confused if we drop external table so we can create that table again, whatever table we drop we can create those table either it is managed or external, however my question is if we re create external table, so does it rollback dropped table data ?

[dnyaneshwarshelke]

internal table stores data in warehouse and external table outside warehouse directory in hive

[furqanbaig]

can you share the dbc file link to practice

[joshuaodeyemi]

I am getting an error when I try to read the user/hive/warehouse/customers file with SQL.

Here is the error I'm getting -
Error in SQL statement: ParseException:
no viable alternative at input 1, pos 20)

== SQL ==
SELECT * FROM

For perspective, I noticed in your video that the font colour of your path didn't turn blue when you added the single quotes. However, mine is.

I can't move forward from here and I hate this.