How to Build a Cloud Data Platform Part 1- Architecture

In part 1 of this 4 part series, you'll learn how to combine the best of data warehouses and data lakes into a simple and unified approach with Delta Lake, for improved data reliability, performance, and operations. The How to Build a Cloud Data Platform technical training series explores how to use Apache SparkTM, Delta Lake, MLflow, and other open source technologies to construct your Cloud Data Platform with Databricks. These virtual sessions will include concepts, architectures, and demos.

At the end of each session, you will be given redemption codes for additional free Databricks self-paced training and/or demo notebooks for hands-on practice.

ABOUT
Databricks provides a unified data analytics platform, powered by Apache Spark™, that accelerates innovation by unifying data science, engineering, and business.

Connect with us:

[vikasmca]

One of the best presentation on the data architecture available in YouTube.

[akashalilili]

Very well explained the concept of datawarehouse, datalake and how delta lake can help in realtime processing & availability of data.

[NicolasPappasA]

This was an amazing breakdown of the architect, technology and approach! Thank you Doug and Databricks!

[ajajaj]

Thanks. Awesome as always. This has become my fav place to learn spark ♥️

[NeerajGarg]

Thanks for making such a series public.. This would help a lot of professionals like me. Have following queries
How to handle indexes? Is it possible to create/apply indexes on the data being stored. As per my understanding of spark so far is that, it would have to be handled during querying ( either using SQL or any programming interface like Python or Scala or R). Is my understanding correct?
How to handle sorting? Again, my understanding is similar to above mentioned point by me?
Please see if you can confirm.
Thanks

[virendradeshmukh]

Its too much informative ..thanks so much DataBricks

[ThesamBETH]

This is very informative. I would definitely love to try out Delta Lake

[waqarahmad]

Great session. Is it a good idea to migrate an on-prem datawarehouse to a cloud data lake? Or it should be migrated as is to a cloud DWH?

[rushikeshbulbule]

Thanks Databricks for awesome uploads.... .

[SuperLano]

Where I can subscribe in this video series ?
I google it but don't find.
Thanks

[krish_telugu]

I have a question, so the delta Architecture which is the 3 layers(bronze, silver & gold) is it visible externally or is it all under the hood?

[zeeshanmirza]

Where can I get Notebook used in Demo? Please share the link of Notebook, thanks

[vidoemakenoke]

Hallo ik Kan waar je over hebt ook over merk