Master Databricks and Apache Spark Step by Step: Lesson 31 - PySpark: Parallel Database Queries

This video shows you how to read data from a SQL Database from Databricks/Spark using Python using parallel reads so you get back partitioned data. SQL databases are the most popular platform for storing data so you are going to need this in your toolbelt. This video picks up where Lesson 30 left off and provides better performance.

Join my Patreon Community and Watch this Video without Ads!

Twitter: @BryanCafferky

Notebook with Code at:

Video on Creating an Azure SQL Database

Video on Creating an Azure Key Vault

[muhammadzulqarnainbutt]

Hi Bryan, Thank you for this video. This is a unique and a million-dollar video. Much Appreciated.

[gonzalofuste]

thank you very much Bryan for the time invested in these tutorials, I am learning a lot and I am loving the way you teach.

[amanchauhan]

Hi Brain, Thank you so much for your informative content it really helps me a lot, can you please make a video on how to read data from DB2 with parallelism without patition column and without modifying the sql query

[sanjaynath]

Hi Bryan! Great video.Learning a lot from this series. Wanted to know, do you have any videos planned for Spark optimisations/internals? Thank you.