Intro To Databricks - What Is Databricks

What is databricks?

How is it different from Snowflake?

And why do people like using Databricks.

This video will act as an intro to databricks.

We will discuss what is a databricks table(delta table), a databricks job, etc.

0:00 Intro - What Is Databricks
1:02 Presentation
6:29 - Hands On Demo - What Is Databricks

If you're team needs help setting up Databricks, then set up a consultation with me today!

Also! If you enjoyed this video, check out some of my other top videos.

Top Courses To Become A Data Engineer In 2022

What Is The Modern Data Stack - Intro To Data Infrastructure Part 1

If you would like to learn more about data engineering, then check out Googles GCP certificate

If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.

Or check out my blog

And if you want to support the channel, then you can become a paid member of my newsletter

Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio

_____________________________________________________________
_____________________________________________________________
About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.

*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

[anishninan]

The best part about databricks is that is unifies batch and streaming workloads.
Also provides a single source for structured, semi structured and unstructured data.

[rachidt]

Would be cool to see a mini project in databricks where you could compare and highlight why you don't see it as a data engineering / BI first tool

[gardnmi]

I've used both. Snowflake is toast. Serverless Clusters will take away the pain of managing clusters and they are making really fast improvement on delta lake which will reduce a lot of the common pains of filter, joins, and updates in spark.

[kerimsever]

Transitioning into using Databricks and this is a great introduction!

[NroShock]

Great video! Would love to see another one on Databricks; moving raw data from blob storage, transforming and storing in databricks tables

[jackgolding]

Had this on while I was working and it just clicked to me, thank you!

[devencareer]

Your approach in this particular video, is simple and precise, not deep, just right enough. Thanks! Devendra

[hughesadam]

Super helpful - have been using databricks in another system without ever really understanding how much of that other system was simply databricks.

[codestrap]

Awesome breakdown Ben. I'm looking forward to a comparison with Foundry. My personal opinion is Databricks has the edge when it comes to their pay version of Spark and Delta. It's hard to do a direct head-to-head though because many of Foundry's overlapping capabilities are not documented. IMO Foundry has much better e2e capabilities with a built-in version control system, online IDE, CI/CD, and Data Apps/ML/AI tools. I'm a huge fan of both companies and really think these are the two players that will be left standing at the end of the Big Data OS wars.

[ShashankData]

🔥 video! Learning so much from your vids man. I’m not really getting the effective difference between DataBricks and Snowflake.

[akshaybaura]

great starter !! it'd be interesting to dive a little deeper into delta lake file format and also compare it with iceberg or hudi formats i.e. where they are similar, different, which situations suit one best over the other.

[artandrockall]

really cool all around video, would love to see more videos on databricks where a more deep dive analysis would be given on each topic ;)

[severtone]

You earned my sub. I am all in. Thank you for this, it was a great help!

[dahof]

Wanted to watch but can't filter that goofy background noise.... Everyone does it and it adds negative value to the listener.

[BuyNLarge_]

🎯 Key Takeaways for quick navigation:

01:36 *🚀 Databricks offers managed Spark services along with other tools like Delta Lake and MLflow, providing options for data processing and model deployment.*
03:56 *🏠 Databricks and Snowflake both promote the concept of data lake houses, combining data warehouse and data lake functionalities, but with different emphases on use cases.*
05:37 *🛠️ Key components of Databricks include workspaces, notebooks, tables, clusters, jobs, and libraries, providing an integrated environment for data processing and analysis.*
09:33 *📊 Databricks simplifies the transition from notebooks to production by allowing users to create jobs directly from their notebooks, enabling seamless integration and scheduling.*
11:13 *🌟 Databricks facilitates easier productionization of data science workflows compared to alternatives like Snowflake, with integrated features like job creation and version control.*

Made with HARPA AI

[alineremy]

Super! Thank you so much for the video!

[edwinfokobo]

I love this an would love to learn more and understand what’s needed as a prerequisite before I can get a job

[hotpeppermovie]

Databricks is awesome. Its so easy to work with

[surfhr]

I'm new on the subject, well explained!

[mashagalitskaia]

a really cool introduction, thanks a lot!