Tutorial 7- Pyspark With Python|Introduction To Databricks

Databricks is an open and unified data analytics platform for data engineering, data science, machine learning, and analytics.
From the original creators of Apache SparkTM, Delta lake, MLflow, and Koalas.

Subscribe my vlogging channel
Please donate if you want to support the channel through GPay UPID,

Please join as a member in my channel to get additional benefits like materials in Data Science, live streaming for Members and many more

Connect with me here:

[alihaiderabdi]

sir, watched all pyspark sessions, awaiting for further videos like aws and databricks as you have mentioned, please sir upload that as well.

[moeintorabi]

Hey Krish, thanks for your great content; I was wondering if you're planning to make more videos in this playlist on how to use Databricks within Azure or AWS?

[sankyppp]

Sir please make a short video on job search and more importantly about salary expectations for people who are making a shift to data science from another industry like BPO, insurance, sales etc.

[ankitpancholi]

When running the Cell you were getting an error "Failed to create..." because the notebook was not linked to any cluster. On top left you could see "Detached". If you had updated that to the existing cluster then it would have worked. You didnt have to delete other files.

But overall a very good video. Hence thumbs up!

[SuperFatafati]

Not because of two files, your cluster was still not up that is why it was failing to execute.

[alanhenry]

Hello sir can you do a project on spark, kafka...streaming ..etc??

[gaikwadpallavi]

Sir plz make statistics tutorial for data science 🙏

[pradipawasthi]

I want a serious help from you..actually I have a sequence data i.e., a single row data I want to split the data into multiple rows after every 5th delimiter ('|') how can I do that??

[priyamghosh]

Sir please make a video on IBM Watson studio.

[shikhasharma]

Sir, I am not getting the Databricks screen like you(New Cluster, notebook etc), When I enter to this site it's just ask me for standard/premium plan.
Is this still available for free?

[krishraj]

sir, I am a little bit confuse about ML that where to start from your channel playlist. there are so many playlists related to ML

[satyamtripathi]

Sir whenever u upload video on bert and transform please tell us like how to use pretrained model and how to build own model and everything bcoz sir i have learning everything from ur channel and now i am implementing many things but sir when it comes t9 basics about how everything works ur channel is best sir even for advance also sir.
And ones again its a request sir please explain everything related to vert and transform and sir if there is any course where you can or Sudhanshu sir or any sir you know who can teach me bert and transformers i am ready to pay any fee related to that sir like 4k, 3k, 5k sir 🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻🙏🏻❤️

[TheVickramsharma]

Hi @Krish, What is meaning of title of this video "pyspark with python"🙃