Part 1- What is CI/CD? - Continuous Integration and Continuous Deployment in Azure Databricks Demo

#cicd #azuredevops #devops #databricks #azuredatabricks


In this Part 1 video of CI/CD in Azure Databricks, I have discussed about what is CI/CD, how we will be using it for deploying Azure Databricks notebook from dev to prod and the merging techniques that we are going to follow for building the CI/CD pipelines.

The next parts will be uploaded soon, stay tuned!

Part #2- Setting up the Repos
Part #3. Creating CI Pipeline
Part #4. Creating CD Pipeline and Testing

Chapters

TimeStamp:

0:00:00 - Intro
0:01:13 - What is CI/CD?
0:04:51 - Merging / Branching Techniques used in CI/CD
0:09:55 - Outro

– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –– – –

Thank you for watching! If you found Part 1 valuable and want to dive deeper, the full tutorial is available on Udemy. This comprehensive course covers everything you need to know to confidently set up CI/CD in Azure Databricks using Azure DevOps, with practical, step-by-step guidance.

🎓 What You’ll Learn in the Full Course:

Setting up a seamless CI/CD pipeline in Azure Databricks
Configuring Azure DevOps for end-to-end development and production workflows
Best practices in deployment, branch protection, and permission setups
And much more!
If you're ready to access the complete tutorial and gain these essential skills, you can enroll here:

Thank you for supporting my work, and I’m excited to help you continue your learning journey!

– – – Book a Private One on One Meeting with me (1 Hour) – – –

– – – "Express your encouragement by brewing up a cup of support for me" – – –

– – – Other useful playlist: – – –

– – – Let’s Connect: – – –

Instagram: mrk_talkstech

– – – Tools & Equipment (Gears I use): – – –

Disclaimer: Links included in this description might be affiliate links. If you purchase a product or service with the links that I provide, I may receive a small commission. There is no additional charge to you! Thank you for supporting me so I can continue to provide you with free content each week!

– – – About me: – – –

Mr. K is a passionate teacher created this channel for only one goal "TO HELP PEOPLE LEARN ABOUT THE MODERN DATA PLATFORM SOLUTIONS USING CLOUD TECHNOLOGIES"

I will be creating playlist which covers the below topics (with DEMO)

1. Azure Beginner Tutorials
2. Azure Data Factory
3. Azure Synapse Analytics
4. Azure Databricks
5. Microsoft Power BI
6. Azure Data Lake Gen2
7. Azure DevOps
8. GitHub (and several other topics)

After creating some basic foundational videos, I will be creating some of the videos with the real time scenarios / use case specific to the three common Data Fields,

1. Data Engineer
2. Data Analyst
3. Data Scientist

Can't wait to help people with my videos.

– – – Support me: – – –

#AzureDatabricks #ApacheSpark #Sparkcompute #clusters #notebooks #magiccommands #machinelearning #ETL

[mr.ktalkstech]

Thank you for watching! If you found Part 1 valuable and want to dive deeper, the full tutorial is available on Udemy. This comprehensive course covers everything you need to know to confidently set up CI/CD in Azure Databricks using Azure DevOps, with practical, step-by-step guidance.

🎓 What You’ll Learn in the Full Course:

Setting up a seamless CI/CD pipeline in Azure Databricks
Configuring Azure DevOps for end-to-end development and production workflows
Best practices in deployment, branch protection, and permission setups
And much more!
If you're ready to access the complete tutorial and gain these essential skills, you can enroll here:


Thank you for supporting my work, and I’m excited to help you continue your learning journey!

[pshycnnn]

Hi sir, humble request to please upload detailed all videos for Databricks CI CD like on tamil channel. Please sir.. that will be very helpful. There are no good tutorials available and your teaching style is really great. I learnt a lot from your channel.

[rakeshverma]

Hi Mr. K, it's really very easy to understand any layman user. Thanks for providing the complete series.

[SundarKannan_Tenkasi]

voice clear, concept clear and engaging throughout the video

[Velben]

You teach this really well, and that's rare. I just learned DevOps.

[moonalariqi]

really it is the an amazing explanation video of CI/CD . Thank you very much for your excellent explanation. I will follow you and see all your interesting video. Appreciated Sir

[tovinnu]

Clear explanation made it easy to understand. Please upload next video soon. Thank you for the video

[sharaniyaswaminathan]

Great explanation sir. Waiting for the next part.

[destroyer]

great and well explained, you made it easy to understand the fascinating terminologies which one think might be an Alien type of thing. :)
😀

[BasavaPrabhu-qx]

Thanks for the details, I have one question please - In this example Azure data bricks is invoked from Azure data factory, lets suppose If there are any changes to ADF and ADB, how to use the CICD approach to deploy both azure resource(ADF and ADB) to higher environment

[Rajeshkumar-osx]

where is the rest of the video in english on ci cd, i can see playlist in Tamil which i can't understand

[vinaybk]

Superr Boss, Loved all your videos, great efforts and thanks for making such a good content, Keep going boss, best wishes

[ramswaroop]

Hi sir, Why did you removed remaining parts of the playlist 😢 .... We didn't expect this from you .

[jothsonaas]

Why removed videos from this playlist?

[rahulpanda]

As usual, this is another important series..great to have this... Did you also cover any rollback mechanisms?

[sameerkhan-siql]

@mr.ktalkstech
Hey Sir, I thought i have azure ci/cd azure devops videos in members only on youtube but is not there. I am going to pay for your udemy course anyways. Can you refund my money?

[HemantKumar-suqt]

Hi sir
I humbly request you to teach us or let us know how to create the notebooks - Bronze to Silver and Silver to Gold respectively. We have not been taught it in that end to end project. I am confused whether the containers - bronze, silver, gold are merged together? If yes then how? Or are the two different notebooks merged into one? If yes then how?
I have spent a whole day learning them from every possible source where I could reach but it is yet to be understood.
Kindly help me I am a non-cs background enthusiast

Thank you so much

[Jitendra.rautula]

Great. Thanks for the clear explanation. Where can i find the next part?

[RawPowerLifting]

why you removed remaining videos from this playlist?

[moramanitha]

Pls upload remaining continuous videos in CI/CD