Fastest way to Start Your Data Engineer Journey in 2024 - 100 Days Of Data Engineering Crash Course

How do you become a data engineer.

There are lots of skills you need to learn that range from Python, SQL, Data warehousing, etc.

Can you learn all of that in 100 days? The short answer is no.

But if you are looking to become a data engineer in 2024, this video will help you set a baseline! Also check out the checklist below.

100 Days Of Data Engineering Checklist

If you enjoyed this video, check out some of my other top videos.

Becoming A Data Consultant In 2024

Top Courses To Become A Data Engineer

What Is The Modern Data Stack - Intro To Data Infrastructure Part 1

If you would like to learn more about data engineering, then check out Googles GCP certificate

If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.

Or check out my blog

And if you want to support the channel, then you can become a paid member of my newsletter

0:00 Intro
2:19 How To Use The Data Engineering Checklist
3:59 Kicking Off Your 100 Days Of Data Engineering
4:12 Days 1-10 Of Data Engineering The Basics
6:02 Days 11-40 Deeper Dive Into Python, SQL, Data Warehousing
7:57 Days 41-50 Building A Mini Data Project
8:52 Days 51-70 Survey Of Data Engineering Tools
10:32 Days 71-100 Data Engineering Project

Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio

_____________________________________________________________
_____________________________________________________________
About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.

*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

[moradabbouazaz]

This is really funny because this year my company offered me the posibility to enter the Data Department (I'm a Software Dev.). I'm kind of fed up with coding everyday and for now I'm learning Elastic Search, Apache Nifi and Airflow, then I'll head to Spark and AWS. This video is pretty intereseting to serve as a guidebook. Thanks for stressing the part of "What have you learned so far?"

[gobrax]

This couldn't have come at a better time for me, and a free sheets document to track all of this? So valuable, thanks!

[jameshizon]

One potential key topic is how to bounce back from difficult client/project that did not go as successful as desired (especially in data consulting if you have had that experience). For me, because of this experience, it made me lose confidence during a client screening to try & explain this experience & re-frame it as positive.

[tenzinnamdhak]

Will be following your map for the next 6 months as I am into 9-5 routine.

[Yavin]

Data Engineering means different things to different companies. For example, you don't list SAP as a core competency, but some companies do. WIth that said, isn't it better to pick a lane and stay in it? I.E. one or two of the cloud providers, AWS or Azure or GCP, and master data engineering, data analysis, machine learning, AI services, etc.

[yeaaayeaa]

looking into this now, solid background in data primarily SSIS, informatica, Alteryx with a good amount of "BI" work. Thanks for this guide, we use Azure in our current work environment but mostly only at the corporate level. I'm going to challenge myself to follow this guide so I can transition into being a data engineer!

[travishawks]

Thanks for the video. Another video idea would be one for finding / getting your first DE job. It's a bit of a struggle finding entry DE positions

[arulnidhi]

Thanks for sharing brother! I'm just going to stick with this plan.

[HI-bwfe]

Thanks for the 3m plan. Exactly 👍🏼 just what I need!

[EndlessLearner]

Like number 1, 000🎉 Great video! I’m going to start this challenge, you gave us a lot good information😎

[madukomablessed]

Hi Ben, awesome roadmap, even though you are yet to update some parts such as the article you are yet to upload and the live Q and A😂

[waynelast]

Please make another video for people who are new to the field

[mintlatte]

Would pet projects be enough to show some knowledge of Spark/Databricks or Azure? I feel like without previous real work experience it's impossible to even land an interview for any data engineering related position.

[antgonz]

Hi, I recently decided to change my career into the data field and interested in data engineering. Your channel has been very helpful thank you.

My question is, I never coded before. Would you recommend taking a Computer Science course as a prerequisite to have a baseline foundation on computers and coding? (For example: Harvard CS50 course?)

[gogyoo]

The spreadsheet points to the AWS Solutions architect cert course. It's 10 hours long. Since then the same author published a 50 hour video as an update. Is it worth it to go through it all?

[jagannathishere]

can we get into data engineering with no experience? I'm good with Python and SQL.

[daniell.]

I have a video idea for you.

What would be an example of the minimum project portfolio to begin applying for jobs without previous engineering experience? Like 5 legit projects that include ____ & & ____? I have no idea what's a realistic amount of coding to be considered for a coding entry level job....

[kiranyeluru]

Great awesome...best wishes from kiranu😢

[diegowargenosky]

I am doing the IBM Data Engeneering course from.Coursera. I hope to be ready to create a project and get hired for a first job after that.

[brainydel]

Thanks alot for the roadmap man! I appreciate. I just have a question for the cloud services like GCP, AWS courses should I take them all or just pick one. Also many are suggesting GCP. What's your take