Data Engineering Road Map - How To Learn Data Engineering Quickly( By A FAANG Data Engineer)

How do you go from 0 to data engineer?

What is the road map to data engineering?

These are all valid questions that I will walk you through over the next 15 minutes.

The purpose of this video is to help you break down all the various skills we seem to need to know as data engineers in 2021 into manageable bites.

So you don’t feel overwhelmed, but instead have a clear path from where you are and where you need to go as a data engineer.

Also, here is a link to the data engineering roadmap I reference in the video. With links and everything!

Wherever you are in your data engineering journey. Good luck!

So good luck with your DE career. And here are some more resources you may enjoy:

What Skills Do Data Engineers Need?

Data Engineering Project Ideas

If you want to learn more about data engineering, check out Google's Data Engineering Course

If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.

Or check out my blog

Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio

About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consults on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.

*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

[Symmetryful]

I find it interesting that so many of these roadmaps focus so acutely on technical skills. Frankly, I’m not sure how valuable it is to learn AWS to ‘get into’ data engineering. You’ll learn this skill on the job when you get to it. Also this type of technology is highly dependent on what field you end up in. Lots of companies in the finance and insurance sector are nowhere near ramping up to AWS.

I think learning the concepts of data storage, ETL pipelines and data warehousing - as well as having a general ability to write code in, say, Python - ought to suffice as a starting point.

The hard part about technical roles like data engineering isn’t really writing the programs. The hard part is the softer skills involved and understanding the domain you’re working in.

[xA]

Learning about containerization from the outset is an important skill. Start by packaging an application such as an API and then perhaps containerize other components or processes such as data acquisition, cleaning, and loading into a database from which your API draws its data. Persistent data storage containers as early as possible will be useful.

[LukeBarousse]

Loved this road map that you shared! Also liked how it integrated learning, projects, and then building further. Solid! 🙌🏼

[kalydrae]

Don't worry... 15 years into my it career I still write hello world projects for new technologies and languages!
Great video thanks.

[DeezSkates]

Excellent video. The hardest thing about working in IT has been that every time I make a move to further my career, I find I have to build my own road map. Problem is, it’s impossible to know what all exists because there is so much. And every person you ask will give you some different list of things you need to learn, with no real concept of how it all fits together. As the technology expands, the need for roadmaps becomes so much more important than in previous years.

[fioivys]

Thanks for the roadmap, im working as a developer for five years. Juz turn my mind to focus more on data engineering stuff starting 2022. It will be a good start to come across with the items mentioned in the map. Hope I can be a better man after the effort made. 2022 Wishes

[LayaWhite]

Thank you for this - it's exactly what I was looking for. I have some SQL skills and I work with relational databases, but I want to make a career shift into Data Engineering. I was starting to get overwhelmed by all the options!

[CarlosMorenoV]

Amazing!. I am a Python software developer, so I have a background in making APIs and Unit Testing as well as some skills using Docker. But definitively I need to understand how to model Data Warehouses, and some cloud tools and play with Luigi or Airflow. I felt happy watching your video because I realized that I am on the correct path. I have a nice number of tools in my bag, but I have to keep working to get the other ones.
Thank you for this great video and excellent road map, mate.

[harveymitchell]

Thank you for this roadmap. I have a background in IT and I’m trying to make a lateral move into a jr data engineer role. I’ve been studying for 5 months now with UDACITY, and up until this video I still had no idea how to correctly maneuver into a DE role without feeling overwhelmed. Thanks 🙏🏽

[kinarapandya]

Please continue making videos on Data Engineering. They are very helpful !

[MahmoudElaskare]

Thank you so much, I was desperate navigating the diagram shown in the beginning (actually it was hanging on my wall giving me anxiety about actually being able to finish it)👍

[knightsavage]

This is awesome, I'm currently a data analyst and I have been searching for a way to make the switch to data engineering. Thank you for compiling and breaking down the tons of information that is out there.

[anthonyphan]

This guy posted this for 6 days with nearly 400 likes and not a single disliked. That make me definitely give him a subscription

[viswajitnayak]

Thanks ... i have been working towards transition to a data engineering role and I see this is the most concise path...
Thanks seattle-guy

[kocermehmet]

Hi! I started a data engineer internship that week and I find myself here. Your video is great as I think It should help me. I didn't know where to start and how to use my time efficiently so a huge thanks for the video and the roadmap!

[PaulMisner]

Thanks. I got thrown into a data engineering role because of a unfilled vacancy. I'm trying to skill up for the position. This was a real help.

[carlobisda]

love this kinda videos, still relevant in 2023. i started a data science course but it wasn't really my jam and i tend to lean towards backend stuff anyways. <3

[matthewgin]

Very informative. I'm taking udacity's data engineering nanodegree and we're doing a similar roadmap. Good job!

[ridge_]

Thanks man! I'm a HRIS and Reporting Specialist looking to make a switch to the other Data scene. I found a lot of your videos very down-to-earth and concise to learn more about Data Engineering.

[elimgarak]

Learning DE is like being trapped in vendor tool hell. There are so many tools it is really overwhelming. Thanks for this vid.