How To Become A Data Engineer: My Story On How I Went From Analyst To Data Engineer

How do you go from data analyst to data engineer.

Some people like being analysts, others want to be data scientists and still others like the idea of being data engineers.

But how does an analyst become a data engineer.

If you need to learn more about being a data engineer, then consider some of the resources below.

What Skills Do Data Engineers Need?

If you want to learn more about data engineering, check out Googles Data Engineering Course

If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.

If you like this video, then subscribe to the channel!

Or check out my blog

Back to my story:

Early in my career I started as an analyst working in healthcare but I eventually found myself in the role of data engineer at a FAANG and it's really been a great learning experience.

Along the way I learned how to operate on an engineering team.

How to follow good engineering practices and just in general, develop maintainable systems.

Now that companies are starting to hire even more rapidly for data engineers, I wanted to provide my story for how I went from being a data analyst to data engineer.

From taking the initiative to develop products, to self learning. All of it was required to really challenge myself to be a DE.

Thanks for reading and good luck on your data engineering journey.

Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio

About Me:

I have spent his career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consults on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.

*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

[sudhir]

The video is so relatable. It's been two years working as a data analyst and I want to move towards engineering and this video happened. Thanks.

[ianfelton]

I also started as an analyst and then moved to data engineering. The cool thing about that route is that you can practice data engineering within the scope of an analyst role. For example, you can take over parts (or all) of the data delivery process feeding your analyst work.

[YourMakingMeNervous]

I've been an analyst for the last 2.5 years and I just signed the contract for my first Data Engineering gig! I'm so excited and I owe a lot to your videos when it comes to understanding the field a bit better. Thank you.

[Ok-mfdt]

Every data noob needs to be subscribed to you. What a treasure trove

[RifqiAbidin]

Thanks for your video! I have been working as an analyst back then, and now I'm in transition to data engineering role. Will be back once I landing my DE job.🤞

[shellShock]

I’m actually looking to do the reverse (sort of): DE to DA hahhaha
Although tbh, if you work with data you’ll end up being a bit of both regardless.
I started looking more into Data Analysis cause it’s sometimes a pretty crucial step in the decision process of building a pipeline or developing some analytics process.

At the end of the day, IT people gotta be wearing lots of hats to ultimately get the job done.

[FafoGamer]

Man i've been subscribed to your newsletter for so long and we are on idenitical paths. I am transitioning from Analyst to Data Engineer as well.

[McClowd]

I am currently in your position as data analyst.. I feel like I wasn’t learning anything…not gaining much knowledge skills. I’m looking into company that’s has new system software. Health company would be good one and any technology companies. I’m glad that I came to watch your video!

[MilanManise]

Great video Ben! Also, thank you for your useful tips in the Facebook ds group about focusing on one area and specific skills that match SWE, DS & DE. Greetings from the Netherlands

[italomendez]

I'm currently working on a data ingestion project on my data analyst job. It's been really challenging since my experience is only with python requests and APIs. Thanks for the motivation!

[garcialovesme]

I've been an MI analyst for 3 years and have an interview for junior data engineer next week. Thanks so much for your insight, it's great to know how you've developed! You're a great inspiration!

[PixelsWorkshopVideos]

warm words coming from you! Thank you so much for the "feet-on-the-ground Motivational Video"

[dmiradakis]

Thank you sharing this. You are covering a very unique topic early on which is genius. I’ve been reading up on Data Engineering a LOT the past few weeks, and I’m beginning to wonder if that suits me more. I am desperate to adopt software engineering principles on my way to one day becoming a Data Scientist, but I want to be fully functional. I want to be able to do Data Engineering, Database Design, Analysis, ML training, and MOST OF ALL, Deployment. As I said, I’m desperate to do more coding now. I teach myself ALL the time off the clock about advanced software engineering. I never get to code anymore at my job, I’m not even allowed to build much in SQL. It’s been very demoralizing, because I can do all of these things, so I’ve been asking myself if this is my next step. I just want to code again.

[ampersignia]

I appreciate you covering this topic but it was mostly just how you personally made the transition instead of how someone else could reasonably make the transition. I’m trying to do this myself. Do you know of key words to look for in job posts that may favor someone who used to be an analyst?

[BJTangerine]

Thanks for your videos on data engineering, they seem very grounded and more relatable than a lot of other testimonies out there which usually talk about already going into the DE field with a masters in computer science, a million portfolio projects and infinite related experience going into it. I recently quit my job and enrolled into a Data Analyst bootcamp to start a new career in it, and a quarter of the way in I learned more about DE on the side and decided that's what I want my new career to be in.

After the DA bootcamp, I plan on taking Coursera's "IBM Data Engineering Professional Certificate" program. Is there anything else I can do to try and maximize my likelihood of landing a DE job afterwards besides listing projects on my resume and continuing to network with companies/people already in the field?

[txreal]

Been subscribing to your great contents. But I'm not even a working Data Analyst yet?
Been working on a few beginner SQL and R projects and some MOOC classes and move forward from there. Working on Capstone for Google Data Analytics Certificate.
Hopefully I get lucky someday. Thanks for sharing.

[nevada_jinks]

@SeattleDataGuy do you think you can go straight into data engineering without being an analyst? With some respectable SQL and DE certs + programming knowledge and a big portfolio project?

[dailyglasses]

Hi Ben, I was once a Data Analyst and Business Analyst too. Last week I was just had my first day as a Data Engineer in a startup. I think I am now in a "cut my teeth" stage since I can now apply what I have learned in real world problem. I am kind of afraid that I will lose my desire to learn because of working. How can you maintain your curiosity and willingness to continuously learn?

[sylvainbodji]

Hi, i really like your story. i have a masters degree in epidemiology and just completed my web dev training, in the process of launching my first real world App (react nodejs mysql) for a local business. i'm really interested in data engineering i'm looking to start in a few months. how was your background in epidemiology usefull on your journey as a data engineer ?

[sakuramahbuba]

I am working as an data analyst but I am looking for good opportunities to work with data in higher level rather than use only some sql/linux command to analysis. I am thinking of doing masters in data science which can help me to do research in future in data sector(bioinformatics or something like these type of significant field) . Should i do masters in data science or data analytics& business or some other field?? please suggest.