How To Become A Data Engineer - Live Data Engineering Career Advice(ft. Mia Zhang)

3:46 How to move from data analyst to data engineer
4:26 Which ETL tool should you use
5:35 Can you become a data engineer without knowing how to code
6:40 What ETL tools should I use for a project
12:30 How do I get a Jr Data Engineer Position
14:36 Do data engineers need to know Scala
16:21 Do data engineers need to know Hadoop
17:44 Do data engineers need to have CS degrees
20:30 Are cloud certifications worth ing
20:56 What should I do after I finish with my courses

If you enjoyed this video, check out some of my other top videos.

Top Courses To Become A Data Engineer In 2022

What Is The Modern Data Stack - Intro To Data Infrastructure Part 1

If you would like to learn more about data engineering, then check out Googles GCP certificate

If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.


Or check out my blog

And if you want to support the channel, then you can become a paid member of my newsletter


Tags: Data engineering projects, Data engineer project ideas, data project sources, data analytics project sources, data project portfolio

_____________________________________________________________
_____________________________________________________________
About me:
I have spent my career focused on all forms of data. I have focused on developing algorithms to detect fraud, reduce patient readmission and redesign insurance provider policy to help reduce the overall cost of healthcare. I have also helped develop analytics for marketing and IT operations in order to optimize limited resources such as employees and budget. I privately consult on data science and engineering problems both solo as well as with a company called Acheron Analytics. I have experience both working hands-on with technical problems as well as helping leadership teams develop strategies to maximize their data.

*I do participate in affiliate programs, if a link has an "*" by it, then I may receive a small portion of the proceeds at no extra cost to you.

[CalSticks]

Just wanted to say thanks for all of these live sessions, and discussions with the various guests. I think they’re a really valuable source of info - a bit like having a load of work colleagues who are constantly talking about stuff that’s over my head, but are happy to try and put it in layman’s terms so I can understand too.

Recently started playing them in the background while doing other things - and have found that hearing these experts talking around various DE subjects has helped me pick up a load of info in a relatively short timeframe.

I’m prepping for a DE interview next week, and am feeling a lot more confident in being about to talk around DE a lot more easily now!

[boboka]

Your channel is quite informative, DEs from Africa are really benefiting

[shardulkatareaz]

Love your content! Currently, I am working on a Data-engineering project within my company. I need to pull data from different data sources and compile it in excel for Reporting purposes.

The data comes is stored in the following databases - Athena, Oracle and SQL Database, and some from Excel. This data becomes available at different points in time as each is for a different country. Currently this process is done manually and takes about 1-2 days.

I am thinking of building a datapipeline using Apache Airflow. Do you think this is a good solution? is there any alternate approach that I should try? Any guidance/video tutorials on this step will be greatly appreciated. Thank you.

[ahmedtareque]

What is the future of Data Engineering in 2026?

[HarshKukreja]

Hey Ben,
What are your views on "whether data scientist should learn DE skills" topic?
I am personally working as a DS for over a year now. Should I pick up DE skills? I am definitely interested though