Data Engineering Trends - What Is Changing In The Data World

Where is the data world going? There recently feels like there has been a plethora of claims being made about deaths of the modern data stack and perhaps new positioning of data teams.

But what is actually going on?

I wanted to host a longer live to discuss possible articles my audience finds interesting as well as talk about trends that I am personally seeing.

If you enjoyed this video, check out some of my other top videos.

Fastest way to become a Data Engineer in 2024 - 100 Days Of Data Engineering

Intro To Databricks - What Is Databricks

If you would like to learn more about data engineering, then check out Googles GCP certificate

If you'd like to read up on my updates about the data field, then you can sign up for our newsletter here.

Or check out my blog

And if you want to support the channel, then you can become a paid member of my newsletter

[SteamPilot]

Hey there, I'm really glad to have folks like you putting out content for data pros here on YouTube. I'm currently searching for my next role as a seasoned data/tech leader, and appreciate perspectives from someone who interacts with the data community and shares their findings, as you're doing here.

One thing I've noticed in the realm of sharing data is folks using BI tools like Tableau to share query results as a component in a dashboard. The cool thing about that is the ability to control access to raw data vs aggregated or anonymous results, plus concepts like row-level security to enhance access control. Now, once the data is downloaded as a csv or xlsx or whatever, then all bets are off from control of access to the data downstream, but it at least offers a first line of defence.

Keep up the great content!

[roooosieful]

thanks for this! helps me stay up to date, since i don't spend as much time on twitter and such these days. i actually moved into product (for data) from analytics, but my intention is eventually being in data leadership (title unknown). i think the main thing I didn't see and still don't really get in the world of data roles is what the career progression really should be for those of us that want to do a little bit more than dashboards/reports. to me it does seem like understanding data engineering is key though.

[maziarzarea]

Great video man. Thanks for the in depth coverage.

[dsadsadsadsadsa]

Awesome vid, please do more like this!

[ChristopherCordero-upxq]

Thanks for the content, I'm new into Data Engineering and this help me a lot. Question you think is easier to break into Data engineering or Software engineering??

[zzaym]

Hey thanks for sharing the insights and it's very inspiring! Would you mind sharing a little bit more about the survey results so we could understand the trend better?