What is Data Mesh?

Over the last few years a new buzzword has entered the data world - Data Mesh.

Just a simple Google search returns tons of articles on what it is, the key principles & how to use it.

Tools are even incorporating this concept directly into the product.

Yet despite the hype, I've also yet to see it fully implemented at a company exactly as described.

But that doesn't mean it's not an important trend to follow or one to simply brush off.

While a lot of this is still being played out in real time, in this week's video I want to help you better understand what's behind this idea of a "Data Mesh".

That way you can feel more confident talking about it and can decide if it makes sense to implement at your own company.

Enjoy!

Timestamps:
0:00 - Intro
0:23 - What is Data Mesh?
2:13 - Pros & Cons
2:44 - Example Implementation

Title & Tags:
What is Data Mesh?
#kahandatasolutions #dataengineering #datamesh

[narayanaou]

In software engineering world they have DDD ( Domain Driven Deaign), micro services for long time. Data mesh is similar to those concepts, but just applied to data platform world. Its all about modular thinking and applying DRY principles to data.

[tomastruchly]

Worked for a large pharma company as data engineer on Data mesh using also DataOps concepts. Various domains were deveoping datalakes to Snowlake where they were modelled by using Data Vault 2.0 concepts, dbt for trafos etc. Great experience. The big thing by data meshing is also governance of the created data products (datamarts)

[shashankemani]

Is this framework supposed to be used only within the company to organize the organization's data or it can also be implemented in any projects?

[jay_wright_thats_right]

Someone put this man in the military or make him an FBI Agent. Scary dude.

[YEM_]

Sounds like a data swamp but worse. Instead of the swamp being filled by the data team it is filled by business people. Yeah, that's not going to bite us. Hm.

But dbt mesh / cross project refs are a great idea, really. So many good reasons to move on from the mono repo.