Data Lake Architecture

We will discuss a generic reference Data Lake Architecture in 2 steps
1) Layers or Zones
2) Possible data flows.

We will also touch base upon batch and stream/real-time processing

Related Videos:

Other Areas (Playlists):

[sjvr]

Please do more videos, you are doing a great work and easy to understand way, I saw your last video is 7 months, Please keep doing your communication and content are crisp and easy to understand in a nutshell.

[niveditasinha]

Such an awesome explanation to landing zone, trusted zone and refined zone… waiting for more such videos!

[AjitMaski-rvix]

Very good information provided in crisp format. Looking further for data modelling videos. Great job 👍👏

[igorpinhas]

Your videos are great, don't stop posting!

[amangaurav]

5:21 I think the direction of the three arrows should be towards Sandbox zone (as per what I understood from your words)

[georgekalathoor]

what is an example of the physical structure of the data sink / landing zone ? Is it a sharepoint / ftp location ?

[jameslucas]

Wouldn't the Trusted and Refined zone be a part of your data warehouse?

[payalbhatia]

how database architecture, data lake architecture and dtaware house architecture connected. Please make video with scenario

[biosienceonlinetutoring]

Hi...!!! such amazing videos waiting for more such videos plz upload soon...

[chald]

As per explanation from 5:19 sec, "Data from any of these three zones can be picked up or moved into a sandbox".
This means data can be moved into sandbox also. So, is it required to show bi-directional arrows?

[muralichiyan]

Data Lake Architecture and medallion Architecture both are same..?

[RishabMarwaha]

fundamentally, data from sandbox is NEVER activated or consumed, not even for ad-hoc use cases. The data in sandbox is for research, exploration only, once done, the data pipeline can be built from raw -> standardized -> refined zone.

[qcici]

I think the arrow direction to sandboxes are wrong? Sandbox is picking up data from the other 3 layers not proving data, right?

[rizasanjaya]

should give info where the sandbox area comes from