Data Engineering Expert Reacts to AWS Architecture at Veritiv

► Link to the original video

►Learn Data Engineering with my Data Engineering Academy:

►LEARN MORE ABOUT DATA ENGINEERING:
-Check out my free 100+ page data engineering cookbook on GitHub:

►PLEASE SUPPORT WHAT YOU LIKE:
Just use this link whenever you buy something from Amazon:

(As an Amazon Associate I earn from qualifying purchases from Amazon)
This is free of charge for you but super helpful for supporting this channel.

#AWS​​ #ThisIsMyArchitecture

[gpavanb]

Great work! I was watching your videos along with the AWS series for a lot of my data engineering knowledge. What was missing in the AWS videos was the reason for their choices and you are very nicely filling the gap. I'm open to collaborating if you want to do this for more of the series also 😀

[iitravindra]

At 4:25 he is explaining how lambda pulls metadata of file from dynamo db. They are using it as metastore for the files they are suppose to receive from s3.
Most of pipeline do these validations to make sure the process validates the schema of files before getting processed. This act as a contract for data lambda supposed to recieve.

[AbdurrahmanKocukcu]

This reaction/review concept is so valuable and pleasant. Please continue :)

[andersboje]

I don't hear they are adding the file content into DynomoDB as you mention. My guess is that this is only the metadata of the file they storei DynomoDB.
I have done this my self and seen others do this for Data Governance. Store info like when was file received, filename, md5 etc
In the data lake I would assume they concat the file into bigger chunks

[arockianirmal]

Really awesome! Looking forward for more similar reaction videos!

[ChristFan]

This was excellent. I learned a lot. I hope you do more like this.

[rohitkumarz]

Very insightful.. as an enthusiast.. i find videos like this very great from the point of learning... I can see a lot of students and new graduates finding the breakdowns of these architecture useful and helpful.. thankyou Sir

[Larry]

This is unmatched. I recently enjoyed a similar book, and it was unmatched. "Mastering AWS: A Software Engineers Guide" by Nathan Vale

[justsomeguy]

I really appreciate the insight in these videos. I'm currently learning data engineering in AWS so I can try to assist the supply chain company that I work for with projects like these.

[shauryajain]

Is future of de bright since lots of tools are coming up