AWS Tutorials - Create Data Lake with Amazon S3, Lake Formation and Glue

Ready to build a data lake - well a small one. In this workshop, you will keep two data sets sales and customers in Amazon S3. AWS Glue is used to catalog the data. You then use AWS Lake Formation to provide specific permission for the salesuser and customersuser users for the sales and customers tables. The users will use Amazon Athena to query the data as per the permission defined.

[vivekjacobalex]

super dojo. before i stepped into this video, data lake was a different planet for me. now you took me to that place and showed the highlights of it. thank you

[maryo]

Fantastic, I have been looking for a detailed explanation on how to create Data Lake not until i found your video..This is well explained, now I can follow your steps to create my own Data Lake within the AWS console before I automate this with Terraform.

[lznompi]

Thank you so much for the very detailed tutorial! Was searching around for tutorials and noticed that the tutorials out there were either outdated or missing some information, so glad that I found yours!

[muralidharanmurugan]

Thank You much.Got a Good video to understand AWS DataLake.

[nestonalex]

This what I was exactly looking for... Thank you so much.

[gentlecraftsman]

Very neat tutorial, I was able to practice and learn the functionality and use case. Thank you!

[Akash]

Exactly what I was looking for, thanks.
Would like see more such videos.

[sujitbehera]

Awesome presentation and tutorials .. Keep it up with this good work for AWS user community .

[niluparupasinghe]

Great video, saves my time and learned what is essentially relevant, thanks a lot. Please keep up the good work!!!

[leonidb]

Awesome material, thanks a lot for your effort.

[ankitatiwari]

It was really wonderful video, you provided detailed steps which helped in understanding well, though the video is outdated now but helped alot.If possible do make a video on lake formation using Glue blueprints(instead of crawler).

[GlowGineer]

Great Great tutorial!

I have one request,

From where i can download sales and customer data set ?

[shayankabasi]

@AWS Tutorials- Thanks for amazing video, please advise when the crash course is coming on Glue and lake formation. eagerly waiting for that..

[bhatiamadhurful]

Great great explanation. I have two questions

1) in data lake when we have producer and consumer how does data encryption (KMS) work along with lake formation. Just to ensure apart from IAM access data is secured with proper encryption

(2) in data lake when we have producer and consumer as two different AWS accounts (2 VPC) how does these two VPC communicate)

[muneeswarana]

Can we implement the upsert logic in data Lake formation using glue for large data?

[fanig]

Nice tutorial great job. it did helped me

[gayathrichakravarthy]

Thanks for the tutorial. Would it be possible to import JSON files instead of csv? Thanks

[alladamk]

Hi, thanks for providing detailed steps on data lake, lake formation configuration and usage. It would also be helpful, if you can do specific video on ingestion process (file based and relational db).

[krishnat]

You did not talk about securing under lying s3 buckets. Does lakeformation have options to tighten security at s3 level as well ? Otherwise it is not 100% secure imho.

[patricktan]

Great presentation and workshop. I have a question. Even if data is protected from salesuser and consumersuser via Glue database, it is not protected via S3. salesuser and consumersuser can download files from S3 since they have full S3 access. How do you protect against this?