Sync an Amazon S3 Bucket to a local folder // How to upload and download S3 buckets with the AWS CLI

In this video I will show you in 5 minutes or less how to sync an Amazon S3 Bucket to a local directory and upload or download changes to and from Amazon S3 using the AWS Command Line Interface (AWS CLI).

ABOUT THIS VIDEO:
In this video, you will learn how you can use the AWS CLI tool to up- or download an entire bucket to or from Amazon S3 using the aws sync command.

#AWSTips #In5MinutesOrLess

LINKS TO LEARN MORE:

ABOUT AMAZON S3:
Amazon Simple Storage Service (Amazon S3) is a cloud-based object storage service offered by Amazon Web Services. It offers industry-leading scalability, data availability, security, and performance.

This means customers of all sizes and industries can use it to store and protect any amount of data for a range of use cases, such as data lakes, websites, mobile applications, backup and restore, archive, enterprise applications, IoT devices, and big data analytics.

Amazon S3 provides easy-to-use management features so you can organize your data and configure finely-tuned access controls to meet your specific business, organizational, and compliance requirements.

ABOUT THE AWS S3 SYNC COMMAND:
The AWS CLI sync command syncs directories and S3 prefixes. It recursively copies new and updated files from the source directory to the destination.

TIMECODES:
0:00 - Intro
0:08 - How to upload and directory files from S3
0:38 - Demo: Upload an entire local directory to S3
1:14 - Demo: Sync new files and changes to S3
1:43 - Demo: Download an entire S3 bucket to a local folder
2:20 - Summary

FOLLOW ME ONLINE:

ABOUT THIS CHANNEL
My name's Dennis and I share tips to help you grow your Amazon Web Services (AWS) skills, build well-architected applications, and learn the best tools and skills required to help you on your cloud journey. If you're a developer, business owner or hobbyist who is interested in learning about AWS and the cloud make sure to subscribe for helpful training videos.

I’m AWS Certified (SA Pro, DevOps Pro, and Security Specialist) and have been actively developing for the cloud since 2011. Over that time I've helped countless developers and businesses build their applications in the cloud through training, content, and consulting. I'm also directly working at AWS as a Developer Advocate and Technical Evangelist, taking care of the builder community in Germany, Austria, and Switzerland.

If you have any questions or want to request a topic or tutorial just leave a comment on any of my videos and I'll see what I can do to answer it.

Thanks for watching, welcome to the cloud!

[cmuhammad]

So downloading directory from s3 will overwrite similar contents on local machine or download fully if no similar contents

[foobar_codes]

Thanks Dennis! This is great for backups

[DTraub]

If you want more content like this, like and subscribe. Let me know in the comments what else you'd like me to cover.

[dallascamp]

for some reason, I am getting a unknown options for the " . " . I am trying to download a specific folder in the bucket

[ctnava]

does this create a GET for every file, even if unchanged?

[warrengleeson]

Great Vid thanks, this is a one time upload though right? It's not persistent? Is there a way to create a folder on your PC that is permanently synced with a bucket?

[SocialAnimal_]

hi bro i have a bucket which has 3 folders. is this possible to show only one folder to a user? don't want to show all folders in bucket.

[multitaskprueba]

Fantastic video! Thank you! You are a genius!

[RobDeFeo]

This is super useful, thanks Dennis! Can I sync a sub directory in the bucket or does it only sync the whole bucket?

[dhanukawickramasurendra]

any way of automating this with something Local? like a bash script?

[vishalk]

does s3 sync work for other storage classes as well

[ManoharS-exth]

is it possible to download entire bucket with python coding using boto library ? Thanks !!!

[juanccalderon]

I think you missed to describe --delete option. If you delete a local file and sync with the S3 bucket is not going to delete that file on S3 unless you use this option :)

[XCTDEV]

no avilable closed caption please next time mark enable CC

[bebebe]

it's only 1/3 of the tutorial, you could make it much better. don't assume that everyone thinks or now everything like you.