How to create S3 connection for AWS and MinIO in latest airflow version | Airflow Tutorial Tips 3

How to create S3 connection for AWS and MinIO in latest airflow version | Airflow Tutorial Tips 3

#Airflow #AirflowTutorial #Coder2j

========== VIDEO CONTENT 📚 ==========
So you want to create an S3 connection via the airflow UI by clicking the add connection button. Scrolling the drop-down list, oops, you found no AWS-related connection type. Or you might be lucky enough to find some Amazon-related type, but the S3 connection type is still missing. Don’t worry! In this video, I will show you how to create an S3 connection for AWS S3 or Minio in the latest airflow version. Sounds exciting? Let’s get started!

========== T I M E S T A M P ⏰ ==========
Throughout the course, you will learn:
00:00 - Intro
00:28 - Install airflow providers amazon package
02:24 - S3 connection for MinIO

========== L I N K S 🔗 ==========

========== Connect with me 👏 ==========

[archanakarpebhukan]

'ClientError' error occurred while testing connection: An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid.

I am getting this error but this video is not showing how to create tokens so could someone help

[chineseculture]

Always looking forward to your video ❤

[Millio__reallio]

can you show how to do it without minio, using the latest version I am having trouble connecting to s3 bucket using the connections list. it works if i pass the environment variables into my dag but would like to know how to do it using an airflow connection. thanks

[archanakarpebhukan]

I am getting error "'ClientError' error occurred while testing connection: An error occurred (InvalidClientTokenId) when calling the GetCallerIdentity operation: The security token included in the request is invalid." But this video don't tells about how to create token so please someone help where I am going wrong

[_hariprasad]

An error occurred (403) when calling the HeadObject operation: Forbidden -its shows in log, sir can you tell what problem

[alonsom.donayre]

How to do the connection with a local deployment of minio?

[saichaitanyabondada]

I have an issue

raise error_class(parsed_response, operation_name)
An error occurred (403) when calling the HeadObject operation: Forbidden

How do we resolve it?

[andrewcbuensalida]

'NoCredentialsError' error occurred while testing connection: Unable to locate credentials

[romariogomes]

Hello! I i watched your full tutorial. It was really great. But when a try to connect airflow with Minion throw this error:
An error occurred (403) when calling the HeadObject operation: Forbidden".

I am usign wsl2.
I wrote my connection like that:

{
"aws_access_key_id": "mZtRj1zvXa4uAv0fIRqY",
"aws_secret_acess_key": "7KpTz9q67OEJX1sAN7b02sB803OsYNILXpz5XoSJ",
}

Could you or someone help me? :D