Amazon Managed Workflows for Apache Airflow: Getting Started

Amazon Managed Workflows for Apache Airflow (MWAA) is a managed orchestration service for Apache Airflow that makes it easier to set up and operate end-to-end data pipelines in the cloud at scale. Apache Airflow is an open-source tool used to programmatically author, schedule, and monitor sequences of processes and tasks referred to as "workflows."

Subscribe:

#AWS #AWSDemo

[KhushbooShah-df]

You may need to check the execution role permissions policy for your environment, and that each of the VPC networking components required by the environment are configured to allow traffic.
How do i resolve this issue? Do we have some reference video to show creation of execution role? And Video to check traffic ?

[JonMarkSearle]

too be true Gabe, my old team have run Airflow for a few years, just in ec2 and it's been extreamly stable. Tenacity, is my favoriate word with respect to Airflow.

[carlosllerena]

Do you have a link of the dag I would like to see your code

[vinayemmadi]

Can we include custom sql scripts/ or other python modules (helper functions) in the deployment?

[GeorgeZoto]

Great resource, thanks for this intro video.

[DeadShotValorant]

Is there any way we can have an active-active replication in two regions ?

[PickingBlueberries]

I tried to create some environments, they all got stuck on "Creating" state and I cant delete them nor get any logs for why its stuck...

[abhinavkumar]

How to access it if I select private network.. I am new to VPC

[riteshpathak]

how to measure mwaa auto scaling workers where it logged

[yugsharma]

It's bullshit and expensive ! Better to run on EC2 Instances