How to Create Datasets in Airflow!

preview_player
Показать описание
In this video I'll show you how to create Datasets in Airflow from S3 prefixes. Datasets are a newer Airflow 2.5 feature that allows you to both visualize how data is flowing between tasks, and trigger tasks based on dataset creation for data driven scheduling!
Рекомендации по теме
Комментарии
Автор

Hey man! Good content! Thank you for bringing this!
But Jinja template refers for files or dynamic variables and uses a different syntax, for Jinja its a double "{", this one its just a f-string format!

ikkik