Airflow tutorial 4: Writing your first pipeline

In this video, we will learn how to write our first DAG step by step.

Please Subscribe! And Like. And comment. That's what keeps me going.

⭐️Want to learn more from me? Connect with me here:

[haciendadad]

Great job on this video. This is just at the right level of explaining and the pace is good too! It is hard to find anything on AirFlow, so I am thankful for these videos!!!

[sbmaggarwal]

This is a very good example for starting with Airflow. I got it working under 20 mints (10 mints if you follow the blog), really nice.

[richardisaac]

A really useful series of tutorials - has been hard to find such a good explainer of Airflow & Composer!

[tinaxu]

Great tutorial, clear and short, well organized. 👍💖💯

[aaa]

Best Airflow tutorial - Nicely presented.

[abhisheksingla]

Thanks you so much for this video. I'm facing one issue. When you stop the docker-compose it erases complete setting like all logs and variables which you've created in a session. How could i retrieve the logs of previous session if I restart my docker-compose?

[rotichbill]

Thanks for the video... this is a really good high level explanation of getting started with the DAGs concept with AirFlow

[michellegoogleuser]

Excellent Airflow series videos, a spiral learning experience. Thank you so much for your work!!!

[sandeepsingavarapu]

Thank you, these videos are really good. Could you also share new videos on any supporting data science technologies like kafka, Docker, spark etc.

[ronzmartorres]

I've done every step but you haven't show how to save that script to reflect in webserver. where to save it? it doesn't appear in webserver. after you've shown the actual script you just activated the docker..

[naveen_thomas_]

Can we install pypi packages inside a DAG?

[stonecoldcold]

Can we change the order of the dependencies using the webserver UI itself?

[rohitkumar-dksy]

How to change Temp directory tmp where bash script is being executed

[nikhilv]

Excellent explanation ...precise explanation ...easy to understand than from apache airflow document .... I have. a basic doubt like why airflow initdb we are using?

[ajaymalik]

what factor determine owner value in the default_args?

[niranjankumaraa]

Hi I need one clarification in Airflow after completing my Dag successfully I can't able to see the rendered temple at SQL query I need to help guys the rendered template is empty is any possible to see the SQL query

[jiechaowang]

so we still have to use Jenkins to do the actual work?

[roy]

Thanks to this video, I have been able to successfully install airflow using docker.But my dag table is empty.Also, I have a local virtual env configured in anaconda.I would like to use airflow in this environment.
Please let me know how may I import airflow in my conda virtual env as my virtual env is not able to recognize airflow.

[pranavkumareshwargari]

Thank you so much!! you were fantastic :) :)

Could you explain how to add new dags when the webserver is already up and running

[sonphamtrung]

anh có thể để phụ đề để em có thể chuyển sang tiếng việt được không ạ. Vì nó rất hay mà anh nói tiếng anh nên em cũng không hiểu hết í. Cảm ơn anh.