[Getting started with Airflow - 6] Using sensors to sense files

Sixth video for the getting started with Airflow compilation. In this video we use the FileSensor to sense if a file is there or not and act accordingly.

[samuelkellerhals]

Fascinating stuff. One thing to add though, you never mentioned how to create the my_file_system connection.

To do so go to connections > create new connection with the following parameters:

Conn Id: my_file_system
Conn Type: File (Path)
Extra: {"path":"/tmp/"}

[stefanw]

Thank you very much. This helped me a lot. Great stuff

[kalinivanov]

bro you are legend, honestly. Keep it going!

[FernandoLopez-elmp]

Hi! Thank you. You have done a great job!

[aparnasrivastava]

In file sensor task, if that particular file is already there in the filepath, will it succeed or look for the latest one?

[poovarasanram]

Hi How to mask the connections passwords I am using the airflow version 2.2 4 and aI also encrypted the passwords with using of fernet key but still I could see the connections passwords in airflow task logs

[rahulmaron]

thanks! How about wildcards? how do your use filesensor to match patterns?

[shenbagaprabhupalaniganesa]

How to connect the server and check the file is existing

[vandanasingh]

Can we sense more than 1 file using a single FileSensor?

[SoumilShah]

I am trying to understand hooks can you help me could we schedule a google meet I reside in Stamford area i have a YouTube channel too you can check out