Install Apache Airflow on windows 10 without docker

Step to install airflow on windows without Docker
Step 1: Control Panel | Programs and Features | Turn Windows features on or off

Enable : Windows Subsystem for Linux

Step 2: Install Ubuntu from windows store and restart system

Step 3: Install and update PIP

sudo apt-get install software-properties-common
sudo apt-add-repository universe
sudo apt-get update
sudo apt-get install python-pip

Step 4: Install airflow

Note:
if above command doesn't work use below
python3 -m pip install apache-airflow

export SLUGIFY_USES_TEXT_UNIDECODE=yes
pip install apache-airflow

Step 5: Initialize DB
airflow initdb

Step 6: Start airflow server
airflow webserver -p 8080

Step 8: Setup folder for DAG

create folder DAG in C: drive (C:\DAG)

Step 9: Add new DAG

run airflow initdb

References:

[antonbar]

Well done, nice tempo, no wasting time, straight to the point, very useful!

[sharma.nitesh]

log - Filling up the DagBag from /mnt/c/DAGs
PendingDeprecationWarning: The requested task could not be added to the DAG because a task with task_id is already in the DAG. Starting in Airflow 2.0, trying to overwrite a task will raise an exception
Any idea? What should be issue behind this

[Velben]

This is the only video that worked for me. Thank you!

[nirbhaymehta]

What are the changes required in airflow.cfg

[sedoredo]

thank you. You may need to change airflow db init with the new version of Airflow.

[ashissahoo]

I'm getting below warnings and webserver is not starting

Filling up the DagBag from /dev/null
WARNING - No user yet created, use flask fab command to do it.

Can anyone please help?

[lavanyabandla]

When i start webserver it is asking me sign in. Where can i check the credentials webserver config file or airflow config file.

[piyushjadiya]

I have one naive doubt, I have a pyhton project, and have a virtual env for that, also I have the file that I want to run in my dag in that project, how to use the same venev for airflow?
Or is there any other way using two different envs?

[oldachm]

I had to run 'sudo apt-get install python-dev python3-dev' prior to 'pip install apache-airflow' on my system

[apoorvsingh]

Thanks a lot for sharing this! Really helpful (Y)
Do you have more content on airflow?

[aakashroy]

Hi,
It worked on my machine but unable to set it up on the other one.
Having below error:

Traceback (most recent call last):
File "/usr/local/bin/airflow", line 32, in <module>
args.func(args)
File "/usr/local/lib/python2.7/dist-packages/airflow/utils/cli.py", line 74, in wrapper
return f(*args, **kwargs)
File "/usr/local/lib/python2.7/dist-packages/airflow/bin/cli.py", line 966, in webserver
gunicorn_master_proc - subprocess.Popen(run_args, close_fds-True)
File "/usr/local/lib/python2.7/subprocess.py", line 394, in __init__
errread, errwrite)
File "/usr/local/lib/python2.7/subprocess.py", line 1047, in _execute_child
raise child_exception
OSError: [Errno 2] No such file or directory


Any help on above error will be much appreciated.

[argha-qihf]

Wasted two hours trying with docker. This came to the rescue. Thanks a lot /\ /\

[MB-ygvg]

Thank you for this great tutorial!! saved me tons of time!
That said i am still having an issue with showing my DAGs in my new DAG folder while following this tutorial. Anyone fixed this issue?

[nvnvashisth]

sqlite always gives running error of scheduler and can't start any task because of that. I read about it, everyone says that its better to use postgres. Do you have any steps to install with postgres as the backend. Help will be appreciated.

[bantuandproud]

Nothing worked! I'm stuck where you show in the slide that we need to install "pip install apache-airflow"

[techyanbu]

Instead of sql lite how do we connect to postgres or mysql db in the airflow configuration file in windows 10 home

[pinkpuffles]

My files don't get updated in dashboard. I have changed airflow.cfg file as well.

[nandini]

when I try to the execute the command "airflow scheduler" I am getting this error (sqlite3.OperationalError) disk I/O error

[jehanjoshi]

on doing airflow initdb I get an error -bash: bad interpreter: No such file or directory

[pinkpuffles]

is anyone getting this error No inspection system is available for object of type <type 'instancemethod'>