Controlling Drones with AI (Python Reinforcement Learning Quadcopter)

Teaching a Reinforcement Learning agent to pilot a quadcopter and navigate waypoints using careful environment shaping.

0:00 Intro
0:22 Physics
1:08 Control Theory
2:04 Reinforcement Learning
3:45 Training
4:13 Results
4:46 Conclusion

[abisheksunil]

Cool!! Would love to see more videos on RL, especially in an environment with a lot more parameters for the agent to control.

[manigoyal]

The disadvantage of PID as not able to reach higher speed even if the target is far away seems to be wrong tho
the control output from a PID controller is directly proportional (P) to the error, so if the target is far away, error is more, therefor the output of PID controller will be more.

[jeremybertoncini]

Hi,
as the task to fulfill is Path-Planning, did you think about comparing results using Optimal Control theory too ?
For example, Model Predictive Control algorithms may be efficient and real-time solving the presented scenario. Moreover, MPC are collision avoidance robust too, in case you would like to investigate more developed scenarios.

In any case, very interesting framework of yours!

[sanchaythalnerkar]

Great Video, can you create a video where you explain the process step by step, for beginners?

[imannabiyouni]

Keep doing the good work 👏.
Just curious what platform did you use to make this YouTube video?
The edit and timeline is impressive.

[SP-dbsh]

Amazing, make a video on Disaster management Drone, trained with DRL ?
How to design efficient aerodynamics & battery efficient Drones with DRL on virtual environment like VR?

[shalevforfor]

I used neat it's half reinforcement or even none but he just outsmart me and he realise that by staying near the balloon it will give them more then take it 😅

[freddy_bsc]

Very cool video, keep up the great work! I wonder, how fast the AI-controlled drone could have been with more training.

[Alpha_]

Video got me to sub. Now you just need to write a couple thousand papers and you will have a million subs 😋

[rverm]

cann you make a video on that process? sure would like to apply this to real life stuff. autonomous machines

[kennethporst]

I'm confused...how do you give a computer math and it equates that to moving forward?

[юрийступак-хо]

python -m quadai
/usr/bin/python: No module named quadai this helped pip install -e . thank you so much

[hradynarski]

Cool experiment, but that also may prove that human used in experiment sucks at drone game and in PID control tuning right? ;)

[TavoFourSeven]

This needs to get to a point where nobody should need to tune a drone (only like, a master multiplier in betaflight). Like just build it and go, slap any props on at anytime and the (ai flight controller name) just knows real time what to do for best propwash handling safely. Could make GPS use probably easier. So many reasons is why I just looked it up and am happy this is only 2 months old. Toroidal prop= yawn*

[perfumedsea]

So it's a game? Any plan to port to real drone?

[shalevforfor]

You can also simulate a fake control and it will work because the ai doesn't really know what physics is

[govynela]

Hi ! I liked this video. I would like read your paper. Can I have it ?