Machine Learning Control: Genetic Algorithms

This lecture provides an overview of genetic algorithms, which can be used to tune the parameters of a control law.

Machine Learning Control
T. Duriez, S. L. Brunton, and B. R. Noack

Closed-Loop Turbulence Control: Progress and Challenges
S. L. Brunton and B. R. Noack

This video was produced at the University of Washington

[rbc]

I subscribed after watching about 12 seconds of your explanation! You are doing a very good job, and I don't know why is such a good content is so underrated! Please keep up the good work, you are making tomorrow's world a better place! Thank you

[achmdz]

never tried understanding the concept of GA because it seemed complicated. but after watching this, I at least have the feel for it. great lecture

[emrekarabulut]

It is the perfect video I have ever watched on YouTube! It is a clear illustration. I admired the point you perfectly make a connection between tuning a PID controller and GA. Thanks a lot

[watch_tolearn]

from this i understood mutation and crossover( Explore and exploit). thanks for the great objective lecture

[StefanWelker]

One problem with tuning PID here is that it is difficult to evaluate the cost function automatically, the motor could be damaged or else if you just use random mutations on control laws. Also i think one of the problems with Genetic algorithms is that it is not really clear how the binary encoding of the parameter space works, I think these concepts easily port over to Evolutionary Strategies or ES by Schwefel and Rechenberg, where this is much more straight forward.

[zrmsraggot]

At 12:06 the exact moment you notice Cross Over is not when you are saying .. 'seen ( the eyes go on the left the voice slows down )

[shahedthabitmalkawi]

شكرا كتيير لك . انا اتابعك من الاردن لقد فهمت هذه الخوارزميه

[alirezababaei]

Thanks Dr. Brunton, it was a great illustration!

[boogaloobomber]

This is *really* well explained. Thank you!

[ninafrd]

Hi, i love your work, what would you use to tune pid if not genetic algorithms for unknown system dynamics?

[mhawan]

Random scrolling lead me to learn something new. Thank you! I have two questions, would be great if I get answers.
• Can we say that Elitism and Replication are same, and can be duplicate in Generation(k+1)?
• Is there only two Generation(k) and Generation(k+1), or they can repeat until it find best parameters?
Once again thank you!

[zrmsraggot]

Since dimensiality reduction is supposed to be the main objective when you start, why would you worry about using an algo that performs well in High Dimensionality ? Thanks

[touchdowndillon]

Based on the diagram shown at 11:00, I'm a little confused on how the "probability of selection" (or the second coin flip, as you say in the video) influences the GA. It seems like all of the individual parameter samples shown make it through the evolution from generation k to generation k+1. Does generation k actually have many more individuals than generation k+1? This may be covered in a later video...

[peaceandlove]

Good job. Well explained. Do u have a video of the next part ? (Matlab implementation)

[XecutionStyle]

When crossing-over, how does the algorithm know which genes are the cause of a favorable trait? It seems exploitative relative to mutations but I don't understand the mechanism other than an average of a better pool.

[masoudsakha]

Thanks for the great video. However, I cant understand our Kp, Ki and Kd are functions of time or not. I mean control parameters change over time or we tune them and then they are constant. The other question about how we choose the cost function??

[shengjianchen]

Hi Steve, just wondering how can we encode continuous variables into gene sequences in GA? Discretization? Will this hurt the performance?

[ameena]

hey i'm 11
i think that every thing is possible nevertheless how old they are. age is just a number
when you lose it's not over, but if you quit it's over😁😉