Lagrangian Neural Network (LNN) [Physics Informed Machine Learning]

This video was produced at the University of Washington, and we acknowledge funding support from the Boeing Company

%%% CHAPTERS %%%
00:00 Intro
02:14 Background: The Lagrangian Perspective
05:14 Background: Lagrangian Dynamics
06:46 Variational Integrators
10:40 The Parallel to Machine Learning/ Why LNNs
13:22 LNNs: Underlying Concept
16:02 LNNs are ODEs/ LNNs: Implementation
18:21 Outro

[psychii]

this in combination with some of the modern neural operator (fourier, wavelet) methods are really going to be the norm for most computational physics in industry that use continuum models I think

[hyperduality]

Problem (input), reaction (hidden), solution (output) -- the Hegelian dialectic!
Your mind (concepts) is the reaction or anti-thesis to the outside world (perception).
Input vectors are dual -- contravariant is dual to covariant -- dual bases, Riemann geometry.
Concepts are dual to percepts -- the mind duality of Immanuel Kant.
"Always two there are" -- Yoda.
Neural networks are based upon the Hegelian dialectic!
Lagrangians are dual to Hamiltonians.

[maxbaugh]

So we have Lagrangian & Hamiltonian Neural Networks, I think the question is obvious: do we have Hamilton-Jacobi Neural Networks?

[as-qhqq]

Integrating chaotic systems: when Runge-Kute can be called naive

[mootytootyfrooty]

least action seems like the only way you can actually ground a neural net if you want it stay in reality, even abstract from physics since at some point it needs to come back to reality where there is thermodynamics governing always. Seems like a necessary core for neural nets in general to adopt.

[dadsonworldwide]

I do long for an agent that can serf all models tuned and weighted although I'm sure it will be a while before we the people really get tomorrow's access today like that .

[zanubiadepasquale]

So cool, thank you, professor! I have a possibly naive question: does this mean that MLPs are inherently unable to fully model such systems, no matter the complexity or depth of their architecture, because they will always lose a system's symmetry relations?

[ingolifs]

Can I clarify something? Does the NN just give the updated position and velocity at the next time step? And then you repeatedly use the NN to integrate the system to find its full time evolution? You can't use this sort of architecture (at least for simple problems) to find the state at an arbitrary point in time in a single NN calculation?

[johnwaczak]

Excellent video! About the intrinsic coordinates problem for HNNs, can't you use an auto-encoder to "discover" the correct (q, p) pairs from your input data like Greydanus et al do for the pendulum video example in the HNN paper? It seems like the added cost of computing the Hessian could be a significant bottleneck for more realistic, high-dimensional datasets.

[esti]

I suggest a "transcendental neural network". Can I publish?

[FredericMbouleNgolle]

Good eveny sir and tank you for yours videos
Please Can WE use or those méthodes(all that you have présent) in a epidemylogycal model ? ( Driving by ODE or PDE system)

[jaikumar]

Hello sir ! Is it possible to make mathematical model/transfer function of Diode /Thyristor so that we can predict output of diode just by convolution of diode and input sine wave ?

[vinitsingh]

Could you please do a video explanation one for Implicit Neural Representations with Periodic Activation Functions? Thank you!

[looper]

any proof that it will find the right lagrangian?

in my case the qpp values fit, however the lagrangian is completly off. seems like there is no 1:1 relationship.

[arafathasan-eccj]

sir..can u make a video on tensor for a physics will be grateful if u make one....

[usman]

To all those who read my comment:

I want to apply a Lagrangian Neural Network (NN) to approximate or model a temporal signal, such as temporal traffic flow. However, I don't know where to start. Could you guide me on whether it is possible and where I can find related python-code? I would also be happy to learn if anyone has applied LNN to the MNIST features as an embedded layer in a neural network.

[Jaylooker]

I think this Lagrangian neural network would be good at most classical physical simulations and has applications like being used in a physics engine.

There is the Lagrangian of the standard model so it should be possible to also replicate particle physics excluding gravitational effects.

[rudypieplenbosch]

The videos, went from being really instructive, towards, just skimming the surface unfortunately. The content has changed and not for the better..

[AABB-pxlc]

I know, no one care, but please tell me when that Perceptron BS ended on this channel, and I can finnaly enjoy real math as half year or so ago.

[SuperSuperGenius]

I so want to dub a version of this video to ZZTops 'LaGrange.'