AI Learns Video Frame Interpolation | Two Minute Papers #197

The paper "Video Frame Interpolation via Adaptive Separable Convolution" and its source code is available here:

Two Minute Papers subreddit:

Recommended for you:

We would like to thank our generous Patreon supporters who make Two Minute Papers possible:
Andrew Melnychuk, Brian Gilman, Dave Rushton-Smith, Dennis Abts, Eric Haddad, Esa Turkulainen, Evan Breznyik, Kaben Gabriel Nanlohy, Malek Cellier, Michael Albrecht, Michael Jensen, Michael Orenstein, Steef, Sunil Kim, Torsten Reil.

Two Minute Papers Merch:

Károly Zsolnai-Fehér's links:

[CSengineer.]

Hello fellow scholars, at 3:00 is my tiny mediterranean city on the west side of Istria, Rovinj. I'm so happy to see it presented in such a great work :D
Kind regards from a computer science student from Croatia :))

[orangedac]

These 2 minute papers from Carlos are just excellent.

[PopcornColonelx]

I would have liked to see a visual comparison of the algorithm vs a baseline (simple linear interpolation or optical flow) rather than just the non-interpolated input image.

[davidmcsween]

Still seems to suffer from boundary errors when new sections of an image appear, just like Optical Flow. I wonder why they can't reverse direction of play for prediction at these deviations? Also effective fast interpolation would be useful in real time CG, so instead of making slow-mo you extend 12fps to 24fps but retain more samples for render. Or it could extrapolate an alternate eye view for stereo without retracing

[aaronhayden]

I'd love to adapt this for stitching multicam VR rigs

[jMcWill]

Anyone feel like formatting this into an After Effects plugin for me.

[Andytlp]

cant wait for these to be inbuilt in common video players like vlc.

[mrtomato]

with the girl holding the camera phone if you focus on her left arm as it gets slower you see pixels freaking out around it

[diegoantoniorosariopalomin]

Animation will become much cheaper, let's discuss what other techniques will be useful

[movaxh]

Pure magic. Technique looks obvious and simple after knowing how it works. But the results are better than expected from so simple method (particular topology of the neural network isn't obvious tho, and probably took some time to design and test). Wow.

[mortyforty]

How does this compare to Smooth Video Project (SVP)?

[BattousaiHBr]

someone should use this to convert anime battles into 60 FPS.

[gcbzzzz]

in summary: lots more work, for a result that is either a) as good as ghosting frame interpolation or b) full or weird edge artifacts.

[BigDickEnergy]

Can anyone tell me if the AI that indentify letters in a hand written paper by using neuralnetworks uses another AI with neuralnetworks to indentify the parts where mistakes were pointed by humans as starting point resource?

[Ziar]

This video has 1080p60 max quality 🤔
Could it have been secretly created in 30 Frames Per Second?

[buttonasas]

My right eye is now twitching, not kidding.

[CISMD]

This is so dope! Is there anything on video stabilisation?

[ramim.j]

Can this be used to artificially increase the FPS of video games from 30fps to 60fps for example?, Or is it best only to slow down footage?

[npaisfordummies]

If this trend continues, soon we'll have programs that are able to generate enitre movies from scratch

[Ponk_]

When will this be available for my smartphone?