Animate Images using AI with Frame Interpolation for Large Motion

A quick look at the Frame Interpolation for Large Motion (FILM) machine learning model for interpolating one or more images between two endpoint images. This can be used to create short animations that can be stitched together from output video files, or individual frames can assembled into videos.

Demo animation:

Frame Interpolation for Large Motion Github:

Paths to add:
INSTALL_PATH\NVIDIA GPU Computing Toolkit\CUDA\v11.2\bin
INSTALL_PATH\NVIDIA GPU Computing Toolkit\CUDA\v11.2\libnvvp
INSTALL_PATH\NVIDIA GPU Computing Toolkit\CUDA\v11.2\include
INSTALL_PATH\NVIDIA GPU Computing Toolkit\CUDA\v11.2\extras\CUPTI\lib64
INSTALL_PATH\NVIDIA GPU Computing Toolkit\CUDA\v11.2\cuda\bin

Tensorflow test:
pip install --ignore-installed --upgrade tensorflow==2.6.0

Run interpolation:
--pattern "frame_interpolation/photos" \
--model_path pretrained_models/film_net/Style/saved_model \
--times_to_interpolate 6 \
--output_video

[pcefsbx]

I've just wait for an UI. Looks like a pain in the ass to run

[aksiiska]

hi there was just an animated liberty statue in the recommendations, if this works it can be done also with the mother homeland (matka rodina) statue in kyiv

[CHARIOTangler]

Would it be possible for you to make an updated setup tutorial for this app? Do I have to downgrade cudnn and CUDA for this to work? Why aren't more AI youtubers interested in this? It's still the best interpolation available despite not having been updated for about 6 months.

[rickg.]

hi. why do I get access error if I try to execute the commands for taking the two pictures and create the middle one? mh it is difficult to set up

[maximilianonunez]

Hi Nano, I'm having a problem, when I run this code:
pip install --ignore-installed --upgrade tensorflow==2.6.0
python -c "import tensorflow as tf;print(tf.reduce_sum(tf.random.normal([1000, 1000])))"
Is not showing me my gpu, how can I solve it? I already installed CUDA Toolkit and extracted the cuDNN folder🤔

[spiritpowertx]

Can you make a .exe auto-intall program please ? because it is too much complex... lol

[.mp]

Is it normal, that it doesn't use the GPU?

[arcangeel]

Is possibile to run this on a rtx 3070ti 8gb? :) I hope, btw great video, cheers

[senchi]

Couldn't make it works.
Says : Could not locate zlibwapi.dll

PS
Fixed by searching for this dll around my PC, and put it inside C:\Program Files\NVIDIA GPU Computing Toolkit\CUDA\v11.8\bin

After that i was able to use FILM.