The First High Res FREE & Open Source AI Video Generator!

Potat 1 AI is a project that aims to create videos from text prompts using state-of-the-art diffusion models for image and audio generation. It is based on the research paper Structure and Content-Guided Video Synthesis with Diffusion Models by Runway Research. Potat 1 AI has a GitHub repository where you can find the code for their diffusion models and video generation techniques. They also have a Hugging Face account where you can try out their models online.

▼ Link(s) From Today’s Video:

-------------------------------------------------

▼ Extra Links of Interest:

-------------------------------------------------

Thanks for watching Matt Video Productions! I make all sorts of videos here on Youtube! Technology, Tutorials, and Reviews! Enjoy Your stay here, and subscribe!

All Suggestions, Thoughts And Comments Are Greatly Appreciated… Because I Actually Read Them.

-------------------------------------------------

[MattVidPro]

CORRECTION: the square example vids are from the OG modelscope. Not the new model.

[drillerdev]

I'd say as long as coherence is maintained, we don't need high fps. We have interpolators for that, once you have chosen a generation you like.

[Dron]

num_steps: is like in Stable Diffusion, controls how detailed is the image. It should be at least about 20 and bigger values generate more detailed but not always better scenes. num_frames: is responsible for video length.

[Mr.ThomasAnderson]

I want to see both installs but definitely the Blender one. I wish someone with build a more user friendly app for these open source generators but then I guess you would need a team like Blender has. Thanks for all the great AI content Matt

[eyevenear]

can't wait to have this as an extension for automatic1111, that'd be where this will blow up

[lstephen]

Kudos to you for always being the first to introduce new tools!

[coloryvr]

Wow! ...that sounds good and promising!
By the way: I really like the mutating incoherence of SD Deforum: Of course not in every context, but with fast psychedelic music (PsiTrance, Progmetal etc) the Deforum style fits perfectly.
Thank you for all your great and quick updates! ( I love all the Lemon testings very much!)

[AI_ArtShow]

Those example videos are from the original Modelscope example i think. I remember Matt Wolfe going over these exact examples like a month ago.

[unheilbargut]

Sadly I couldn‘t get it to run, but the watermark still would be a bummer and makes it less usable. So I will wait until it comes to automatic1111 😅 But we are slowly getting there. I am thrilled.

[RockyBergen]

Stop crapping on Modalscope! ;) I LOVE some of the creative solutions to prompts I would come up with. I am totally smitten with GEN-2 as well but I can't make my actors do much but stare into space most of the time. Thanks for the head's up, I am hoping this will be the best of both worlds.

[agnesslovehealz]

Honestly cant believe how finding your channel today has completely expanded my mind in so many ways...been on this rabit AI hole for few months and ur channel covers things in best diff way and covers all i been looking for thank u

[literalsarcasm]

Tech like this could eventually be used to transform any book into a movie.

[tonyanimations]

Don't get me wrong, iam excited to see how this AI goes, but the only thing i want is being able to do at least 3 minutes videos in like 10 minutes not 1 hour.

[PRepublicOfChina]

Why doesn't the huggingface link work? On the huggingface page, you cannot actually generate any video. Then whats the point of that HF page?

[andreafassone]

You spoke for three hours of hot air without ever looking at the camera once

[Madcore.]

Yes please do a video tutorial on how to run this on our PC. Would love to get my 3090 cracking with the 24gb of VRam.

[pjonesdotca]

Since this is based on ModelScope, I think you should be able to find that there is basic image coherence at 10 steps per frame. Also, use 8-10 fps and interpolate with FILM or similar tool

[scispiracy]

Thanks for the info! I have a humble request: Is there any way you can tone down the white glaring background? It not only washes you out, but it puts a strain on viewers eyes with light sensitivities.

[Dron]

It crashes often in Google Colab trying to allocate memory. I couldn't create videos longer than 4 sec and sometimes just 1 sec. But I need to try to change resolution, it is not in the editable params but in code section.

[kisatom]

It looks like image generation from a year ago. I hope it will evolve, too!