I Just Let AI Make A Music Video, What A Dreamy Journey

It took me 10 days to "watch" AI drawing a music video from scratch, and the result turned out to be...

AI painting is very popular recently, I have researched it personally so far, this time, how about let AI draw an MV animation based on the music lyrics?
In this video, the artificial intelligence generates the world in each frame based on the input text lyrics and scene description.

The original song is from Vicky Xuan Xuan's new song, the rhythm and content are very suitable for AI art theme, let's try it!

In addition to the part generated by the AI, I am responsible for the whole process of "supervising" the AI ​​work, providing the camera movement coordinates it needs, implementing some scene text information, and adding subtitles and fine-tuning editing in the end!

It's really helpful! Special thanks!!!

I used the open source AI painting project Disco Diffusion to complete the production~
Hope you like it!

AI painter "overseer": DGSpitzer

[Amblins]

It really is a dreamy journey! Things shift and change even as you're looking at them, just like dreams. What a beautiful MV made by a creative AI artist and our fav DGSpitzer :) Very grateful for this lovely experience!

[Gingnose]

The similarity between these AI generated MV and dream, psychedelics induced trip is quite interesting
Well, AI is made to emulate the neural networks of human brain, so it is inevitable to be similar but it is still amazing to see this.

[awanderingtroll]

You should make a video showing how you made the music video with the AI 😉

[ahtoshkaa]

This was beautifully directed. You did an amazing job with the camera movement as well. Thank you, this wasn't just a trippy AI-generated mess but an actually well-made music video.

[drymice]

Amazing! Needs a few hundred thousand or millions views more. :)

[slr-d]

this is pretty much old game consoles.. in about 5 years were gonna look back at these and LAUGH!!! but at the same time well say "ohhh ok, I see what they was trying to do"

[ag]

This video seared itself into my consciousness

[Ramzy_Prod]

When it said no one knows my hearts on fire it showed paper burning and then the paper turning into hearts this is so good 1:15

[retxab]

The video is amazing, it reminds me of ADHD especial when I was stoned in the passenger side of my buddies 5.0 with 2-10s dumping driving down the levee eyes closed... It's quite a journey

[CrowCoded]

This is my new favorite genre of music video. Weirdly soothing to my starseed soul.

[Anthroponeural]

So incredible! I’ve done ai images. Now how / what do I use to blend or dissolve them together in a video similar to this?

[MrLandShark_]

It's like multiple artists were given the same prompt and the art pieces were arranged like a slideshow

[mryan]

Can you share your setting input file for the video?

[XxGyromancerXx]

I love these AI created music videos. Stick Figure's new song "Way Of Life" is one such video that was created by AI. I wonder what AI would do with any given Cannibal Corpse or Dying Fetus song.

[viixbhomberz]

Is there an app or site that merges n shuffle videos ?

[punekarnikhil]

What software you used to make this video ?

[Eadyt]

0:32 The AI misinterpreted swallow as swallow bird

[aksisoylenemez]

Can you please put down a video of how to add keyframes? which compositing software to use after u generate the images. Video looks awesome!

[ahmarmusic]

Share some prompts? Is it drawn by a certain artist?