Black MIDI, but every note spawns a physics object... (4k, 60fps, ray traced)

I created a program in Unity that can read Black MIDI files and generate a Synthesia like visualization. However, each time a piano key is pressed, a corresponding tetromino physics object is spawned (since it plays the Tetris Theme A). The high note density areas created some interesting effects.

I had a simpler version of this almost done, but for some reason I always feel the need to do a bunch of extra modifications that people probably won't even notice (60fps + 4k, I still don't have a 4k monitor, so I don't even know what it truly looks like, lol). After figuring out how to use Unity's HDRP, I couldn't resist setting up path tracing. Unfortunately, the Unity Recorder package isn't capable of waiting for the ray tracing paths to converge before moving to the next frame yet. To circumvent this, my code paused the simulation for about 200 frames for path convergence stalling, took a 4k screenshot, then repeated the process for about 72 hours straight. I was very sad when a bug in my code glitched out the physics at the very end of the simulation. Surprisingly, after fixing it and skipping a bunch of frames to set up a pick up shot where it failed, the physics behaved deterministically so the transition was unnoticeable.

Massive thanks to Kanade Tachibana for allowing me to use this MIDI file!

Music: Tetris Theme A

Cash Register Sound Effect:

[MadMovieMakers]

Mom says to clean up your 3.5 million blocks when you're done

[KrazyKF]

"Oh hey, this isn't that bad so far."

0:24

*The shadow.*

[bghmusic]

Never have my eyes seen something more beautiful

[zacherychapman]

Black Key: "Mom, I'm scared of those shadows"
White Key: "The shadows can't hurt you."
The shadows: 0:23

[RubyBlooming]

Shout outs to the one green block that gets on top of the piano at 1:15, they went where no block had gone before

[sebastianverhagen]

I love how the melody is still recognizable, even with all the runs and full-piano slams happening

[ChristopherMoom]

The real reason you never get to see the product of all the Tetrominoes is because DoodleChaos is insanely lucky and the Tetrominoes all happened to line up perfectly when they fell down off screen, causing them to disappear like in actual Tetris

Jokes aside this is a really neat video, it's really satisfying whenever the song makes an explosion of Tetrominoes, great stuff

[sergiorodriguez]

2:29 at this point with that amount of notes spawning the piano looks really smooth

[znox_x]

The parts where the music sounds like it explodes is so satisfying lol

[DoggoGod]

I love how you can see the shadows move and you have a couple seconds to prepare yourself

[meILM]

I want to see all the pieces at the bottom fit together perfectly

[hiimpurple]

Omg when that green line pops, it’s so satisfying

[abstractn]

"Did you do it?"
"Yes"
"And how much RAM did it cost?"
"...Everything"

[forgettablePyromaniac]

Ah, yes. Let's raytrace our Midis. We're finally reaching the graphics Toby reccomended for his own music

[achoi]

"yeah im apart of percussion"
"oh yeah? what instrument do you play?"
"piano."

[arsonistnpc]

i got a discord notif as soon as the song ended. absolutely magnificent

[qwertyb]

I can't imagine all the effort that went into this video, all the time it took ti write the midi, coding the 3d objects, render time, and especially all the thought and effort that went into the thumbnail. Good job, Doodle!

[Qoride]

1:12 props to that one green block that made it on top of the piano

[delicioushomemadestrawberr]

I would've liked to see the product of the blocks below

[hakhpu]

2:10 this part is my favorite part, epic