Background Matting V2

We present a real-time high-resolution background matting method that achieves 4K 30fps and HD 60fps. The method outcompetes the previous state-of-the-art.

[JonathanAdshead]

confused why after testing this none of the models produced as clean a result as you have shown.

[johnny]

Is this some kind of alternative to chromakey ? I don't really see it's purpose, unless all your cast have long hair and it's a windy day ? But then this video does a terrible job of describing whatever it is that the video is about in the first place.

[cineblazer]

This is absolutely, insanely cool. The coverage of this project over on the Two Minute Papers channel singlehandedly got me into Machine Learning, and I've sunk hundreds of hours into it since then. I'm actually VERY interested in attempting to extend your methodology to moving cameras!

[TerminatorSAWk]

Give it a Windows Version from this Tool?

[Macman]

How to install it and is it available for Mac. Thanks.

[FunielAudio]

I tried using the camera demo but no matter what arguments I supply the resulting image seems a lot worse than zoom. (Resnet50) There's a lot of bleeding especially if the background is not substantially different (as in it needs a solid black/white difference)

[GTFoxNY]

I really need help with this. I'm pretty confused seeing how to use this.

[陈子帆-wt]

Can this technology be applied to live broadcasts, such as OBS Studio。

[ArielTavori]

1.) Thank you for making and sharing this!
2.) Most people can't program.
3.) Most of those who can, don't want to do so when USING A TOOL for a CREATIVE process.
GUIs exist for a GOOD reason.

Can someone please explain to me why so few of these great tools are available as a .EXE or better still an actual installer for the masses?
I'm honestly baffled by the reasoning that causes so many who want to share a useful tool with the world, to chose to do so in a .py file/Collab, making it useless to 99% of the population...
I'm not being facetious, I would honestly appreciate an explanation if anyone knows?
Avatarify, Flowframes, Ebsynth just to name a few, prove that it's doable, so why do so many still neglect to provide even the simplest of GUIs? Seems utterly absurd!..

[Philsophy]

Need colab tutorial. No matter how many times I try to run it on colab, the output com. MP4 produces only src video.

[jasonliu]

Do you also make the livestream background matting

[randomvideo]

Did you guys used any manual effort into this like the use of photoshop or any other editing tool?

[xkyash]

Hi
May I know where I can get the app used in 0:51 ?
Thank You

[memomind]

Please create it as standalone software for windows OS and App for Android devices ?

[ThatTomshow]

is there any chance of a proper release???

[pavelvicik]

Wow! This is awesome! Great job! We need this in Nuke!