My Experience With Apple Vision Pro Spatial Video

In this clip, Marques tells Andrew and David about what it's like to use spatial video on the Apple Vision Pro headset.

Shop the merch:

Twitters/X's:

Threads:

Instagram:

Shop the merch:

Join the Discord:

Music by 20syl:

Waveform is part of the Vox Media Podcast Network.

[mahfah]

I am glad they show examples of topics in middle of video or animations. It’s really helps in podcast. Some thing which other podcasters don’t do.

[loganrussell]

One of the cool things now, is that with Neural Radiance Fields (NeRFs), we can reconstruct a whole scene without having to have all the pictures from the same spot. You can move around a scene, and basically have a fully 3D scene to view in the Vision Pro

[Alex-hvir]

They now have wide angle cameras, better processing and LiDar. Taking a sphere photo would be so easy today.

Imagine being able to get back to that moment… being able to look everything in 3D (LiDar) would be awesome.

[tjengawongi]

Photosphere is still available I think, I use it all the time. Stitching has become quite good imo and the lighting as well, very uniform.

[sheldoncarter]

It's odd to me that they decided to set the orientation correct on the 15, but not 14. Spatial Video was definitely in the pipeline while designing the 14, atleast is imagine it to be.

[PfropfNo]

I take 3d footage as a hobby and when they introduced the “spatial video” on iPhone 15, I was immediately skeptical. The distance of the lenses determines the strength of the 3D effect. The most realistic 3D happens when the distance of the lenses is similar to the distance of our eyes (3 inches, or 8 cm). The distance of the lenses on the iPhone is way too small, which means the perspective of both cameras is very similar (which results in a weak 3D effect).

[xarfram]

Can confirm, on my Pixel 6 Pro the camera app has photo sphere available as one of the modes, right next to Panorama and Night Sight

[krnelpanic_]

I used to love taking panoramas and photo spheres on my phone, paired with my Daydream View headset it was really nice being able to take a pano and view it quickly in VR.

[newmantopia]

I suspect taking video with the Vision Pro itself will produce higher fidelity 3D than the footage from the iPhone 15 Pro, given the wider spacing of the lenses. Marques describes how the footage taken from his phone featuring subjects at 5 feet distance don't feel all that different-- I think that will be improved on taken from VP.

[suuift]

I loved photo sphere! I was really sad when they removed it even though it was really niche. The newer versions definitely stitched the image together better than they used to and the lighting was pretty much always uniform as well. I do think it would be better though if you could just scan the phone everywhere around you and it does some magic rather than using fixed points if they ever bring it back

[Dgodwin]

Can confirm. I have photosphere on the pixel 7, still :)

[joshsilveous]

I was so confused when you guys were talking about Photo Sphere as if it's been gone for years... I took one on my P7P yesterday.
Thought I glitched into the wrong dimension or something lmao

It's not even buried in settings, it's just on the far right of the default Camera app. Works great imo, stitching is really good

[adrianroldan]

For years I’ve wondered why they haven’t made it possible to shoot 3d, Glad they are finally making spatial video. Still wondering if it’s possible to have wide angle cameras front and back to capture 360 photos/videos with one shot

[RalphBarbagallo]

Snap Spectacles 3 did basically photospheres in 2019. It's too bad the Meta Ray-bans don't do it. But when you take videos or photos with the old Snap Spectacles 3 you get a 180 degree hemisphere image / video you can look around in.

[StevenYoungcaptual]

Back to saying “Like-Like” every other word.

[alexeypunov]

Guys, your ads are usually great,
but this time it was another level. Standing ovations

[michaelwright]

The stereo effect on the iPhone is probably limited by the physical distance between the lenses. I guess they're doing a lot of computation, but I think there are some hard limits there (else the astronomers would have got a much further reach with stellar parallax).

[calebnovick]

This seems kind of like a new revolution.

[SNIVY]

DJI drones can do spherical images, that'd be super cool to see in the Vision Pro.

[rewdotkim]

I *still* use photosphere (Pixel 6 Pro) and we enjoy them with my now defunct Daydream headset. Wild how old the tech is.