➜ Learn how I edit this video here with DaVinci Resolve: th-cam.com/video/PBGOpTsOyOA/w-d-xo.html ⬇ Download MV-HEVC version here (for Apple Vision Pro or device support spatial video only): bit.ly/4bRYTeY This is a release as the older version has an issue. We tested on Apple Vision Pro this time and make sure everything works now!
thanks man, I have a Quest 3 and have been wondering what "Spatial Video" looked like, now I know. It will really be great for home videos, since it's super easy to use, it can be a super good tool for people to watch a video, or their parents or grand parents who are no longer with them later in life. I'm a Samsung guy personally, so I'm hoping they put this into their future phones.
I will have an indepth tutorial on Spatial Video when Quest 3 update is drop! Coming up tutorial will show how to capture spatial video on ANY CAMERA (not just iPhone or AVP)
Looks great on Quest 2! I'm really happy more people are going to start recording in 3D now that iOS includes the option. The only downside of this type of video is it's very easy to feel motion sick
Some great shots Hugh. I watched this on Quest 3. I did notice for some scenes the depth of field between left and right eye was distinctly different (sharp in one, bokeh in the other). Any idea what was causing that?
Very sharp eyes! Yes, this happen in the latest firmware on iPhone. It is still a different lens that has different specs - sometime the phone is just not smart enough to correct them for some distance. Which is a major problem. I hope they are fixing it in the next firmware. But pretty sure the real way to capture Spatial Video is using Vision Pro or next iPhone (iPhone 16 maybe with dual fisheye?)
Hi Hugh! I used my wife's iPhone 15 Max Pro to film a spatial video. But when I uploaded it to TH-cam, It wasn't in 3D and in the settings there was no "3D" choice as there is in your video here. Is there another step that I'm missing? Thanks for your help.
Thanks, Hugh, for another great informative video. You are always at the cutting edge, keeping us up-to-date. You are right in emphasizing the need to compose shots with items in the foreground - this is something I learned doing high-resolution stereo photography for decades that is especially important with the narrow stereo base between the lenses in the iPhone 15. The quality was impressive at 2160p, and the stabilization is amazing on the gondola went over the pulleys. By the way, I noticed in the Quest Browser app that the text in closed captioning seemed to fuse into a single image some of the time but at other times showed double.
I just started 3D photography last year, and totally agree. I have been taking 3D photos with my iPhone 12 mini and quickly realized the small stereo base means anything more than 6 feet away loses depth dramatically.
Very cool! maybe you’ve explained this before in a previous tutorial. Is it possible to crop vr180 video into a regular 16x9 spatial video using Davinci resolve/fusion? A tutorial on that would be great!
I will make a full on post production tutorial next as this one has editing, time remap, 3D graphics insert that you won’t be able to pull straight out from the iPhone. Stay tuned for the tutorial on this one.
@@hughhou ok because I don't own an iPhone 15 Pro but have an DIY Stereoscopic cam, made out of two Dji Osmo Action (with self printed Rig) to record 3D Video. If I cut them together as an Half SBS video and view it through TH-cam, it looks Finde but I can't get all of the anaglyph features as you
Well, first thing based on your comment is "Half SBS" - which is the standard of old 3D Display but it is not Spatial Video. Try it with full SBS first :)
@@hughhou ok but how? If I edit it with both UHD eyes next to each other I couldn't get it to work like on your video with anaglyph mode. Or do I need a special video editing software etc? Using Luma Fusion and Final Cut on my Macbook
I have the same questions. I tried upload video so many times with the special tag "frame-packing=3" but all I got was only SBS video. 3D button is not available. Thank you!@@hughhou
No but everything on this channel are correct spatial video (donwload link provided) and we are also provide spatial video shot on the Vision Pro for download soon. Is that what you need?
I don't have Xreal Air - can you try it for us? It is 3D video so if Xreal support TH-cam 3D it should be able to play correctly. It works on Lume Pad 2 and other 3D display natively with no modification. The downloadable Spatial Video (I soon provide will only work on device support Apple Spatial Video format)
i can watch sbs 3d videos with XREAL, its weird though because i see sbs for the preview when scrubbing through this video, but in fullscreen it's not sbs. @@hughhou
@@hughhou it only does SBS for spatial video. Looks like we can convert the Apple Spatial Video to SBS then view it on the Xreal. We can use spatialify to convert it to SBS.
Can't wait for the stereoscopic editing tutorial, hopefully tailored for Davinci Resolve Studio! Also, I can't seem to find the link in the description to download this video so I can watch it on my Zapbox headset.
Hi Hugh! Great Video.. I have download the sample footage (Directly to Vision Pro) and when I open the video, the aspect ratio is 1:1 (Square). It looks a little squished. Not sure why. It is spatial (3d) just 1:1 and squished. How do you edit these clips? I'm using Adobe Premiere Pro. Any videos explaining? Thanks buddy!
Thank you for pointing out the issue. I found the issue as well it is cause by latest VisionOS update - we fix it and post the new link inside our Pateron (still FREE). Try it again and let me know if this work for you now. Apple update break thing lol.
This video looks great on the Quest 3, but some of the shots have a HUGE PROBLEM… one of the eyes has a blurry background and the other one doesn’t (like @2:45 on the video). I hope this is a bug that apple fixes pretty soon. Thanks for showing us this footage!
I think this is a native iPhone 15 Pro problem with 2 different lens. There is so much computing vision can do - so I don't think Apple can fix this completely. Vision Pro own camera will be better tho and maybe the iPhone 16
Yes its a hardware issue and not software so no way for Apple to fix it. Apple has to crop into the ultra wide lens to match the field of view of the regular lens. Best way to solve this issue with the iPhone 16 would be to have 2 main sensors. Also true that it'll be good on the Vision Pro for anyone who has the spare cash.
Hello from Ireland! I have a Meta Quest 3 but I find the youtube 360 videos unwatchable through the Quest 3 (even using the Meta Quest 3 youtube app) the resolution is horrendous.... it looks looks somewhere between 144p and 240p. Why Meta hasn't sorted this out is beyond reason? Do they want their VR headset to sell or not? Mow, someone online pointed me towards DeoVR and it was a huge improvement in quality, but very little content and the content that is free to watch is mostly amateurish nonsense. Is there a way to watch high resolution (proper 4K) 360 videos on the Meta Quest 3?
...and hello from Canada. When I first started watching the video in the Quest 3 TH-cam app in auto quality, the resolution dropped at one point to 144p and was very pixilated. I was able to view the video in extremely high resolution by choosing 2160p in settings>quality. When I tried TH-cam in the Quest Browser app, I saw side by side images rather than fused stereo images. Anyone know if we can watch it on TH-cam in the Quest Browser?
It’s b/c TH-cam VR default to low resolution to save bandwidth. You need to manually set to 2160P for the highest quality. Or you can also watch it Free on quest browser which can go up to 8K! Better than DEOVR. For content that shot and upload on 8K. That’s what I will recommend
I highly doubt it. Might be able to push to 60fps but 1080P pretty sure is the limited and honestly not too bad. If you set the resolution of this video in 4K (2160P) - as it technically it is 4K (2 x 1080P), it looks really good on TH-cam VR inside Meta Quest 3 or other 3D display.
@@MetaverseStage that's what I think too but hoping they surprise us. Since each eye is 4K and they're filming in 8K for their own content for the headset, I hope they at least thought about it!
Did you see their content? Might be back to what we do here - VR180 or with the sensor match that 8K size. They will want filmmakers to shoot for them and most of them don't like to roll an iPhone on set lol. I am sure there will be 8K 3D camera coming if Vision Pro is launch. There are OTHER problem beside resolution I will touch on in the next video. Spatial Video is not 100% ready, at least for people who understand 3D.
It seems to be heavily based on the blu-ray 3D spec. Not a bad thing for a v1 device. Can’t wait to see Apple Immersive Video. A brand new spec created by Apple. I’ve also done some initial spatial tests on my channel, formatted for current gen headsets.
It's not shown in VR on the vision pro because obviously the resolution is pitiful. It's displayed like a 3D TV at distance with a hazy dream like border. I imagine the distance is set so it remains sharp. It's amazing reading pro apply reviews - they clearly haven't tried 8k VR videos before because this is nothing but a gimmick. However if it stimulates the VR180 market and my next Samsung has a stereoscopic camera....I'm all for this gimmick. But I doubt mainstream phones are going to throw dual fisheye lenses on their phones anytime soon.
@@bigdaddy5303 I hope you realize AVP has the best wearable display on the market at the moment. Even after what was announced at CES 2024. Hopefully there's surprises as the software catches up and devs get these in their hands.
This is getting very interesting would you classify spatial video as own name or is it part of metaverse or mixed realty I myself call it spatial immersive realty video(SIRV) curious what you call it
I just call it Spatial Video or MV-HEVC - what ever official Apple docs call it. It is really an effective codec to distribute immersive content that is ONLY 3D (so mono 360 will be bye bye) - so SBS, VR180 and VR360 or Volumetric Video if Apple will ever figure that part out
Very informative video Hugh! I have a Fujifilm W3 3D camera that I recently used to capture 3D videos during a Europe vacation. After processing with Topaz Video Enhance (upscaling and converting to 60 fps), they look decent when viewed through my Rokid Max glasses. Image stabilization is one thing that really caused issues with videos taken with the camera. I used Davince Resolve to stabilize the footage before Topaz processing, but still not great due to blurring when camera moved. Assuming you've used the Fujifilm W3 or similar type handheld 3D camera, how does the iPhone 15 pro spatial video capture compare? Obviously, a bit better resolution at 1080p vs 720p and stabilization which is a big plus. I watched the video on my Quest 2 so figure the headset is limiting me from seeing the video quality at its best. My biggest concern is how well the 3D separation works with the lenses being only about 1 inch apart, but I'm surprised how well the 3D separation works in your example videos.
Hello, very good channel. Quite a PRO. On a low budget, I’m doing recording exercises with two parallel Insta360s, and it looks great, controlling the IPD between 5.5 and 7mm. How does that IPD thing work on the iPhone? Thanks!
Hugh, can you tell me how you put direction lock on moving Insta 360 pro 2 footage. It is not an option in the insta360 pro editor. I've been watching all your videos looking for an answer. I don't want to make my viewers sick. Please help!
That is a big problem on Pro 2 - the only way to solve it (and I believe I have to a tutorial) is to use Mocha to track a distance center object (not moving) and then lock the direction with tracking. Only way around. Mistika VR can do it as well
Did I hear correctly? The max resolution of spatial video is 1080P @ 30fps?? How are they able to achieve realistic 3D when the lenses are not nearly as far apart as human eyes?
Great video Hugh! I can't wait to see your editing video. I upgraded to an iphone 15 pro and have been taking vids using my insta360 flow. I've used spatialify to watch on my quest but the vids aren't great. Anything more than a slow pan causes the movement to be blurry. My zapbox should be delivered shortly so hoping that will let me see if the spatial video looks ok before I convert to SBS with spatialify.
Thinking of the most polite way to put this. Some people are going to love the way small things can be made to look really big close up. Other people having these things waved around at point blank range in high definition are not😂
One more questions for you! Do you know how Apple Vision Pro users will watch spatial video from other people? Will it be on TH-cam similar to what you shared in this video? If spatial content really is that much better, I'm assuming Instagram and TikTok will support it at some point.
Right now there is no social media on Apple VisionOS so people will need your physical video airdrop to them or their own capture. To watching others, someone will need to go tho the iTune release process to get the Spatial Video to massive. We have no idea what is process take for independent small content creators like us. B/c Apple don't really care about us. Only big box studio like Disney, WB or bigger channels have that access and all of them sign NDA so on one know how YET. I am sure the answer will get clear when Vision Pro is finally here. But only legit 3D movie now with IP is converting into Spatial Video and available to be purchase on iTune. But I can see it will go the Podcast route. It is sux tho Apple only open to Compressor and prob FCP next - so for Premiere and Resolve users, we will have to wait or learn a whole new software system. Just like the whole Swift vs Unity drama Apple is throwing. You need to learn Swift to develop on VisionOS - even they advertise Unity Support. It is a close source vs open source system... basically, lots of learning
@@hughhou thanks! Luckily I use FCP so I'm hoping there is so sort of workflow at the time of release. If they plan on selling 10m units of their next version they will have to have some sort of social media support. The Google/Samsung headset is supposed to be released late 2024 and they'll definitely have some sort of social integration.
Currently, you can easily convert using Spatialize, then edit in something like After Effects. Which is what I’ve done on my channel. Gonna get interesting!
🔥Strong video as always! But one question I do not understand: 1.) Why does this work? I thought approx. eye distance is always needed between the 2 cameras? 2.) If not: Why do you then need at least 6 cameras for 360° 3D and not just 4 (e.g. 2x 180°)? I thought eye distance is the reason... 3.) And if 4 are enough why is insta360 using at least 6 in their professional hardware?
looks Great on my Q3. Watched 1st in YT app and next in Quest browser, The browser requires fiddling with settings but seemed to look better to me. Thanks for the tips considering content subjects. Right now, people have to really want to watch 3D content because of the barrier to entry. At some point in the future the Barrier may switch to people avoiding 2D content Because It just doesn't look as good. . I think you will be the father of the 3D revolution by the way you are going, and it's right that you came in strong right here at this moment in advancement , right now with Kimchi. :) I'm staying tuned and considering what is interestingin what I do that I may show with this new power. Thanks! I'm Looking forward to see what is next.
Wow thank you 🙏🏼 I really hope so:) I need to check on Quest browser next. I actually only watch it on TH-cam VR app which has recent improvements on 3D video playback - this in 4K look really good just in TH-cam Quest 3 app :)
Thanks for letting us see the disappointment. I mean this would have been cool 6-8 years ago, but its like 3 steps back when you used to 360 3D and even what the $300 Evo VR 180 can do.
Well, we are a little bit ahead of the curve but most consumer has no idea what is 3D 360 or VR180 - 3D is already over their head... But see my new video? Vision Pro can play VR180: th-cam.com/video/fvUtaRTqWLw/w-d-xo.html
Looks quite good on Quest 2. I will wait to upgrade my iPhone until it can do 60fps at much higher resolution as 30fps is just not enough. The scale needs to be fixed too. Hopefully after Apple Vision Pro comes out, camera manufacturers will start releasing serious VR cameras with 8k at 60fps.
More great stuff mate, thanks for your persistence in and around immersive video. Question for you and your audience! It feels to me and i am probably wrong, that we are in an interesting spot with VR/XR/AR/180/360/Spatial, where across the board we are are starting to see some issues with adoption resulting in a plateau in quality content videos, gaming or otherwise. Without going on a rant, I feel that the apple vision pro's success or failure might be a turning point either direction. Spatial video is great but do you foresee Apple or Android including a competitive/quality 180 or 360 video solution in their upcoming phones and would that coupled with an affordable headset or display conversion (think better google cardboard) without undercutting the AVP be the way to go? I still love watching people try VR for the first time, its the only way to sell someone on this and ultimately the biggest barrier. Anyone for turning Car lots into VR lots?
Thank you and totally agree! We hope the Vision Pro is a turning point for immersive media. But we can't know what Apple is going to do and no one will know. So we have to see. So far Meta is heading pretty strong in the space. With Pico drop out of the race, I think immersive Filmmaking is still a new but growing market. My job is to create content tailor NOT to gamers or male audiences - but audiences are are new to immersive film - non-gamers, movie watchers or in general female audiences. (99.9% of my audiences are male tho lol). Technology will adopt if we can get more viewers into the immersive viewing and better storytellers come into the space. There are lots of Directors I talked to refuse to touch immersive filmmaking and laugh at 3D. So yes, lots of conversation need to happen and leader like Apple going into the game make my job of persuasion a lot easier. Even tho Spatial Video right now basically is 3D video :P
@@hughhou Thanks for the quick reply, funnily enough im sitting here waiting for my laptop to hopefully not overheat and blue screen stabilizing something in Topaz :D I feel you on the 99.9% male audience, you have made me feel better about my 96% boys club. I personally look at this as a biome of immersive entertainment regardless of it being videos/game/360 tours etc etc likely you will end up looking at the others if you have the means to. All for one, one for all. Unless you are apple in which case sorry gamers. But to your point about Pico. Meta has done good things in the hardware space but badly fumbled the content delivery space and somehow made a worse metaverse than what existed in the early 2000s somehow going backwards with regional accessibility on their own offerings by moving some of their best content behind Horizon and locking the door to anyone not in NA. Sony seems to be struggling with the PSVR2 with one of their better VR studios going under and their store basically being res evil and GT games if you want a point of difference, live service games are dying like flies as well, its kinda hard to watch. I am curious if in your space you see much competition or comradery in your space, I see your work, the Pano VR teams and some great little docos on META TV (when it works) and YT but not a lot of breadth in variety. Cant really blame the big guns from shying away when I can only imagine you would need to be okay with being out of pocket to put together a bigger project, the only thing I can think of that might have some real world to VR translation would be anything made for the MSG Sphere or other Pano theatres. I guess where I was angling with the original question around Android/Iphones getting some native VR filming capability. I believe it could be a great piggyback and boost, think what PS3 did for Blu ray, and Meta uses Insta to push spatial hard. Sorry, If I ramble im quite enthusiastic about this stuff sometimes :D
If it were capable of recording 8K 180-degree videos, I would instantly acquire the Apple mobile phone. I must watch it on my Quest 3 headset tonight, and I'm curious to see how it impresses me. However, I think in this case one might have to wait for the next generation, until they have rearranged the lenses.
Hope can you find spatial video headset 1. $100 or less 2. Can watch spatial video 3. Watch panoramas video were video wraps around you can see video like Apple Vision Pro panorama 4. Headset that’s not zapbox
Well I will say Zapbox lol. But $100 is a tough call. There only 2 headsets can natively watch spatial video directly now - Zapbox and Viture XR - without trancode MV-HEVC. So you really only have 2 options unless you transcode them then all headset will support it.
Am i using the vision pro incorrectly? I see red and greed outlined like the old School 3D movies is it supposed to look like that????? I’m pretty much very dissatisfied with these overpriced paper weights and want to take them back but was hoping this would help change my mind but not sure if I’m seeing the video correctly
Would be nice for our European viewers to mention the consequences of framerates. Europe is using 50hz/25hz versus US/Canada 60Hz (59.94)/30Hz(29.97) Recording with 60hz in Europe is problematic especially with artificial light (50hz) Also, what are the consequences of viewing video in the headset, 60hz/120hz is not a multiple of 29.97 or 59.94. Neither is 120hz/90hz/72hz a multiple of 50hz/25hz . For sure people wonder why the video is not playing that smooth.....
this is just a better quality 3d video from the sonys 3d Bloggie does the same thing just lower resolution doesn't come near vr180 for immersion just a 3d static not able to feel like you are there disappointed and over hyped spatial video just normal 3d video thats all
Ok this was the LAST straw I’m taking this over priced pos back to apple the video looks terrible!!!! Look in all honesty the apple bison goggles will be amazing in 1-2 years time but not right now and and not for anything over $200 at this time PERIOD. I’ll be retiring these things back tomorrow
This is shot on iPhone 15 Pro Max just FYI. But ... the 3D camera is worse on AVP: th-cam.com/video/xPWe1S6yNyo/w-d-xo.htmlsi=GL5z_CwbrbKGpHG4 / Yes, wait for the next gen if you don't find it too useful for your workflow. 14 days return period don't miss that. We are keeping it as it is getting better everyday with new app coming and making it actually useful
Hugh, I don't mind spending some money if you give me a "taste" of your wares. By surfing through your "wares", it does seem that you are very "money" motivated (which is good). BUT, I think you'll do a lot better to "relax" on the "money" aspect, which will have the ultimate effect of increasing your profits. I took the faith of "registering" for what I thought would be some sample spatial video, only to find that YOU HAVE EVERYTHING LOCKED DOWN....UNTIL A PURCHASE IS MADE. Your sites say "ONE THING"....I ONLY CARE ABOUT MONEY....NOT YOU...NOR YOUR ENJOYMENT OF MY FRUITS. Relax Dude...put some stuff out there....then see what comes back. You'll be shocked. Stingy people always end up with nothing.
➜ Learn how I edit this video here with DaVinci Resolve: th-cam.com/video/PBGOpTsOyOA/w-d-xo.html
⬇ Download MV-HEVC version here (for Apple Vision Pro or device support spatial video only): bit.ly/4bRYTeY
This is a release as the older version has an issue. We tested on Apple Vision Pro this time and make sure everything works now!
thanks man, I have a Quest 3 and have been wondering what "Spatial Video" looked like, now I know. It will really be great for home videos, since it's super easy to use, it can be a super good tool for people to watch a video, or their parents or grand parents who are no longer with them later in life. I'm a Samsung guy personally, so I'm hoping they put this into their future phones.
I will have an indepth tutorial on Spatial Video when Quest 3 update is drop! Coming up tutorial will show how to capture spatial video on ANY CAMERA (not just iPhone or AVP)
Had a look on Quest 3 and I was blown away by this along with the demo Spatial vids on the quest.
May get the iPhone 15 pro or pro max.
Glad you think so! Check out this AI generated version as well on Quest 3: th-cam.com/video/qQv6ysfLEjw/w-d-xo.htmlsi=8KU5X2LAC4vkadC9
aah, the RED GREEN glasses...
i can remember that day in the 80's , they had a whole day promoting this type of 3D efects.
it was prety amazing..
graciaaaaaaas amigo tengo lo meta quest 3 eres grande
How did you upload 3D (anaglyph) video? What metadata did you insert? The official youtube info does not help (some sort of bug on youtube).
The instruction is here: th-cam.com/video/Odx5bNwdvOA/w-d-xo.htmlsi=qC7Phj7uxTGlKQ1r
Looks great on Quest 2! I'm really happy more people are going to start recording in 3D now that iOS includes the option. The only downside of this type of video is it's very easy to feel motion sick
Indeed. I am building rig to lock people down on their iPhone. As long as the phone is not moving it should be fine lol.
Some great shots Hugh. I watched this on Quest 3. I did notice for some scenes the depth of field between left and right eye was distinctly different (sharp in one, bokeh in the other). Any idea what was causing that?
Very sharp eyes! Yes, this happen in the latest firmware on iPhone. It is still a different lens that has different specs - sometime the phone is just not smart enough to correct them for some distance. Which is a major problem. I hope they are fixing it in the next firmware. But pretty sure the real way to capture Spatial Video is using Vision Pro or next iPhone (iPhone 16 maybe with dual fisheye?)
Hi Hugh!
I used my wife's iPhone 15 Max Pro to film a spatial video. But when I uploaded it to TH-cam, It wasn't in 3D and in the settings there was no "3D" choice as there is in your video here. Is there another step that I'm missing? Thanks for your help.
Thanks, Hugh, for another great informative video. You are always at the cutting edge, keeping us up-to-date. You are right in emphasizing the need to compose shots with items in the foreground - this is something I learned doing high-resolution stereo photography for decades that is especially important with the narrow stereo base between the lenses in the iPhone 15. The quality was impressive at 2160p, and the stabilization is amazing on the gondola went over the pulleys. By the way, I noticed in the Quest Browser app that the text in closed captioning seemed to fuse into a single image some of the time but at other times showed double.
Thank you!! You mean TH-cam automatically generated close captions or the Title graphic I added in the video?
I just started 3D photography last year, and totally agree.
I have been taking 3D photos with my iPhone 12 mini and quickly realized the small stereo base means anything more than 6 feet away loses depth dramatically.
I was referring to the TH-cam generated closed captions, not your titles.@@hughhou
couldn't find the link for the original MV-HEVC video.
regardless, awesome video. thx!
Still processing! Wait you have a Vision Pro? MV-HEVC will need Apple Vision Pro to see it.
nope! just want to mess with the files. thx@@hughhou
Just uploaded - check description. If you have an iPhone with latest firmware - that file will show Spatial Video label.
Happy New Year Hugh
Same to you!
Very nice! Great work!
Thanks a lot!
3D拍摄很漂亮！很好！我们喜欢！
Very cool! maybe you’ve explained this before in a previous tutorial. Is it possible to crop vr180 video into a regular 16x9 spatial video using Davinci resolve/fusion? A tutorial on that would be great!
Yes you can! I will make one soon.
Great. When can we see it?@@hughhou
Want to see this too
How did you upload it to TH-cam tho have options like Red and Blue 3D mode? Do you only upload the rendered SBS video?
I will make a full on post production tutorial next as this one has editing, time remap, 3D graphics insert that you won’t be able to pull straight out from the iPhone. Stay tuned for the tutorial on this one.
@@hughhou ok because I don't own an iPhone 15 Pro but have an DIY Stereoscopic cam, made out of two Dji Osmo Action (with self printed Rig) to record 3D Video. If I cut them together as an Half SBS video and view it through TH-cam, it looks Finde but I can't get all of the anaglyph features as you
Well, first thing based on your comment is "Half SBS" - which is the standard of old 3D Display but it is not Spatial Video. Try it with full SBS first :)
@@hughhou ok but how? If I edit it with both UHD eyes next to each other I couldn't get it to work like on your video with anaglyph mode. Or do I need a special video editing software etc? Using Luma Fusion and Final Cut on my Macbook
I have the same questions. I tried upload video so many times with the special tag "frame-packing=3" but all I got was only SBS video. 3D button is not available. Thank you!@@hughhou
Super cool!! Thanks for making this video.
Glad you like it
Does anyone know if the Vision Pro demo spatial videos are available online to view in the Quest 3?
No but everything on this channel are correct spatial video (donwload link provided) and we are also provide spatial video shot on the Vision Pro for download soon. Is that what you need?
Can this be watched in the Xreal Air?
I don't have Xreal Air - can you try it for us? It is 3D video so if Xreal support TH-cam 3D it should be able to play correctly. It works on Lume Pad 2 and other 3D display natively with no modification. The downloadable Spatial Video (I soon provide will only work on device support Apple Spatial Video format)
Found an interesting work around u have an iPhone?
Yes iPhone 15 Pro Max
i can watch sbs 3d videos with XREAL, its weird though because i see sbs for the preview when scrubbing through this video, but in fullscreen it's not sbs. @@hughhou
@@hughhou it only does SBS for spatial video. Looks like we can convert the Apple Spatial Video to SBS then view it on the Xreal. We can use spatialify to convert it to SBS.
Can't wait for the stereoscopic editing tutorial, hopefully tailored for Davinci Resolve Studio! Also, I can't seem to find the link in the description to download this video so I can watch it on my Zapbox headset.
Oh I still rendering the video lol 😂
How do u like Zapbox? Mine shows too large pixels from the lens
I love it for it is easy to review everything I shot to make sure I get the shots. For final enjoyment - I still use Quest 3.
Hi Hugh! Great Video.. I have download the sample footage (Directly to Vision Pro) and when I open the video, the aspect ratio is 1:1 (Square). It looks a little squished. Not sure why. It is spatial (3d) just 1:1 and squished. How do you edit these clips? I'm using Adobe Premiere Pro. Any videos explaining? Thanks buddy!
Thank you for pointing out the issue. I found the issue as well it is cause by latest VisionOS update - we fix it and post the new link inside our Pateron (still FREE). Try it again and let me know if this work for you now. Apple update break thing lol.
Hey Hugh, was the whole video enhanced with AI or just the cart scene?
Just the cart scene
This video looks great on the Quest 3, but some of the shots have a HUGE PROBLEM… one of the eyes has a blurry background and the other one doesn’t (like @2:45 on the video). I hope this is a bug that apple fixes pretty soon. Thanks for showing us this footage!
I think this is a native iPhone 15 Pro problem with 2 different lens. There is so much computing vision can do - so I don't think Apple can fix this completely. Vision Pro own camera will be better tho and maybe the iPhone 16
Yes its a hardware issue and not software so no way for Apple to fix it. Apple has to crop into the ultra wide lens to match the field of view of the regular lens. Best way to solve this issue with the iPhone 16 would be to have 2 main sensors. Also true that it'll be good on the Vision Pro for anyone who has the spare cash.
Hello from Ireland!
I have a Meta Quest 3 but I find the youtube 360 videos unwatchable through the Quest 3 (even using the Meta Quest 3 youtube app) the resolution is horrendous.... it looks looks somewhere between 144p and 240p.
Why Meta hasn't sorted this out is beyond reason? Do they want their VR headset to sell or not?
Mow, someone online pointed me towards DeoVR and it was a huge improvement in quality, but very little content and the content that is free to watch is mostly amateurish nonsense.
Is there a way to watch high resolution (proper 4K) 360 videos on the Meta Quest 3?
...and hello from Canada. When I first started watching the video in the Quest 3 TH-cam app in auto quality, the resolution dropped at one point to 144p and was very pixilated. I was able to view the video in extremely high resolution by choosing 2160p in settings>quality. When I tried TH-cam in the Quest Browser app, I saw side by side images rather than fused stereo images. Anyone know if we can watch it on TH-cam in the Quest Browser?
It’s b/c TH-cam VR default to low resolution to save bandwidth. You need to manually set to 2160P for the highest quality. Or you can also watch it Free on quest browser which can go up to 8K! Better than DEOVR. For content that shot and upload on 8K. That’s what I will recommend
Thanks for the swift reply, hughhou.@@hughhou
Is the Vision Pro expected to shoot in something higher than 1080 with the built in cameras? It would be a pretty big disappointment if they don't!
I highly doubt it. Might be able to push to 60fps but 1080P pretty sure is the limited and honestly not too bad. If you set the resolution of this video in 4K (2160P) - as it technically it is 4K (2 x 1080P), it looks really good on TH-cam VR inside Meta Quest 3 or other 3D display.
@@MetaverseStage that's what I think too but hoping they surprise us. Since each eye is 4K and they're filming in 8K for their own content for the headset, I hope they at least thought about it!
Did you see their content? Might be back to what we do here - VR180 or with the sensor match that 8K size. They will want filmmakers to shoot for them and most of them don't like to roll an iPhone on set lol. I am sure there will be 8K 3D camera coming if Vision Pro is launch. There are OTHER problem beside resolution I will touch on in the next video. Spatial Video is not 100% ready, at least for people who understand 3D.
Remember this is a v1 device. If it catches on, imagine where we’ll be in a few years…
I watched it on my LG 3D TV and looks awesome. The nearby contents have a good depth, but the far away contents looks flat.
Yes it is not design for far away depth
What is 3d Spatial Video? Is this just a fancy word for VR180 . what resolution is it. 8k?
3D Spatial Video is fancy word for traditional 3D video. It is only 1080P 30fps
1080 in vR sounds kinda bad. @@hughhou
It seems to be heavily based on the blu-ray 3D spec. Not a bad thing for a v1 device. Can’t wait to see Apple Immersive Video. A brand new spec created by Apple. I’ve also done some initial spatial tests on my channel, formatted for current gen headsets.
It's not shown in VR on the vision pro because obviously the resolution is pitiful. It's displayed like a 3D TV at distance with a hazy dream like border. I imagine the distance is set so it remains sharp. It's amazing reading pro apply reviews - they clearly haven't tried 8k VR videos before because this is nothing but a gimmick. However if it stimulates the VR180 market and my next Samsung has a stereoscopic camera....I'm all for this gimmick. But I doubt mainstream phones are going to throw dual fisheye lenses on their phones anytime soon.
@@bigdaddy5303 I hope you realize AVP has the best wearable display on the market at the moment. Even after what was announced at CES 2024. Hopefully there's surprises as the software catches up and devs get these in their hands.
This is getting very interesting would you classify spatial video as own name or is it part of metaverse or mixed realty I myself call it spatial immersive realty video(SIRV) curious what you call it
I just call it Spatial Video or MV-HEVC - what ever official Apple docs call it. It is really an effective codec to distribute immersive content that is ONLY 3D (so mono 360 will be bye bye) - so SBS, VR180 and VR360 or Volumetric Video if Apple will ever figure that part out
Very informative video Hugh! I have a Fujifilm W3 3D camera that I recently used to capture 3D videos during a Europe vacation. After processing with Topaz Video Enhance (upscaling and converting to 60 fps), they look decent when viewed through my Rokid Max glasses. Image stabilization is one thing that really caused issues with videos taken with the camera. I used Davince Resolve to stabilize the footage before Topaz processing, but still not great due to blurring when camera moved.
Assuming you've used the Fujifilm W3 or similar type handheld 3D camera, how does the iPhone 15 pro spatial video capture compare? Obviously, a bit better resolution at 1080p vs 720p and stabilization which is a big plus. I watched the video on my Quest 2 so figure the headset is limiting me from seeing the video quality at its best. My biggest concern is how well the 3D separation works with the lenses being only about 1 inch apart, but I'm surprised how well the 3D separation works in your example videos.
Try it on your Quest 2 or 3 - it is pretty good. And this is just beta firmware. It will get better with Vision Pro release
Hello, very good channel. Quite a PRO. On a low budget, I’m doing recording exercises with two parallel Insta360s, and it looks great, controlling the IPD between 5.5 and 7mm. How does that IPD thing work on the iPhone? Thanks!
It’s narrow but Apple has some metadata magic on MV-HEVC to get it back to 65mm normal view.
@@hughhou 🕶👌
Hugh, can you tell me how you put direction lock on moving Insta 360 pro 2 footage. It is not an option in the insta360 pro editor. I've been watching all your videos looking for an answer. I don't want to make my viewers sick. Please help!
That is a big problem on Pro 2 - the only way to solve it (and I believe I have to a tutorial) is to use Mocha to track a distance center object (not moving) and then lock the direction with tracking. Only way around. Mistika VR can do it as well
Thanks a million!@@hughhou
Did I hear correctly? The max resolution of spatial video is 1080P @ 30fps??
How are they able to achieve realistic 3D when the lenses are not nearly as far apart as human eyes?
Okay this just change. There is third party app get it up to 4K 30fps and 1080P 60fps with HDR!!! Will have a tutorial soon.
What app?!?
Great video Hugh! I can't wait to see your editing video. I upgraded to an iphone 15 pro and have been taking vids using my insta360 flow. I've used spatialify to watch on my quest but the vids aren't great. Anything more than a slow pan causes the movement to be blurry. My zapbox should be delivered shortly so hoping that will let me see if the spatial video looks ok before I convert to SBS with spatialify.
Yes! Check out this even faster solution here: th-cam.com/users/shorts168BL4a7tAw - looking at red & blue you can tell is the 3D look good or not!
Thinking of the most polite way to put this. Some people are going to love the way small things can be made to look really big close up. Other people having these things waved around at point blank range in high definition are not😂
Lol!
One more questions for you! Do you know how Apple Vision Pro users will watch spatial video from other people? Will it be on TH-cam similar to what you shared in this video? If spatial content really is that much better, I'm assuming Instagram and TikTok will support it at some point.
Right now there is no social media on Apple VisionOS so people will need your physical video airdrop to them or their own capture. To watching others, someone will need to go tho the iTune release process to get the Spatial Video to massive. We have no idea what is process take for independent small content creators like us. B/c Apple don't really care about us. Only big box studio like Disney, WB or bigger channels have that access and all of them sign NDA so on one know how YET. I am sure the answer will get clear when Vision Pro is finally here. But only legit 3D movie now with IP is converting into Spatial Video and available to be purchase on iTune. But I can see it will go the Podcast route. It is sux tho Apple only open to Compressor and prob FCP next - so for Premiere and Resolve users, we will have to wait or learn a whole new software system. Just like the whole Swift vs Unity drama Apple is throwing. You need to learn Swift to develop on VisionOS - even they advertise Unity Support. It is a close source vs open source system... basically, lots of learning
@@hughhou thanks! Luckily I use FCP so I'm hoping there is so sort of workflow at the time of release. If they plan on selling 10m units of their next version they will have to have some sort of social media support. The Google/Samsung headset is supposed to be released late 2024 and they'll definitely have some sort of social integration.
Currently, you can easily convert using Spatialize, then edit in something like After Effects. Which is what I’ve done on my channel. Gonna get interesting!
what is the difference between a 3D Video and this one?
🔥Strong video as always! But one question I do not understand:
1.) Why does this work? I thought approx. eye distance is always needed between the 2 cameras?
2.) If not: Why do you then need at least 6 cameras for 360° 3D and not just 4 (e.g. 2x 180°)? I thought eye distance is the reason...
3.) And if 4 are enough why is insta360 using at least 6 in their professional hardware?
I don't quick get it neither - it is computer vision Apple developed. Only Apple Enginer can answer that
Crazy...can you see any differences to real distance ipd 3D videos?
looks Great on my Q3. Watched 1st in YT app and next in Quest browser, The browser requires fiddling with settings but seemed to look better to me. Thanks for the tips considering content subjects. Right now, people have to really want to watch 3D content because of the barrier to entry. At some point in the future the Barrier may switch to people avoiding 2D content Because It just doesn't look as good. . I think you will be the father of the 3D revolution by the way you are going, and it's right that you came in strong right here at this moment in advancement , right now with Kimchi. :) I'm staying tuned and considering what is interestingin what I do that I may show with this new power. Thanks! I'm Looking forward to see what is next.
Wow thank you 🙏🏼 I really hope so:) I need to check on Quest browser next. I actually only watch it on TH-cam VR app which has recent improvements on 3D video playback - this in 4K look really good just in TH-cam Quest 3 app :)
@@hughhou sei il padre del 3d! continua cosi amico.
Thanks for letting us see the disappointment. I mean this would have been cool 6-8 years ago, but its like 3 steps back when you used to 360 3D and even what the $300 Evo VR 180 can do.
Well, we are a little bit ahead of the curve but most consumer has no idea what is 3D 360 or VR180 - 3D is already over their head... But see my new video? Vision Pro can play VR180: th-cam.com/video/fvUtaRTqWLw/w-d-xo.html
True, lets hope it wakes people up to the potential of VR!
Looks quite good on Quest 2. I will wait to upgrade my iPhone until it can do 60fps at much higher resolution as 30fps is just not enough. The scale needs to be fixed too. Hopefully after Apple Vision Pro comes out, camera manufacturers will start releasing serious VR cameras with 8k at 60fps.
Thank you! Good choice 👍🏻. iPhone 15 is a afterthought for spatial video
More great stuff mate, thanks for your persistence in and around immersive video.
Question for you and your audience!
It feels to me and i am probably wrong, that we are in an interesting spot with VR/XR/AR/180/360/Spatial, where across the board we are are starting to see some issues with adoption resulting in a plateau in quality content videos, gaming or otherwise. Without going on a rant, I feel that the apple vision pro's success or failure might be a turning point either direction.
Spatial video is great but do you foresee Apple or Android including a competitive/quality 180 or 360 video solution in their upcoming phones and would that coupled with an affordable headset or display conversion (think better google cardboard) without undercutting the AVP be the way to go?
I still love watching people try VR for the first time, its the only way to sell someone on this and ultimately the biggest barrier. Anyone for turning Car lots into VR lots?
Thank you and totally agree! We hope the Vision Pro is a turning point for immersive media. But we can't know what Apple is going to do and no one will know. So we have to see. So far Meta is heading pretty strong in the space. With Pico drop out of the race, I think immersive Filmmaking is still a new but growing market. My job is to create content tailor NOT to gamers or male audiences - but audiences are are new to immersive film - non-gamers, movie watchers or in general female audiences. (99.9% of my audiences are male tho lol). Technology will adopt if we can get more viewers into the immersive viewing and better storytellers come into the space. There are lots of Directors I talked to refuse to touch immersive filmmaking and laugh at 3D. So yes, lots of conversation need to happen and leader like Apple going into the game make my job of persuasion a lot easier. Even tho Spatial Video right now basically is 3D video :P
@@hughhou Thanks for the quick reply, funnily enough im sitting here waiting for my laptop to hopefully not overheat and blue screen stabilizing something in Topaz :D
I feel you on the 99.9% male audience, you have made me feel better about my 96% boys club.
I personally look at this as a biome of immersive entertainment regardless of it being videos/game/360 tours etc etc likely you will end up looking at the others if you have the means to. All for one, one for all. Unless you are apple in which case sorry gamers.
But to your point about Pico. Meta has done good things in the hardware space but badly fumbled the content delivery space and somehow made a worse metaverse than what existed in the early 2000s somehow going backwards with regional accessibility on their own offerings by moving some of their best content behind Horizon and locking the door to anyone not in NA. Sony seems to be struggling with the PSVR2 with one of their better VR studios going under and their store basically being res evil and GT games if you want a point of difference, live service games are dying like flies as well, its kinda hard to watch.
I am curious if in your space you see much competition or comradery in your space, I see your work, the Pano VR teams and some great little docos on META TV (when it works) and YT but not a lot of breadth in variety.
Cant really blame the big guns from shying away when I can only imagine you would need to be okay with being out of pocket to put together a bigger project, the only thing I can think of that might have some real world to VR translation would be anything made for the MSG Sphere or other Pano theatres.
I guess where I was angling with the original question around Android/Iphones getting some native VR filming capability. I believe it could be a great piggyback and boost, think what PS3 did for Blu ray, and Meta uses Insta to push spatial hard.
Sorry, If I ramble im quite enthusiastic about this stuff sometimes :D
If it were capable of recording 8K 180-degree videos, I would instantly acquire the Apple mobile phone. I must watch it on my Quest 3 headset tonight, and I'm curious to see how it impresses me. However, I think in this case one might have to wait for the next generation, until they have rearranged the lenses.
Hope can you find spatial video headset
1. $100 or less
2. Can watch spatial video
3. Watch panoramas video were video wraps around you can see video like Apple Vision Pro panorama
4. Headset that’s not zapbox
Well I will say Zapbox lol. But $100 is a tough call. There only 2 headsets can natively watch spatial video directly now - Zapbox and Viture XR - without trancode MV-HEVC. So you really only have 2 options unless you transcode them then all headset will support it.
@@hughhou might get zapbox $80 thank you!
I plan to get it do you have any promo codes thank you
2 million subscribers channel selling
Am i using the vision pro incorrectly? I see red and greed outlined like the old
School 3D movies is it supposed to look like that????? I’m pretty much very dissatisfied with these overpriced paper weights and want to take them back but was hoping this would help change my mind but not sure if I’m seeing the video correctly
I’m also trying to view it on my Viture xr glasses I see the same as you I don’t think I’m doing it right…
Thanks Hugh! You inspired me to create this: th-cam.com/video/rTfGTh_Dpe8/w-d-xo.html. Please do not stop pushing the limits of VR videos.
Love it! Keep it going! I just sub you and looking forward to more of your immersive content!
@@hughhou My videos are there mostly because you were kind enough to share your knowledge and time.
👍
Would be nice for our European viewers to mention the consequences of framerates.
Europe is using 50hz/25hz versus US/Canada 60Hz (59.94)/30Hz(29.97)
Recording with 60hz in Europe is problematic especially with artificial light (50hz)
Also, what are the consequences of viewing video in the headset, 60hz/120hz is not a multiple of 29.97 or 59.94.
Neither is 120hz/90hz/72hz a multiple of 50hz/25hz .
For sure people wonder why the video is not playing that smooth.....
I actually mentioned it here and a solution to handle that problem: th-cam.com/video/n2Hc2ZQbUik/w-d-xo.htmlsi=OkJ0v2UREMjmjLID
Sweet !
I watch 2024 spatial video on my 2011 LG 3D TV
Apple vision pro is so scam
this is just a better quality 3d video from the sonys 3d Bloggie does the same thing just lower resolution doesn't come near vr180 for immersion just a 3d static not able to feel like you are there disappointed and over hyped spatial video just normal 3d video thats all
Yes correct. This is shot on iPhone 15 Pro Max - not a 180 camera lol. The fact that anyone can do it is the key (even Kimchi and I can shoot it lol)
Ok this was the LAST straw I’m taking this over priced pos back to apple the video looks terrible!!!! Look in all honesty the apple bison goggles will be amazing in 1-2 years time but not right now and and not for anything over $200 at this time PERIOD.
I’ll be retiring these things back tomorrow
This is shot on iPhone 15 Pro Max just FYI. But ... the 3D camera is worse on AVP: th-cam.com/video/xPWe1S6yNyo/w-d-xo.htmlsi=GL5z_CwbrbKGpHG4 / Yes, wait for the next gen if you don't find it too useful for your workflow. 14 days return period don't miss that. We are keeping it as it is getting better everyday with new app coming and making it actually useful
Hugh, I don't mind spending some money if you give me a "taste" of your wares. By surfing through your "wares", it does seem that you are very "money" motivated (which is good). BUT, I think you'll do a lot better to "relax" on the "money" aspect, which will have the ultimate effect of increasing your profits. I took the faith of "registering" for what I thought would be some sample spatial video, only to find that YOU HAVE EVERYTHING LOCKED DOWN....UNTIL A PURCHASE IS MADE.
Your sites say "ONE THING"....I ONLY CARE ABOUT MONEY....NOT YOU...NOR YOUR ENJOYMENT OF MY FRUITS.
Relax Dude...put some stuff out there....then see what comes back. You'll be shocked. Stingy people always end up with nothing.