I Faked 8K 3D 360° with AI...and it looks *GOOD* 😵 | Insta360 X4 vs. Titan
ฝัง
- เผยแพร่เมื่อ 26 พ.ค. 2024
- In this video, I reveal how I managed to fake 8K 3D/Spatial 360 video using AI, and the results are kinda GOOD*! 😵 Join me as I compare the AI-enhanced monoscopic footage from the $400 Insta360 X4 to the professional 3D 360 camera, Insta360 Titan - which costs $20,000! Watch till the end to see how I use AI to elevate 360 videos to the next, SPATIAL level! Don’t forget to like, comment, and subscribe for more groundbreaking tech reviews and tutorials!
*Footnote: GOOD, but still has problems just like any AI video 😅
Watch on Meta Quest 3: (Available after LIVE tomorrow)
Download and Watch on Apple Vision Pro in 16K (8K by 8K) MV-HEVC: bit.ly/4bPG7UC
Here is a short tutorial on how you can do it with Immersity AI: • AI turns 2D 360 into 3...
Insta360 X4: bit.ly/Insta360X4cam
Insta360 Titan: bit.ly/insta360titan
Topaz Video AI: bit.ly/3H7OUEd
#Insta360X4 vs #Insta360Titan #immersityAI
![[LIVE] : ONE ลุมพินี 68 | คู่เอก "พระจันทร์ฉาย vs โจนาธาน"](http://i.ytimg.com/vi/F3IM3w-XchI/mqdefault.jpg)
Great video, Hugh! This is wild for anyone who ever shot on a mono freedom 360 rig! lol all those gopros and now 3D!
讲述很好！很清楚。加油！❤
Very impressive and I can't wait to see what it looks like in a year. Moving shots still have too much of an issue, but I tested out one of my videos diving with sharks and it's still really cool.
Diving with sharks?!? Where can I see it?
Hello,
Very interesting video.
Do you think is it still interesting to invest on insta pro 2 regarding result we have with insta X4 and AI ?
I m curious to compare 3D photo with Titan vs Pro 2 vs X4 in interior. Do you have sample ?
Also i m looking for insta pro 2 sample in 3D 11k to compare with Titan 11k native.
Thanks for all your video
I am waiting for this for months!!!
16K version - AI generated another eye so 8K by 8K is also now available on Apple Vision Pro :)
This stuff has crossed into future tech that most people have simply not even imagined possible. It is an amazing future we have to look forward to.
Indeed! I am very heavy into AI tech on image reconstruction and enhancement and depth map generation. AI get a back rep on image generation - but in image improvement is where the power of AI shine. More to come. We are doing alots of research with very smart people around the world to breaking new ground everyday on this channel :)
Looks great, especially so when the camera is moving..
Very interesting test, thank you!
The drone footage is fantastic in VR headset, street view image quality isn't as impressive.
Its got potential Hugh, we can't look for anything near perfection at this stage as it is such a fast developing technology. It certainly makes the 3-D footage more interesting to look at than the plain 2D. I have been using Halodepth for converting my drone 360 footage reframed and in 3-D. The results are excellent and the only area where it tends to fall down is with peoples faces.
I wanna see this, I been thinking about selling my titan360
Wait don't sell it yet. Watch this first!
@@hughhou titan 360 looks so much better, but its also a lot harder to edit and use than the x4
If you go on a price point below 3k just mention me :) (I am just a private person that uses such stuff for vlogging memories so nothing I earn money with)
I want to try this with my One RS One Inch. Have you tried with yours?
Artificial intelligence really creates a very good 3D effect! However, I did a test with a photo and imperfections appeared in the images, such as distorted hands, for example.
Yes! It will just get better. tho
看起来不错。明白！❤
cool! How do you fly the insta360 X4 which drone did you use?
Here: th-cam.com/video/Qz-9JmL7UNg/w-d-xo.htmlsi=zwXm4Mk8u5QNn1Yw
What is the name of the software?, and Hugh if you are in Spain I am living in Santander, Spain at the moment
Immersity ai. 1.Their tech does look amazing... 2.He should probably add the link to vid description
I don't want to make my video sound like a promo video lol to keep my unbias. But I should include the link.
@@hughhouthanks
Any news on the Qoocam 3s Stitching Problems etc? Or the Qoocam 3 Ultra Release?
Yes but again I can't say anything
@@hughhoujust wink if within the next month !
Oh sorry it seems I oversaw a reply from you. Sorry I sadly seem to get no notifications anymore from TH-cam :(
I want to see this. How can I download for Quest3?
I will upload it on Quest TV soon.
Pretty intereresting but I can't really imagine that this works good enough (even though I would love to see this work since travelling with the Pro 2 is not eas - it is loud, really big and therefore not usable in many scenarios where it shouldn't be too obvious etc.)
Theoretically speaking, I trust AI to be able to inject frames much better than constructing 3d from 2d, or even upsampling with hallucinated details.
You guys watch the video and then tell me what you think! Both are correct and AI is progressing scary fast!
48€ for a 10min video is crazy :( isn't there anything that can be executed locally so I do not pay per minute? :|
But this is not your fault, really great video, 3D360 is the future, thanks a lot! :)
I might have a local solution coming up soon that require 20G V-ram - wait on that solution :)
20G Vram is no problem, would love to see that 😍
what about 6dof spatial 3d?
That is also coming up :) We are showcasing it in Computex with NVIDIA and then I will share it here but if you are in Taiwan, come see it in person!
@hughhou thanks! wish i could be there!
Wow!!
Yeah!!!
Sounds interesting, but may very well be excessively cpu and human-time expensive. We shall see if the video changes my mind, but for now I feel like the better path would be getting two Insta360 X4's and convert them (proven Facebook hack) into 8K VR180 each. That way you'll get almost 16k 360 3d (towards the sides there would be little to no 3d effect) and enjoy the flexibility of two disconnected cameras.
[GPT4o assistance mode on lol]
Using a second VR180 camera in the same scene can provide various benefits and additional creative options. Here are some practical ways to use a second VR180 camera:
1. Multiple Angles: Place the second camera at a different angle to capture the same scene from another perspective. This can be especially useful for creating more dynamic and engaging VR content by providing viewers with different viewpoints.
2. Close-Up Shots: Use the second camera for close-up shots of specific subjects or objects within the scene. This can add detail and focus to particular elements, enhancing the overall immersive experience.
3. Elevated/Drone View: Position the second camera at a higher elevation or attach it to a drone for aerial shots. This can give a bird’s-eye view of the scene, providing a unique perspective that complements the primary camera footage.
4. Background Shots: Place the second camera in the background to capture different background details or action happening simultaneously. This can enrich the storytelling by providing additional context or background activity.
5. 3D Effect Enhancement: Position the second camera to focus on areas where the 3D effect is more prominent. This can enhance the depth and spatial awareness in specific parts of the scene, making the VR experience more immersive.
6. Time-Lapse or Slow Motion: Use the second camera for capturing time-lapse or slow-motion footage of the scene. This can be integrated into the main footage to show the passage of time or highlight specific actions in detail.
By using two VR180 cameras creatively, you can significantly enhance the visual storytelling and immersive experience of your VR content.
How do you get 3603D just with 2 x4? The need to have the same eye distance between ALL lenses, sp 2x 180°3D will work but not 360°3D.
@@captteemo9133You're right, it wouldn't be true 3d360, but would certainly be much easier to handle than let's say four x4 cameras in vr180 each then trying to stitch that 32k mess... I still find vr180x2 as a good compromise. You'd have 3d effect looking straight forward, and when turning straight back. Better than 2d 360 that's for sure...
2X X4 for VR180 workflow is coming as my 2nd X4 is finally here (so poor now, but F it, making content for your guys is more important), but I am going to Taiwan for Computex so it will take me 3 weeks to finish this.
@@hughhou❤❤❤ You mean hardware-hacked two X4's into two VR180's??? I'm curious: would it be easy to stitch two vr180 cameras with overlapping 90 deg for enjoyable 3d240 or so? What about one vr180 capturing the entire room (20 ft from person), then the second vr180 being 4ft from person then creating a pseudo 12k vr180 where the center is very sharp but the sides are lower sharpness?
P.S. $5/min is wayyyy more than it's worth it for me for new content. Maybe for my old 360 footage, or childhood VHS even (upsampled, framerate boosted, 3d'ed, color enhanced, who knows what else can be done for it these days hehehe)...
@@Fatman3054 X4 does not make sense, they would film themselves :D so half of the lenses would be wasted. Before doing this you could built a rack with 4 -6 cameras yourself. Btw you need eye distance for real 3D
I didn't think the 3D effect was very good considering what AI is capable of. The problem is that it appears to work on individual frames rather than gathering information from the neighboring frames before and behind the frame being processed. Those could be used to fill in the background when an object is moving in the foreground which should fix the smears. I also did not think that a service should be necessary to do the 3D processing. Anyone with a decent GPU should be able to do it on their own computer and it would likely be done a lot faster. I am sold on the idea of 3D processing 2D 360 degree video though. The idea is a winner. The current implementation is not.
Hey BlueHound! Immersity definitely uses all surrounding frames for depth estimation, that's why the depth is coherent and doesn't shake every frame. The idea you're discussing for filling in the occluded areas is called "inpainting", and newer versions are being developed now. Anyone can try to do the same thing locally, a lot of competing solutions exist, including free and open source ones. The thing is they're much worse quality! Feel free to compare for yourself.
@@nimazeighami1909Not sure why the same thing could not be done faster on a 4090. Why couldn’t this be an app you buy rather than a service?
@@BlueHound Well, when using Immersity, it runs on multiple 4090s, so it'll be slower if you only use one. Also, most people don't have a computer with a discrete GPU, let alone one with a 4090. Also, we did release a version of this for Mac and Windows years ago, for free, and no one used it, in part because of the GPU requirements. Finally, it's our proprietary model and our business model is to make 3D conversion accessible to more people and as an API.
If you want to run a free depth model on your own GPU, those are available, they just have worse quality than us.
@@nimazeighami1909I wish you success with your software then. Sorry I did not realize I was talking to the developer. The 3d looked good.
@nimazeighami1909 I totally understand what you are doing from a business perspective. Sadly this restricts people like me who spent their whole money on a 4090 in order to work with the 8k footage for private vlogging for documenting my life (tons of hours 8k material that needs to be upframed with topaz and cutted + audio synced with resolve). So your service would just be so much more expensive than a 4090 after just a few days of vacation videos.
The fact I haven't used your old version is because I did not knew about it.
If you really would care about us you would offer a "host yourself" / "run yourself locally" license (same pricing model as topaz, lifetime but updates need a fee so you still have money for development).
Dont waste money on AI man. Most AI companies are going bankrupt anyway.
Let the AI companies crush each other till the best emerge, then use them
Hmmm. My monthly subs: midjourney, chatgpt plus, claude opus, udio, elevenlabs....and will soon add a bunch more because it's *immensely* fun (and occasionally biz-useful lol)
Lol this is the only AI company can do this so not really completion...
I used mostly open source stuffs like Stable Diffusion and build / train my models for copyright reasons and avoid the AI pitfall. But that is a very good list. Got me googling elevenlabs lol
No, thanks. Checked as a pro 3d stereo video maker, i see here bad quality, bad depths. The same as 3dtv-s auto conversion, which definetly helped the death of 3dtv-s. These crazy things, should be gone! We need real 3D recordings, 6dof, parallax when you look around, etc. No just "magic". Just my 2cents.
For professional filmmaking absolutely true, but for private videos I would love to see this enhanced in the future. Ai is evolving rapidly now (not comparable with times of 3D TVs) and I guess in 5-10 years this actually could be usable, together with Topaz to convert 360 videos of small 360 2D cameras to a decent 360 3D quality. There are many use cases where I can't pull up my pro 2 on holiday: restaurants with live music e.g. → Other guests feel pressured and see it very intrusive seeing this huge camera filming, but using a smartphone or e.g. small 360 cameras that they interpret as regular action cams are totally fine. Or other places where it is just faster and more convenient to quickly pull up an qoocam 3 ultra instead of the loud Insta360 Pro 2.
But I would love to still see some developments making e.g. the Pro 2 more user friendly or smaller but this is limited by the eye distance and >4 lenses requirement for real 3D360
@nimazeighami1909 I totally understand what you are doing from a business perspective. Sadly this restricts people like me who spent their whole money on a 4090 in order to work with the 8k footage for private vlogging for documenting my life (tons of hours 8k material that needs to be upframed with topaz and cutted + audio synced with resolve). So your service would just be so much more expensive than a 4090 after just a few days of vacation videos.
The fact I haven't used your old version is because I did not knew about it.
If you really would care about us you would offer a "host yourself" / "run yourself locally" license (same pricing model as topaz, lifetime but updates need a fee so you still have money for development).