- 193
- 65 517
BitCrushingCog
เข้าร่วมเมื่อ 21 มิ.ย. 2009
AR/VR Engineer
mechpil0t
mechpil0t
A map based Youtube search/browser demo running on the Apple Vision Pro
Using the TH-cam API, the demo places geotagged TH-cam videos on the Cesium 3D map tiles, when selected the video is opened in the browser.
#designium
#designium
มุมมอง: 27
วีดีโอ
Apple Vision Pro Geospatial content placement demo
มุมมอง 95หลายเดือนก่อน
Objects placed on the #Cesium Google 3D map tiles are saved to a database that can be reloaded in #AR on location as Geospatial API Anchors #designium #AugmentedReality #AppleVisionPro
AR City Monitor on the Apple Vision Pro
มุมมอง 96หลายเดือนก่อน
AR City Monitor on the Apple Vision Pro 🔍 Checking the air quality, pollen count and traffic conditions of the viewable map area. This demo combines Cesium with Google 3D map tiles, the Google air quality, pollen, and directions APIs to give users real time data about the map they are viewing. #designium #cesium #augmentedreality
Cesium Google Photorealistic 3D Tiles running on Apple Vision Pro
มุมมอง 1012 หลายเดือนก่อน
Cesium Google Photorealistic 3D Tiles running on Apple Vision Pro with the Google Places API thanks to x.com/tarukosu for finding the solution! #designium #applevisionpro
Hybrid AR content authoring.
มุมมอง 742 หลายเดือนก่อน
Hybrid AR content authoring. Combining the Cesium Google 3D map tiles & the Google Geospatial API to author AR content at or near a location. The @GoogleARVR Geospatial Creator is great for remote authoring, but I always need to go and check at the actual location & authoring content accurately can be challenging from ground level in AR. This prototype combines #AR & 3D maps to try to optimise ...
re:post - Google Geospatial API on the Gundam Statue in Odaiba
มุมมอง 652 หลายเดือนก่อน
re:post Using the Google Geospatial API to give the Gundam Statue in Odaiba some equipment 🔫🙂🛡️ A good test of accuracy for the #geospatialAPI The virtual objects are from this sketchfab model sketchfab.com/3d-models/gundam-rx-78-60142fe11f9d41ddb412e1b67ee855ad #AR #AugmentedReality #designium
AR Checkers by the river
มุมมอง 185 หลายเดือนก่อน
Testing out collocated position sync using image tracking and Photon Fusion on the Apple Vision Pro #AugmentedReality #designium #AppleVisionPro
#AR checkers. Experimenting with Photon Fusion on Apple Vision Pro.
มุมมอง 635 หลายเดือนก่อน
#AR checkers. Experimenting with Photon Fusion on Apple Vision Pro.
Outdoor to Indoor AR navigation
มุมมอง 3655 หลายเดือนก่อน
Outdoor to Indoor AR navigation 🚶 This prototype uses the Google Geospatial API for outdoor navigation and transitions to Immersal to continue the navigation indoors. #designium #AR #AugmentedReality #GeospatilAPI
Experimenting with hybrid historical AR on Apple Vision Pro
มุมมอง 426 หลายเดือนก่อน
Experimenting with hybrid historical #AR on Apple Vision Pro. Combining a 3D model & historic photos to restore a historic scene of tattooed people in Odaki Falls in Nanushinotaki Park. Photographs from "The Tattoo Writer" (fantastic book) placed at the location they were taken 70 years ago. A 3D model generated by tripoai's photo to 3D tool and one of the historic photos. Thanks to Pascal Bago...
Nezu Tokyo: digital heritage on the Apple Vision Pro
มุมมอง 616 หลายเดือนก่อน
More digital heritage on the Apple Vision Pro. Restoring a destroyed building in Nezu, Tokyo to its original location using #AR with a scan by @kazugoru I like the way the original garage lines up with the new house 😀 Nezu has some great old buildings but they are being rapidly replaced. #AppleVisionPro #AugmentedReality #designium #history
Apple Vision Pro music visualizer I made in Unity with reactive video
มุมมอง 506 หลายเดือนก่อน
Apple Vision Pro music visualizer I made in Unity with reactive video
Hands free AR navigation experiment on Apple Vision Pro (RAW Footagee)
มุมมอง 447 หลายเดือนก่อน
Hands free AR navigation experiment on Apple Vision Pro (RAW Footagee)
Hands free AR navigation experiment on Apple Vision Pro
มุมมอง 747 หลายเดือนก่อน
Hands free AR navigation experiment on Apple Vision Pro
Download a 3D model directly from Sketchfab into Unity on the Apple Vision Pro
มุมมอง 1397 หลายเดือนก่อน
Download a 3D model directly from Sketchfab into Unity on the Apple Vision Pro
Testing out the Google 3D map tiles on Apple Vision Pro
มุมมอง 5537 หลายเดือนก่อน
Testing out the Google 3D map tiles on Apple Vision Pro
Ruin has come to the Apple Vision Pro: Playing Darkest Dungeon on the AVP
มุมมอง 547 หลายเดือนก่อน
Ruin has come to the Apple Vision Pro: Playing Darkest Dungeon on the AVP
Importing Sketchfab models from the browser directly into Unity on the Apple Vision Pro
มุมมอง 567 หลายเดือนก่อน
Importing Sketchfab models from the browser directly into Unity on the Apple Vision Pro
Digital heritage on the Apple Vision Pro
มุมมอง 627 หลายเดือนก่อน
Digital heritage on the Apple Vision Pro
Using the Google Geospatial API to place objects on the Apple Vision Pro
มุมมอง 2477 หลายเดือนก่อน
Using the Google Geospatial API to place objects on the Apple Vision Pro
Walking Visualization on Apple Vision Pro
มุมมอง 468 หลายเดือนก่อน
Walking Visualization on Apple Vision Pro
Lightship Maps SDK + Google Places API working on Apple Vision Pro
มุมมอง 1199 หลายเดือนก่อน
Lightship Maps SDK Google Places API working on Apple Vision Pro
Open AI API and Google Gemini API play Dungeons & Dragons together
มุมมอง 259 หลายเดือนก่อน
Open AI API and Google Gemini API play Dungeons & Dragons together
Large scale procedurally animated monsters interacting with the Google GeospatialAPI geometry
มุมมอง 2610 หลายเดือนก่อน
Large scale procedurally animated monsters interacting with the Google GeospatialAPI geometry
personalised AI recommendations using user personas & location
มุมมอง 57ปีที่แล้ว
personalised AI recommendations using user personas & location
Hey! Can I connect with you to learn more about the development? I would like to develop something similar to this for my school... If yes, please let me know :)
feel free to connect on X/twitter @mechpil0t
So is it like "streetview" just with videos taken in that spot/area? pretty cool conzept for restaurants 😍
@@KirintoGaming yeah geolocated videos, particularly good for restaurants and live houses
That looks fantastic! How was you able to run Cesium on the Vision Pro?
see my reply to the other comment
Hello, so what was the problem? I tried to do the same and it didn't work out for me...
github.com/CesiumGS/cesium-unity/issues/409#issuecomment-2325620383 but they are working on AVP support I think so the problem will probably be fixed soon
can you please share what frameworks you've used for this demo? Unity + Cesium or others?
Unity and Cesium for Unity with the Google 3D Photoealistic map tiles, thats all
That’s amazing! How did you do this? I’d love to give it a try if you have a GitHub :)
Hi! Sell me source code pls and instructions 🙏
hi, DM me on X/twitter (@mechpil0t) and we can discuss
How do you move AR objects in response to interactions? Objects created with the Geospatial API are not recognized as being hit by the user's touch. I would like to know how you operate AR objects.
They are colliding withe the Geospatial API Geometry
sir can you help me how to create this?
yes, DM me on X/Twitter (@mechpil0t) to discuss
💙
wow
Plss sir give me source code
give? no, but you could buy it ;)
Do you have a video tutorial for this
no I dont have time to create tutorials but if you want to discuss is you could DM me on X/Twitter (@mechpil0t)
Is this an app? Could you do this in WebGL?
not a full app, just a prototype I made. I dont think it would be possible in web GL yet
Hi there, so you're using your phone with google geospatial API to create the anchors but what do you use in the visionpro to place them in the environment? Is it apple cloud anchor or are you also using google geospatial api in the AVP? BTW, really cool work :)
yes the phone uses Geospatial and I send the relative position to the AVP, which then just places a gameobject. The tracking on AVP is so good it will be stable even if you walk away hundreds of feet and come back.
hello nice demo dude but i wanna ask you if there is any tips to follow i already used the api but it didnt work as you can u provide some references
check if there is street view coverage where you are testing
Can you do a video showcasing anchoring to indoor locations with google geospatial? Google has persistent cloud anchors that "Scan an indoors location and use this saved location later in your augmented reality experience." However ive not been able to figure it out for indoors? For example, creating an art tour that can be shared on XR devices So that people walking through the same room can see the same 3d models in the same location. Eg there may be a model in each corner of the room, and in the centre of each wall. Or having a different model appearing in different rooms. I know how to do that with geospatial creator for google anchor point outside based on lat and long, but inside im having trouble figuring it out indoors.. Ive seen some people do this through an nfc code or qr image on the wall.. but it would be much better if it could be done solely on the device like it is with geospatial creator with their stock solution or something universal.. So that everyone using the app can see the same things indoors, just like you would in street view.
the only indoor locations that I think can support the Geospatial API would be locations that have been streetview mapped like some train stations and malls have. Otherwise there would be no way for the Geospatial API to localise. you would have to use a separate VPS - like I show in my video "Outdoor to Indoor AR navigation" you can change to different VPS like Immersal or Lightship to go inside
Wow, that's a big thing
🎉
You're the most impressive creator ive come across with unity arcore. Could you please do a test to try to replicate ar with cesium and unreal using arcore where you can place objects in ar space and view them at the location on your device. It doesnt seem like theres any tutorial out there on how to do it with unreal even though they have arcore.. if theres anyone who could figure it out, i feel like it would be you!
Haha thank you but I have actually never used Unreal yet so I'm probably not the best person for the job. If I have some free time in the future I would like to try Unreal AR out, although I do feel like webXR is the more promising future AR technology. Its hard to know where to commit the time.
@@BitCrushingCog that's fair. It would be awesome if you did sometime! I feel like there are a lot of great tools for xr with unreal, especially nanite for Android devices now. So incredibly high res models in xr, quite cool Webxr looks really interesting! What software will you use for it? Wouldn't unity and unreal be able to do that too?
@@gunterstunter ATM webxr is things like threeJS, 8th wall etc
Soon this will be on every device!
Great job! How did you do this?
I got the map data from Cesium 3D map tiles in Unity
@@BitCrushingCog somehow i can't get the correct material for Google photorealistic maps with Cesium and Unity on visionPro. I can't build neither due to some errors. How did you manage to make it work?
@@AlessioEbani cesium unity isnt supported on vision pro yet so you have to pre-save the meshes. yeah vision pro hates these meshes for some reason and the standard materials look terrible so you have to use a custom shader or manually modify the material settings at runtime which I am doing
Can all of these videos your making regarding the apple vision also be implimented with the quest 3?
yes I could make most of them work on a Quest 3. I have a Quest 3 and have been meaning to make some AR content for it but haven't had the time yet
@@BitCrushingCog nice!
@@BitCrushingCog your videos are always quite cool! Any tutorial videos would be awesome to see too 😎
Awesome! Is the code open?
no but you can buy it ;)
@@BitCrushingCog how to buy?
Impressive! A few questions, are you there live in person or is this a pre rendered scene? And how have you connected unity to your vision pro? Or is this something you made in unity to be able to import models in real time?
hi. this is running and recorded on the device, no pre-rendering or anything. I made the app in Unity, the browser and importer are all running inside the Unity app
Nice
Imagine Technology a better Stabilizer than your neck. xD Chat GPT teaching me english: stabilisieren auf englisch Copilot The German word “stabilisieren” translates to “stabilize” in English1. It refers to making something stable or firm. Whether it’s stabilizing a structure, a process, or even a situation, the goal is to ensure stability and prevent unwanted changes. So, next time you need to stabilize something, just remember: “Stabilize!” 🌟🔧
what the hell is this comment lol
@@BitCrushingCog I wanted to say that the cameras on the Vision have better stabilisation than your head. Because the video is shaking a bit. xD And I'm not a native speaker so I asked GPT to translate for me.
@@KirintoGaming lol it was the "Copilot " part that confused me
@BitCrushingCog that was just the part GPT gave me. XD
Always-Random-Room-Generator!! ARRG
Wow I want THIS :O
Better video quality would be great. Can't read any text... Keep up the awesome work!!
the quality is what it is, its recorded on the AVP so cant really improve it, the text is too small I grant you haha also the AVP makes virtual content more transparent the faster you move so thats another issue
@@BitCrushingCog Does it look better inside the headset? Or is the text unreadable there too? Maybe you could increase the font size for your demos. :)
@@KirintoGamingthis was the first demo I made haha so im still learning on device everything looks 100x better than in the recorded videos the AVP has pretty amazing quality
@@BitCrushingCog I really enjoy your demos! Are they just for learning purposes right now or do you plan to expand on them later?
@@KirintoGaming thanks man. My job is prototyping for AR. So some of my demos become bigger projects and some just remain demos/learning experiences
What recognition/anchoring method are you using?
In this demo I am manually placing them as the Vision Pro does not support VPS at the moment. However I am working on ways to get it working. See my previous video.
This one is super cool!
Hit test?
yes I am using the google geospatial geometry to place objects on tap of the phone
Is this possible with unreal? If so could you show us how?
i dont think Unreal supports vision Pro yet
Hello, I would like to ask a question, how do you send the mobile phone positioning results to vision pro, and the anchor in vision pro is rendered by unity? ?
UDP and yes all made in unity
😂😂😂😂😂😅
Nice
Damn this looks beautiful ✨
Nice work! How did you get around the LocationService requests? I can't seem to ignore them.
Can you explain a little more? I only get one permissions request at app boot.
the google maps sdk has deprecated is there any other way ?
this is using google places api, the small map in the corner could be replaced with the niantic lightship map sdk?
this is fake
if i was going to fake a video i would make it look better than this haha its real
funny because with my xreal glasses I cannot do that. The screen is moving with me and does not stay in one specific place. So obviously its fake and obviously you lie when you say its not fake@@BitCrushingCog
@@marcusachberger Maybe read the manual of the stuff you buy next time. You need a beam for the base xreal glasses and then you can do the same. The video here showcases a demo unit from 1 year ago. People like you are why the world is a shit place.
Cool
Do you have a tutorial for this?
sorry man, no time
Please help me! Tell me how use? GPS or image tracking?
geospatial api?
Coud you make of video ? This is very interesting.
this is a video xD
That's amazing! I've been looking into combining those 2 SDK's in a project of mine so i'm really glad to see that it's possible. Did you have any difficulties with this? maybe in building to iOS?
i had issues building/crashing when building using Unity 2022, but rolled back to 2021.3 and its fine now
Does wanderbot have an api or a github code?
no sorry, its using the open ai api
Nice is this terrain anchor ?
yes, terrain anchor for the geospatial part, wayspot anchor (private scan) for the niantic/lightship part
How did you create the anchor?
Is plane detection possible without a script if i use google geospatial api(ex. Wall detection)?? I cannot test it because i live in a country where the geospatial creator not supported😂
A script is needed to set up the geometry
Does geospatial work with unreal too?