Tested In-Depth: Structure Sensor 3D Scanner
ฝัง
- เผยแพร่เมื่อ 7 ส.ค. 2024
- Will and Norm sit down to discuss the current state of consumer 3D scanning technologies, including the Structure Sensor 3D scanner. This iPad accessory uses the tablet as its brains to scan rooms and objects in real-time, creating files ready for modeling or 3D printing. It's what we used to scan Jamie at our live show!
Learn more about the Structure Sensor at structure.io - วิทยาศาสตร์และเทคโนโลยี
![แฮงแงงแฮงงาม - บอย ศิริชัย [OFFICIAL MV]](http://i.ytimg.com/vi/vCGJTy9ZeP8/mqdefault.jpg)
Surface normal is the angle relative to the camera. It uses the red, green, and blue channels to store x, y, and z axis information.
Man, thats so frigin amazing, we're living in awesome time.
Thank you, that saved me an unwarranted purchase. This is interesting, but definitely ruled out for the smaller objects that I want to reproduce.
I was just about to turn off when you showed the 'Room Capture' application, that is very cool ! When this gets into full swing it's going to be incredible !
That thing behind Norm is fun to watch and see it change.
It looks like the depth sensor resolution is limited, and that is causing the limited resolution on the model.
What's that cool led matrix in the background? That thing is amazing!
Cool video, keep up the good work.
If you want to continue testing this, I would suggest a build project to mount an iPad tripod mount on a camera dolly truck and then attach the dolly truck to the pedestal with a strong. This would allow you to keep a constant distance from the model in a perfect circle with repeatable process.
The beautiful thing about this sensor is that you don't need to use a dolly. Because it uses the accelerometer, gyroscope, and compass in the tablet, the software understands the camera's relative movement.
But wouldn't it result in better, more accurate final resolution if you reduce the tracking issues associated with hand shake and stepping while circling the subject?
Tested You can get started with the free software and a 30 dollar Kinect on eBay its not wireless but you can test the technology without breaking the bank
***** no it wouldn't be more accurate. but it could be faster because the tracking wouldn't be lost.the accuracy could be enhanced by reducing motion blur in case you move more than one sampleunit in one frame. this will be unlikely for every frame and the framework should detect motion blur and other "bad sampling" cases, thus your solution is problably not needed
Anyone else get the Glass Age ad with Adam and Jamie before the video. I just did and I thought it was kinda funny/cool even watched the whole thing without skipping.
I think everyone watched it all...
can you help with a full body photogrammetry scanning system...
Does anyone know where they got the light-box that's sitting on the table behind Norm, or know of a build guide is on how to make one (preferred). Thanks.
I think it's from ledpixelart.com They did a video on a development version a year or so ago.
It's Jeremy's GameFrame, ledseq.com/product/game-frame/
Nick Gillotti What Ben Lovell said is correct. It's a Game Frame.
Video published on my birthday =)
Hey, what cool light up cube in the background? :D
How can i use and ipad and structure and a drone to scan a large statue? what are the current updates? maybe a revisit.
Tested @13:24 Bottom right image is a normal map! Each colour represents the direction a surface is facing in the world XYZ
The surface normal would be the direction the surface is facing. You can see that the flat horizontal surfaces are all indigo, the ones facing the camera are light green, etc.
Such a shame that they never released this for the majority of people.
where did u get the portal turret?! please do a video!
I remember back in the day, in order to 3D Scan anything dark, you had to powder it in white flour or corn starch. That was more for those red laser based scanners though. Maybe that could help with this.
after the scan of a room..can you remove furniture...walls etc?
Can someone please provide the list of all the software that Jamie and Adam talked about ? Just want to make sure I got it all.
Wonder how long it will be before this is in Airports
You guys really need to review the metric system. Your approximations are way off. Good video though.
On the contrary my friend. You need the review. The sensor works at 0.3m (30cm), which is ~ "a third of a meter". Weird, but Valid statement.
What was the tool mentioned at the end? something like xray view... about the 20:50 mark
does anyone know why the scanner doesnt scan plaster of paris models very well. Is there a way to get the scanner to pick up the object better? He mentioned black and silver 'double wammy'?? WHY what is the negative with those two and is there a preferred colour?
@14:21 lol!!! , Great review guys, cheers!
hey guys. This scanner is really cool. Is there a system that would allow for an instant scan, or allows for the subject to move? I'm looking to scan animal heads/faces, and they are a bit difficult to keep still for a scan. Something under $10k.
This thing still Works with ipad air with IOS 11?
Can you comment on the different scanning options for a full body scan that can be printed on a 3D Systems 660: APPS, Photogrammetry/Laser full-body Booths, hand held... Thank You.
Was looking at these a few weeks ago, It would be awesome if I could just walk around and scan a building or room in more detail, If you didn't have to stand still with the room one I would buy one today.
What's odd is that there's nothing stopping Occipital from doing exactly that, technologically speaking. They just haven't coded the area scanning software to take advantage of that. Project Tango is further along with regard to that functionality.
Are you going to review the Mark II version?
How about "Fuji FinePix Real 3d W3" camera for 3d scanning? Anyone knows on hand experience?
Very cool
Why do all the portable 3D scanners I see only have the cameras along one axis? Is it too expensive to have a camera on a second axis? Like a triangle array?
surface normal is generally used to describe how light interacts with a surface. when used in video games normal maps can be used to give the illusion of details so small that it would be labour intensive for the engine to render in real time if they were hard modelled in. in this instance they are being used to pick up textured surfaces to better define the scan. it's actually really neat that it's able to do that.
Aye! I imagine it could actually be used to capture a normal map. Say I scan a person, retop him and unwrap him. I'm sure you'd be able to have the program map its scanned normals to a UV map, and then generate a normal map,
I feel that it's worth noting that while that is, as you say, what a surface normal is often used for, it's not what it /is/.
Will should read the 'Normal (geometry)' page on Wikipedia, but intuitively the surface normal tells you which way the surface is facing. When you look at your (presumably flat) computer monitor straight on, its surface normal will be pointing at you.
Interesting video there, I wonder that is the structure scanner able to scan the whole human body from head to toe ?
spraying the black object with an aerosol of arid extra dry could possibly make the scanner pick up more detail. Afterwards the powder can be wiped off. Otherwise some one could use baby powder / corn starch for the same effect.
this is gonna be awesome for indi game devs, scan rooms and people to make meshes. on an ipad, for a reasonable cost. (this is very early but i cant wait to see where this goes, Standalone 3d scanners instead of apps)
Does it works with iPhone ? I can not use it ! And I try with the pc and is not very easy
Whit this item y can print in 3d a wherever object what doing scanned?
So I want to scan my 7yo grandson who's about 4' tal then eventually 3D print small statue on my 3 D Printer? You're doing heads. How about full body scans?
Is it compatible with AutoCAD?
That's pretty neat
I am increasingly interested in this technology to use in films. Imagine scanning an entire room filled with actors with a 3D scanning video camera. Creating scenes you can move a camera around freely in. Want a close up. Move the camera in.
woo! tested!!
What print is behind Norm? Eboy? Links?
These guys should help out on Mythbusters
*****
Now that you put it that way, I also think it would be a great idea to have them on Mythbusters, it would be hilarious.
The new Tory and imahara? Or however you spell their names
Spectacular! rifle mourn What's your opinion about
Cool Theo Jansen tshirt!
it can be used to get alphas to use in zbrush.
Its cool but I want to see it inbuilt on a smartphone.
Very Good for R/C Plane builder that use CNC technology.!! Thumbs up nice Gadget Guys.!!
no use for fucked up mesh, cnc is about 0.001mm me bought educated cnc and 3d artist, you have to rebuild the mesh, sure it could help mb for reference, but you still have to model your models by your own hand with the mouse, knowledge is required :D
I didn't see anything usable
Can you guys please attach an iPad to a phantom and program it to fly around and fully scan something.
Can you reduce the poly count for use in game design?
If the provided software doesn't allow for lower resolutions, then most modeling software that would be used to clean up the model most likely could let you smooth out higher resolution details. None of the information they captured would be used natively for game design, it would most likely be used as a type of base object to clean and build up from.
I look forward to when we can do this real time for games, so we can interact with real people
David Laser Scanner NEXT! PLEASEEE!!
there is this awsome technic but you can´t turn a picture while editing? ;-D
I somehow expected more Jamie, still cool though.
Can this be used on other tablets, samsung tab s
nope coz crapple is the only company that exists.
You should consider running this again 5 years later with the new Mark II sensor. It doesn't seem like this has really taken off yet but maybe the time wasn't right in 2014-15
mainly the CANVAS application which looks like it may be a huge step forward for a real world application that could make this technology very desirable.
Umm "1/3 of a metre" , "3/4 of a metre" .. are those SI units?
4:58 AAAH! OH MY GOD! Wow! I didn't expect that! XD
+NotASpyReally Why not zoidberg?
***** If I were willing to think right now, I could possibly reply to you with a very intelligent answer.
I want to get into 3D scanning and someone tipped me this scanner, I'm siked that this review is now about 6 yaers old, curious how this evolved!
th-cam.com/video/F8kutn1Xu-U/w-d-xo.html -- these guys are just using the sensor on the brand new iPad (2020) ... that's the future
Cubify sense or Structure sensor
which one is better?
i dont care about the ipad requirement!
just about the functionality and other things!
"A third of a meter"
A-HA-hahaha
but it's correct
awesome
If there were multiple cameras configured as CCTV in known positions and orientations
"A third of a meter". You Americans are making the metric system cry right now!
Definitely early days for this technology, and it won't spit out a usable final mesh, but it would be great for reference for large objects and rooms. Photogrammetry is probably still the better option for now, and it doesn't require additional hardware.
You guys don't have fractions in Europe?
666Tomato666 A good use of a phrase that should never be used outside of comedy.
Aside from half, I don't think I've ever heard anyone use a fraction on the metric system. It makes little sense given that it's designed with a range of smaller/larger units in mind. We don't need to use messy fractions like the US system, like 1/16s.
Credit where it'd due to Will for knowing and using both systems in this video, but it was just a very American way of applying it! No offense intended to my US pals.
BlobVanDam Can we at least be glad he didn't use decifeet?
xnamkcor X Oh my, that's a real thing?!
I want one of these so I can take a 3D scan of a giant valley and make it into a map on some sort of FPS game.
I hear there’s something called Google Earth…
isn't it how kinect V1 works??
For what it is it's bloody amazing, a 3d scan in colour too ...... my ten year old self's head just exploded in the past.
Normal would most probably pick up surface fine textures.
another idea like 3d printing, 3d scanning is for better or worse a prototype tool. this being said an animator could have an idea and roughly block it out with shapes IrL and then scan it in then start working from there.
rotate by 90
Is there something similar that is not apple product?
Yup, but not exact the same.
"Revopoint POP" is more similar, is new and more "cheap/accesible", have good quality of scan for the price.
If you have some Iphone you can use apps to 3D scan for the front camera, "EM3D" is one famous one (Even going even far, the last [Iphone 12 Pro] have a Lidar for 3D scan near to the back camera), but the apps with fotogrametry are always the best.
For that you can use any PC with a Nvidia GPU using the software "Meshroom", you only have to take a lot of pictures and voilah~
But if your going to use a PC for 3D scan like this, you can use a Kinect camera from a XBOX 360 using the software "Skanect" or "RecFusion"
Hope that can help you c:
A non Apple solution is photogrammetry. The photogrammetry model using Meshroom and a Canon SLR camera had much more geometry details and the texture was also better than the model this Apple contraptions produced. Apple contraptions = Structure Sensor (Mark II) and IPad air 4. Software I tried was Scanner sample app and itSeez3D. I am disappointed with the Apple stuff's output. My work bought it with EON-XR licenses. Photogrammetry does not have this model size limitation but you need a Nvidia GPU etc to construct the model in Meshroom. I don't think you need a SLR camera, a cell phone camera should work too.
The scanner does a much better job if you run an aftermarket app called itseez3d (free). Also when you get to the print side (color), you really want to have stationary lights and a rotating object to limit shadows and post production. If ya wanna see Jamie in full color, send me the file!
Maltese Falcon!
Amusing device.
3:46 - 3:48 ?
If you put the device on a lazy suzan and kept the object still, it would know it's moving.
Tablets? I thought it's just for 'I' devices? I like Skanekt, but their resolution capture could be better.
Naw, Occipital also sells a (rather overpriced) "hacker" cable that interfaces with standard USB for Android tablets, PCs, robots, etc. They also don't sell the custom brackets for other devices, but they did release the CAD data so you can just 3D print your own to fit.
Thumbnail suggested way more Jamie than there was. :-(
Wow, this is so not worth $500.
Road test before buying but $500 good point
works best with empty rooms...sounds useful
+luke889h +Adrian Butterworth Would you recommend it for measuring applications? Could I scan piping networks and tell the diameters for example?
Norm seems irked that Will is stealing his thunder
if i would use it the best current use commercially, i would pair this with a next gen version of oculus thats wireless, can see you hands and know were it is in a 3d environment that can detect real world movement that accurately moves in 3d space as you move IRL.
i would 3d map the interior of houses for sale, take them to my mac clean them up make them look better, then put them back on an iPad.
then when showing buyers around a house/Interior decoration i could give them a pair of vr goggles and they would be able to hold the iPad chose furniture, place and see it in front of them.
and the customer could walk around the IRL house while being able to visually decide what colour paint they want the walls, match them with curtains and so on.
(sidetone* with the advances of how pc's can handle light, you might even be able to tell how a paint will look like in the sun, rather than the matt paint or when its in the dark. often you will have no idea what a paint will look like in every environment until you have actually painted it.)
you would even be able to scan the costumers current furniture and input it into the new house.
Someone will put this on a drone and will do crazy stuff with it.
maybe u could use an kinnect.
you can with the software it is bundled with.
MYTHBUSTER COOL
Heat map? omg. one is a depth map the other is normal map
This is so awesome!! but creepy as well somehow ^^
z-depth - heat map xD nice
OMG it's the matrix
looks like we still have a few haters thumbing down just for the sake of it, there is no real reason to thumb down this vid.
Really. Pure spam. Scanner seams useless. Ya it looks all great when running it but if you noticed, hardly anything they did was usable. I liked the room scan idea but that's a joke.
My xbox camera and skanect software seriously blow this thing away lol. I paid $25
How large have you tried? Could you scale a car?
+peyton mcvinney up to the Eiffel tower
What!!..that insane. :D
+Mindy More did you fly around it?
You could probably paint a particularly shiny item with elmer's glue if you really needed to scan it. Might need to be willing to ruin it, but you know.
gray plasitdip would work better as it's removable, matte finish and wouldn't ruin the odject
Create a 5 nights at Freddie's animatronic pls
Not to be a jerk, but the Kinect 2.0 is significantly better (in both resolution and adaptable lighting. I would love to see a 3d scan with proper IR and the better scan erm... code..(algorithm) it offers. Check the tech demo Microsoft did before they launched their new console to see what I mean.
This is cool to see in application, but the depth quality and caveats mentioned (like not being able to differentiate skin tone) made me cringe.
The Microsoft demo software puts skinnect to shame. Download and compare