วีดีโอ

please re-do this with gaussian splatter

Outstanding!

I really hope that one day this is used to make street view on google completely 3D, you could literally walk around cities in virtual reality. Imagine when your older getting to see child hood locations in 3D VR

how big are the files?

Wonderful! I came here from nvidias nerf, so you developed this beauty 2 years ago ?

Is this something open that I could try using?!

I wonder what this could mean to the movie industry; you could have a place captured with several images and have the scene be purely CGI. That looks promising!

will this see a code release? =) impressive.

Awesome - In terms of measuring in the model, what's the accuracy like?

Any publicly available programs or links that allows anyone to do something close to this at home? It's mighty impressive and a step beyond regular photogrammetry.

This is nice!

Very impressive results!

Next you would be able to do this with video. Imagine a rendered concert out of short video snippets from the crowd. You can also apply this to events. 9/11? Kilimanjaro explosion? Wow. Just wow.

insanely amazing work. next you just need to let the ai detect and semantically tag separate objects in the scene, tag humans, vehicles, etc. and then you could reimport it and change elements in existing scenes like with deepfakes, but in 3d. has insane implications for video encoding, ai vision and ai object comprehension, etc, semantic ai understanding of whole scenes and relevance. you could upsample lower quality movies into high resolution 3d scenes. when this is applied to video, we would potentially be able to import whole scenes from a movie into blender or similar software. ai vision will be one of those items mentioned in the top 50 inventions since the wheel in a century's time. you guys are literally knee deep in creating history. Arthur C. Clarke was prophetic; "Any sufficiently advanced technology is indistinguishable from magic."

My implementation: github.com/kwea123/nerf_pl/tree/nerfw I'll try to make another tutorial soon (still need to think about how to present the work beautifully). For the moment here's some paper results' reproduction: nbviewer.jupyter.org/github/kwea123/nerf_pl/blob/nerfw/test_phototourism.ipynb

Is that awful looking blur a result of nerf or done in post?

Please release the code <3

1.000 likes

Hello! Nice content. How long does it take to render? Any info about hardware usage, memory, time etc, everything you know would be much appreciated. Also, can radiance field be converted into an obj or any other 3d format?

how many pics do you need?

could this output be used in Blender? (great content btw)

Is it safe to assume that Nerf-W has a basic knowledge of the world and guesses what is behind a pillar?

So my question is, when i want a 3d model, do i still need to run sfm (or are there any ways to get a model)? If yes, Would you be able to combine NeRF with sfm in order to get a better 3d model? For example the AI could be used in masking and cleaning the input before sfm calculation, so you get higher consistency in your simulated "input" data for sfm. The ai could additionally caclulate the best angles for the virtual photos then used as input for sfm, or when combined with sfm, an ai could be used to actively request better images where needed (eg when the point cloud data is sparse), so i imagine it would be a self-correcting mechanism.

It would be nice to able to use it and convert this into an OBJ file to use it on a 3D software like Blender, Cinema 4D, Maya, etc. What are your thoughts about that?

when we get to try this for auther images

Such an elegant method ! Congratulations, you have made one of the most powerful softwares in History 😍 And I know how hard it is! I worked on a similar program this summer using a homemade Tensorflow raytracer, and could just reproduce a fuzzy "3D" apricot from preprocessed 64×64 images 😂

Fantastic. Any idea if / when the code will be released?

How can i get in the beta program to assist???

I think Elon Musks "quantum leap in Autonomous driving software " is linked to this.

It is 2020 dammit. About time minority-reports quality scene reconstruction becomes a thing! Imagine then applying live video to those models. 8-) Amazing work!

This is 🔥🔥

As a senior hard surface modeler, the gate with adjacent structures would take me about 2 to 3 days to model.

The results are really impressive and I am looking forward to testing it.

This is groundbreaking. I would love to play with this software...

Fantastic achievement! Well done!

So basically you're mostly optimizing for intelligent cleaning of the input data, everything else is mostly photogrammetry. Are you doing any predictive reconstruction of missing information gaps or does all information have to be included in at least one of the input sources? Could it fill in one of the columns based on the ones that it managed to capture? Can in guess the aspect of the roof/dome of the cathedral from the information it gets from the exclusively low angle input photos? Very interesting project

Someone in the porn industry will find a use for this in no time.

The future isn't just coming... It's here.

I wonder if a few years from now, there'll be no more vertexes, surfaces, textures in computer graphics... it will all be one big neural radiance field.

wow...

amazing

Saturation: 500%

Can this be used to obtain the parameters and textures for a PBR material that will replicate the appearance of the real thing under angles and lighting conditions not present in the original dataset?

Fantastic. Incredible work. Has so much potential!

awesome!!!!

jolly good work ... now spin up a public server so we can feed up our own set of images and get back the 3D synth object scene - Thanks ... and yes micro$oft bought similar tech they called photosynth - remember seeing the TED talk on that project

Microsoft Photosynth!

🤯

This is awesome! I love it!

Nice job!