I'm definitely interested in a getting started quick guide for getting started with Nerfs. Been meaning to get into it but it's hard to know where to start so I'd find it super helpful
@@EveryPoint absolutely! I think it would help lots of people. This is really cool tech I think a lot of people would appreciate a straightforward introduction to!
No way I am down this nerf rabbit hole and you are not only doing the remote chance thing I'm researching and now you're modelling my hometown icon. If you are in the area awesome. We have similar interests!
Just stumbled upon your channel while investigating NeRF and integrating it into my VFX workflow. Super useful stuff. Good level and length of videos! Subscribed and will be keeping an eye out for future vids. Thanks!
Dude! Fellow Pacific Northwesterner here, please do a beginner tutorial!!!! I am making a very VFX-heavy pitch and have been relying on the Matrix city released in UE5 and being able to creat a mesh from a nerf of part of a city would be amazing!
@@beytullahyayla7401 For me, tinycudann compiled properly but on running 'pip install nerfstudio', pytorch with cuda gets removed and pytorch without cuda support gets installe.This caused the issue with preinstalled tinycudann. Easy way to go around it is by again running commands to install pytorch with cuda. (Tinycudann requires pytorch with cuda to run) Once you do that, it should be resolved. Also use nerfstudio 0.1.18 instead of default which is 0.1.16 [pip install nerfstudio==0.1.18]. Let me know if it helps
@@mohitgupta5000 Thanks for the answer, to be more clear i'm getting this error NameError: name 'tcnn' is not defined because i can't install tinycudann properly. I'm getting this error when i try :× Encountered error while trying to install package. ╰─> tinycudann note: This is an issue with the package mentioned above, not pip. hint: See above for output from the failure.
hi jonathan recently i got way too old xbox Kinect to scan my entire house but its only capture half of the room . i would like to know is there any other way to scan my entire interior of my house like i tried vslam but its doesnt work . please guide me if you got any idea. My old house gone demolishing within a month ,so i have a plan to capture my entire house in 3d . kind of preserve my nostalgia and happy moments in this way . so let is there any way to capture my house
Does anyone know wether its possible to calculate the accuracy of such 3d modeling process? I use photogrammetry for surveying and thats exact math so im able to calculate the accuracy of such process, but this is basically a trained ai to do it for me, so id love to know the math behind it so it could be used for exact replication with calculatable accuracy
If you are using the locally hosted viewer is there a way to set up the command line prompt to give you a link to the locally hosted NeRF viewer link? Or will this just send you a default link to the general web viewer?
Hi @EveryPoint, I have been following the development of nerve since last year, and over the winter break, I missed all of this. Could you make a video from 0 with the installation of Nerf Studio, please? I'm working on my PhD and this information will be really helpful, In trying to use Nerf to recreate a 3d models of insects.
Can we utilize these 3D models for training to use as dataset and further using in MD DL? if yes then how? and if not which tools is used commercially for real time dataset of 3D to use in our training purpose? thanks in advance
Do you know of a way to get the 3d mesh info transcribed through an API into a modelling program such as Blenders Geometry Nodes to have it generate assets with adjustable parameters?
More vram allows you to input a greater number of total megapixels into a project. However, a more powerful card speeds up rendering time. Nvidia suggests RTX 20xx or higher. We found that a 3080 or better is ideal. The older cards take a long time to render.
Hello! I just discovered your channel and I'm finding it very useful as im also working on a similar project at work, where i have to reconstruct a sort of 3d model from videos pointing to a coast from the sea from a medium distance. The videos would not go over the entire scene 360 but they will cover just a portion of these angles, mostly front-facing. I ran over these Neural Fields some days ago and I tried them of linux, and I was just astonished by the performances and speed of the results. Do you think instant-nerf of nerfstudio (which also includes a spatial distortion technique for unbounded scenes -> similar to the original NeRF's NDC technique for front-facing unbounded scenes) would be a good solution for my task (even if not taking 360degrees videos I could maybe extract a sort of 2.5D model of the scene) ? Thanks in advance!
At 11:47, there are two obj files. How is the mesh.obj generated? Is this part of poisson mesh file or is this an independent mesh generated using other method? if so, which method? Thanks again for the tutorial!
What you are seeing here is two meshes, both generated using poisson surface reconstruction. One mesh is the initial result, the second mesh has been optimized at a target number of triangles.
Hello! Do you know if nerf can work with 360 (equirectangular) images? I have many 360 images of a house in diferent position, would like to test to generate a model
You can make NeRFs using cubemapped images from equirectangular output. However, results are mixed. Nerfstudio also supports the fisheye lens outputs from the 360 cameras.
How would you say nerfstudio compares to something like luma? im interested in making nerfs, but the pros and cons of each way to make nerfs are not very clear
Nerfstudio is primarily meant for researches, scientists, and software engineers. It is also useable for creators, however, it has a steeper learning curve. Luma AI is more targeted at creators who want to make VFX and visualizations with limited ability to modify parameters. Both are great options.
My Assumption is that 3D-Asset-Markets will get flooded with highpoly-meshes, which are totally useless for videogames, unless you want to retopo everything. Am I wrong with that?
I'm definitely interested in a getting started quick guide for getting started with Nerfs. Been meaning to get into it but it's hard to know where to start so I'd find it super helpful
Would a 15 minute "Getting Started With Nerfstudio" video be helpful?
@@EveryPoint absolutely! I think it would help lots of people. This is really cool tech I think a lot of people would appreciate a straightforward introduction to!
@@EveryPoint I keep running into errors when trying to follow the official nerf studio guide, so a tutorial might help a lot 💯
@@EveryPoint Definitely!
No way I am down this nerf rabbit hole and you are not only doing the remote chance thing I'm researching and now you're modelling my hometown icon.
If you are in the area awesome. We have similar interests!
We are in the Pacific NW, stretched between Salem, OR and Redmond, WA. We drive by this icon periodically!
@@EveryPoint thank you for all of your responses. What an exciting time to be alive with technology!
Lol I'm in Tacoma and was looking for a NerF reference for some buddies. Guess I found the right vid!😂
Need a getting started video around 15 minutes or less. Segmented and marked on your video so we can follow it easily.
This will blow up
We're on it!
Just stumbled upon your channel while investigating NeRF and integrating it into my VFX workflow. Super useful stuff. Good level and length of videos! Subscribed and will be keeping an eye out for future vids. Thanks!
For sure its very useful. everytime I see a new video from you I know is somethign worth a watch, and this one was no exception.
Glad it was helpful! Also, thank you for the kind words regarding the usefulness of our content.
非常感谢，教程演示给了我很大的启发，虽然没有从事相关的工作但我希望能自己尝试成功这一技术
Dude! Fellow Pacific Northwesterner here, please do a beginner tutorial!!!! I am making a very VFX-heavy pitch and have been relying on the Matrix city released in UE5 and being able to creat a mesh from a nerf of part of a city would be amazing!
👌🏾cool vid could you do a ' how to train your Nerf video ' Next💯💪🏾
Thank You for sharing ...Cheers :)
yes please make a video on nerfstudio installation. I found the process simple to follow but tinycudann does not compile properly.
Same issue for me, could you find any solution :(
@@beytullahyayla7401 For me, tinycudann compiled properly but on running 'pip install nerfstudio', pytorch with cuda gets removed and pytorch without cuda support gets installe.This caused the issue with preinstalled tinycudann. Easy way to go around it is by again running commands to install pytorch with cuda. (Tinycudann requires pytorch with cuda to run) Once you do that, it should be resolved. Also use nerfstudio 0.1.18 instead of default which is 0.1.16 [pip install nerfstudio==0.1.18]. Let me know if it helps
@@mohitgupta5000 Thanks for the answer, to be more clear i'm getting this error NameError: name 'tcnn' is not defined because i can't install tinycudann properly. I'm getting this error when i try :× Encountered error while trying to install package.
╰─> tinycudann
note: This is an issue with the package mentioned above, not pip.
hint: See above for output from the failure.
hi jonathan recently i got way too old xbox Kinect to scan my entire house but its only capture half of the room . i would like to know is there any other way to scan my entire interior of my house like i tried vslam but its doesnt work . please guide me if you got any idea. My old house gone demolishing within a month ,so i have a plan to capture my entire house in 3d . kind of preserve my nostalgia and happy moments in this way . so let is there any way to capture my house
Have you encountered the issue that transforms.json is not created using customer data?
Would you like to share your customer data?
Great tutorial - I will definitely be experimenting with Nerfstudio!
Have fun! Please share your results with us.
thanks for helpful tutorials. getting this message the whole time Could not find ffmpeg. Please install ffmpeg
im looking for example using drones taking images of crops
hi hello.. i want to ask, when i train model i got error message "FileNotFoundError: [Errno 2] No such file or directory" how to fix that?
Please makea video about how to use nerdstudio to train a nerf
Does anyone know wether its possible to calculate the accuracy of such 3d modeling process? I use photogrammetry for surveying and thats exact math so im able to calculate the accuracy of such process, but this is basically a trained ai to do it for me, so id love to know the math behind it so it could be used for exact replication with calculatable accuracy
What happens when you feed it a bunch of data from varying sources of a similar object?
What you are describing is NeRF in the Wild. Check out the project page: nerf-w.github.io/
If you are using the locally hosted viewer is there a way to set up the command line prompt to give you a link to the locally hosted NeRF viewer link? Or will this just send you a default link to the general web viewer?
Hi @EveryPoint, I have been following the development of nerve since last year, and over the winter break, I missed all of this. Could you make a video from 0 with the installation of Nerf Studio, please? I'm working on my PhD and this information will be really helpful, In trying to use Nerf to recreate a 3d models of insects.
Can we utilize these 3D models for training to use as dataset and further using in MD DL?
if yes then how?
and if not which tools is used commercially for real time dataset of 3D to use in our training purpose?
thanks in advance
well that's complicated with all that code. Why can't the software just run those behind the hood with an easy UI?
How is that different from standard point and cloud softwares like WebODM for example?
Do you know of a way to get the 3d mesh info transcribed through an API into a modelling program such as Blenders Geometry Nodes to have it generate assets with adjustable parameters?
Your best option to is reach out to Luma AI regarding their API and integrations.
Hi,
Is it possible to export in STL format and than upload it to 3d printer?
That's very interesting, but this mesh is not usable for any kind of production, unfortunately.
Great. Do you have video from A to Z for noobies? Iwhant to learn this 2d to 3d but how to start?
How to start in to new PC? What must install end how? A to Z?
Noob question, what program are you using to open the finished mesh? Thx
What video card is worth getting? More vram is better?
More vram allows you to input a greater number of total megapixels into a project. However, a more powerful card speeds up rendering time. Nvidia suggests RTX 20xx or higher. We found that a 3080 or better is ideal. The older cards take a long time to render.
I don't know how to use nerfsutdio.
Fantastic demo. Very useful. Have you played around with some of those default parameters yet? Any improved results, if so what did it?
Not yet! That would make for a great follow up video.
I cant install nerstudio. I'm getting tinycudann error :(
Can you create a textured mesh from instant NGP?
Hello! I just discovered your channel and I'm finding it very useful as im also working on a similar project at work, where i have to reconstruct a sort of 3d model from videos pointing to a coast from the sea from a medium distance.
The videos would not go over the entire scene 360 but they will cover just a portion of these angles, mostly front-facing.
I ran over these Neural Fields some days ago and I tried them of linux, and I was just astonished by the performances and speed of the results.
Do you think instant-nerf of nerfstudio (which also includes a spatial distortion technique for unbounded scenes -> similar to the original NeRF's NDC technique for front-facing unbounded scenes) would be a good solution for my task (even if not taking 360degrees videos I could maybe extract a sort of 2.5D model of the scene) ?
Thanks in advance!
At 11:47, there are two obj files. How is the mesh.obj generated? Is this part of poisson mesh file or is this an independent mesh generated using other method? if so, which method? Thanks again for the tutorial!
What you are seeing here is two meshes, both generated using poisson surface reconstruction. One mesh is the initial result, the second mesh has been optimized at a target number of triangles.
Hello! Do you know if nerf can work with 360 (equirectangular) images? I have many 360 images of a house in diferent position, would like to test to generate a model
You can make NeRFs using cubemapped images from equirectangular output. However, results are mixed. Nerfstudio also supports the fisheye lens outputs from the 360 cameras.
How would you say nerfstudio compares to something like luma? im interested in making nerfs, but the pros and cons of each way to make nerfs are not very clear
Nerfstudio is primarily meant for researches, scientists, and software engineers. It is also useable for creators, however, it has a steeper learning curve. Luma AI is more targeted at creators who want to make VFX and visualizations with limited ability to modify parameters. Both are great options.
My Assumption is that 3D-Asset-Markets will get flooded with highpoly-meshes, which are totally useless for videogames, unless you want to retopo everything.
Am I wrong with that?
Make the video please! Beginner here. Thanks
No idea what NeRFstudio is.
A nerf collaboration software suite that was started by a group of student at UC Berkeley.
Don't know how.
Why do you sound like ben shapiro
Jay shree ram ❤
I don't
Be nice to have a complete GUI !!!!!!! So not all the python BS.
do that vid
Title of the video should be "why you can't make 3d models from nerfs using nerfstudio" ... cmon, this mesh is a joke.