Тёмный

How to Make 3D Models from NeRFs using Nerfstudio 

EveryPoint
Подписаться 7 тыс.
Просмотров 69 тыс.
50% 1

In this video, we walk you through the steps to train a NeRF using Nerfstudio and export both a point cloud and textured mesh from the neural network.
For more information on using Nerfstudio, check out their documentation website: docs.nerf.studio/
Tips:
-If you do not see the Export options in Nerfstudio, you need to upgrade your version. You can simply upgrade Nerfstudio using "pip install --upgrade nerfstudio"
-For smaller objects reduce the number of points or faces
-If you don't need normals with point clouds, uncheck the option. The resulting file will be about half the size.

Опубликовано:

 

8 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 73   
@msampson3d
@msampson3d Год назад
I'm definitely interested in a getting started quick guide for getting started with Nerfs. Been meaning to get into it but it's hard to know where to start so I'd find it super helpful
@EveryPoint
@EveryPoint Год назад
Would a 15 minute "Getting Started With Nerfstudio" video be helpful?
@msampson3d
@msampson3d Год назад
@@EveryPoint absolutely! I think it would help lots of people. This is really cool tech I think a lot of people would appreciate a straightforward introduction to!
@x_jaydn
@x_jaydn Год назад
@@EveryPoint I keep running into errors when trying to follow the official nerf studio guide, so a tutorial might help a lot 💯
@shania5214
@shania5214 Год назад
@@EveryPoint Definitely!
@konichiwatanabi
@konichiwatanabi 9 дней назад
Lol I'm in Tacoma and was looking for a NerF reference for some buddies. Guess I found the right vid!😂
@JAYg33t4r
@JAYg33t4r Год назад
No way I am down this nerf rabbit hole and you are not only doing the remote chance thing I'm researching and now you're modelling my hometown icon. If you are in the area awesome. We have similar interests!
@EveryPoint
@EveryPoint Год назад
We are in the Pacific NW, stretched between Salem, OR and Redmond, WA. We drive by this icon periodically!
@JAYg33t4r
@JAYg33t4r Год назад
@@EveryPoint thank you for all of your responses. What an exciting time to be alive with technology!
@VorpalForceField
@VorpalForceField 3 месяца назад
Thank You for sharing ...Cheers :)
@sprekkatsiu779
@sprekkatsiu779 Год назад
Need a getting started video around 15 minutes or less. Segmented and marked on your video so we can follow it easily. This will blow up
@EveryPoint
@EveryPoint Год назад
We're on it!
@kangk9194
@kangk9194 Год назад
非常感谢,教程演示给了我很大的启发,虽然没有从事相关的工作但我希望能自己尝试成功这一技术
@alistairbuchan
@alistairbuchan Год назад
Just stumbled upon your channel while investigating NeRF and integrating it into my VFX workflow. Super useful stuff. Good level and length of videos! Subscribed and will be keeping an eye out for future vids. Thanks!
@trumpsaloser
@trumpsaloser Год назад
Dude! Fellow Pacific Northwesterner here, please do a beginner tutorial!!!! I am making a very VFX-heavy pitch and have been relying on the Matrix city released in UE5 and being able to creat a mesh from a nerf of part of a city would be amazing!
@cumburxx
@cumburxx Год назад
I'll try this. Very useful.
@EveryPoint
@EveryPoint Год назад
We're glad you found it useful!
@carlosedubarreto
@carlosedubarreto Год назад
For sure its very useful. everytime I see a new video from you I know is somethign worth a watch, and this one was no exception.
@EveryPoint
@EveryPoint Год назад
Glad it was helpful! Also, thank you for the kind words regarding the usefulness of our content.
@3RDEYELOVE
@3RDEYELOVE Год назад
👌🏾cool vid could you do a ' how to train your Nerf video ' Next💯💪🏾
@ottokitchenbrand1409
@ottokitchenbrand1409 5 месяцев назад
thanks for helpful tutorials. getting this message the whole time Could not find ffmpeg. Please install ffmpeg
@mohitgupta5000
@mohitgupta5000 Год назад
yes please make a video on nerfstudio installation. I found the process simple to follow but tinycudann does not compile properly.
@beytullahyayla7401
@beytullahyayla7401 Год назад
Same issue for me, could you find any solution :(
@mohitgupta5000
@mohitgupta5000 Год назад
@@beytullahyayla7401 For me, tinycudann compiled properly but on running 'pip install nerfstudio', pytorch with cuda gets removed and pytorch without cuda support gets installe.This caused the issue with preinstalled tinycudann. Easy way to go around it is by again running commands to install pytorch with cuda. (Tinycudann requires pytorch with cuda to run) Once you do that, it should be resolved. Also use nerfstudio 0.1.18 instead of default which is 0.1.16 [pip install nerfstudio==0.1.18]. Let me know if it helps
@beytullahyayla7401
@beytullahyayla7401 Год назад
@@mohitgupta5000 Thanks for the answer, to be more clear i'm getting this error NameError: name 'tcnn' is not defined because i can't install tinycudann properly. I'm getting this error when i try :× Encountered error while trying to install package. ╰─> tinycudann note: This is an issue with the package mentioned above, not pip. hint: See above for output from the failure.
@ZongHoops
@ZongHoops 3 месяца назад
Have you encountered the issue that transforms.json is not created using customer data? Would you like to share your customer data?
@CastilloJA89
@CastilloJA89 Год назад
Hi @EveryPoint, I have been following the development of nerve since last year, and over the winter break, I missed all of this. Could you make a video from 0 with the installation of Nerf Studio, please? I'm working on my PhD and this information will be really helpful, In trying to use Nerf to recreate a 3d models of insects.
@jeffreywolff4961
@jeffreywolff4961 Год назад
Great tutorial - I will definitely be experimenting with Nerfstudio!
@EveryPoint
@EveryPoint Год назад
Have fun! Please share your results with us.
@user-zl9gl9cy3l
@user-zl9gl9cy3l 4 месяца назад
hi bro. How much data is needed for the model to perform well like bicycle ? and i have a 2 minute video from which i need to choose what fps per second. please give me your advice
@radovanvasko7888
@radovanvasko7888 6 месяцев назад
Does anyone know wether its possible to calculate the accuracy of such 3d modeling process? I use photogrammetry for surveying and thats exact math so im able to calculate the accuracy of such process, but this is basically a trained ai to do it for me, so id love to know the math behind it so it could be used for exact replication with calculatable accuracy
@its-bc
@its-bc Год назад
Fantastic demo. Very useful. Have you played around with some of those default parameters yet? Any improved results, if so what did it?
@EveryPoint
@EveryPoint Год назад
Not yet! That would make for a great follow up video.
@pradeepmanoharan4859
@pradeepmanoharan4859 2 месяца назад
hi jonathan recently i got way too old xbox Kinect to scan my entire house but its only capture half of the room . i would like to know is there any other way to scan my entire interior of my house like i tried vslam but its doesnt work . please guide me if you got any idea. My old house gone demolishing within a month ,so i have a plan to capture my entire house in 3d . kind of preserve my nostalgia and happy moments in this way . so let is there any way to capture my house
@brown2840
@brown2840 Год назад
well that's complicated with all that code. Why can't the software just run those behind the hood with an easy UI?
@aaronszczepanek2583
@aaronszczepanek2583 Год назад
im looking for example using drones taking images of crops
@JAYg33t4r
@JAYg33t4r Год назад
What happens when you feed it a bunch of data from varying sources of a similar object?
@EveryPoint
@EveryPoint Год назад
What you are describing is NeRF in the Wild. Check out the project page: nerf-w.github.io/
@panonesia
@panonesia 9 месяцев назад
hi hello.. i want to ask, when i train model i got error message "FileNotFoundError: [Errno 2] No such file or directory" how to fix that?
@dimitriosskarlatos3688
@dimitriosskarlatos3688 Год назад
Please makea video about how to use nerdstudio to train a nerf
@JAYg33t4r
@JAYg33t4r Год назад
Do you know of a way to get the 3d mesh info transcribed through an API into a modelling program such as Blenders Geometry Nodes to have it generate assets with adjustable parameters?
@EveryPoint
@EveryPoint Год назад
Your best option to is reach out to Luma AI regarding their API and integrations.
@grahamwebster8913
@grahamwebster8913 11 месяцев назад
If you are using the locally hosted viewer is there a way to set up the command line prompt to give you a link to the locally hosted NeRF viewer link? Or will this just send you a default link to the general web viewer?
@user-rz6zh9ge6y
@user-rz6zh9ge6y Год назад
Can we utilize these 3D models for training to use as dataset and further using in MD DL? if yes then how? and if not which tools is used commercially for real time dataset of 3D to use in our training purpose? thanks in advance
@Luizof
@Luizof Год назад
How is that different from standard point and cloud softwares like WebODM for example?
@svsarma1
@svsarma1 Год назад
Noob question, what program are you using to open the finished mesh? Thx
@jag24x
@jag24x Год назад
What video card is worth getting? More vram is better?
@EveryPoint
@EveryPoint Год назад
More vram allows you to input a greater number of total megapixels into a project. However, a more powerful card speeds up rendering time. Nvidia suggests RTX 20xx or higher. We found that a 3080 or better is ideal. The older cards take a long time to render.
@GalloBeat
@GalloBeat Год назад
Hello! I just discovered your channel and I'm finding it very useful as im also working on a similar project at work, where i have to reconstruct a sort of 3d model from videos pointing to a coast from the sea from a medium distance. The videos would not go over the entire scene 360 but they will cover just a portion of these angles, mostly front-facing. I ran over these Neural Fields some days ago and I tried them of linux, and I was just astonished by the performances and speed of the results. Do you think instant-nerf of nerfstudio (which also includes a spatial distortion technique for unbounded scenes -> similar to the original NeRF's NDC technique for front-facing unbounded scenes) would be a good solution for my task (even if not taking 360degrees videos I could maybe extract a sort of 2.5D model of the scene) ? Thanks in advance!
@user-nr2vy5ng9s
@user-nr2vy5ng9s Год назад
Hi, Is it possible to export in STL format and than upload it to 3d printer?
@heyjianjing
@heyjianjing Год назад
At 11:47, there are two obj files. How is the mesh.obj generated? Is this part of poisson mesh file or is this an independent mesh generated using other method? if so, which method? Thanks again for the tutorial!
@EveryPoint
@EveryPoint Год назад
What you are seeing here is two meshes, both generated using poisson surface reconstruction. One mesh is the initial result, the second mesh has been optimized at a target number of triangles.
@YaSynAmRaUi
@YaSynAmRaUi 3 месяца назад
I don't know how to use nerfsutdio.
@javierpaternina
@javierpaternina Год назад
Can you create a textured mesh from instant NGP?
@MrTilePRO
@MrTilePRO Год назад
Great. Do you have video from A to Z for noobies? Iwhant to learn this 2d to 3d but how to start?
@MrTilePRO
@MrTilePRO Год назад
How to start in to new PC? What must install end how? A to Z?
@nobody-u-know
@nobody-u-know 11 месяцев назад
That's very interesting, but this mesh is not usable for any kind of production, unfortunately.
@cowsforliyyfe
@cowsforliyyfe Год назад
How would you say nerfstudio compares to something like luma? im interested in making nerfs, but the pros and cons of each way to make nerfs are not very clear
@EveryPoint
@EveryPoint Год назад
Nerfstudio is primarily meant for researches, scientists, and software engineers. It is also useable for creators, however, it has a steeper learning curve. Luma AI is more targeted at creators who want to make VFX and visualizations with limited ability to modify parameters. Both are great options.
@beytullahyayla7401
@beytullahyayla7401 Год назад
I cant install nerstudio. I'm getting tinycudann error :(
@helenagarcia5103
@helenagarcia5103 Год назад
Hello! Do you know if nerf can work with 360 (equirectangular) images? I have many 360 images of a house in diferent position, would like to test to generate a model
@EveryPoint
@EveryPoint Год назад
You can make NeRFs using cubemapped images from equirectangular output. However, results are mixed. Nerfstudio also supports the fisheye lens outputs from the 360 cameras.
@rhinoxrstudios8067
@rhinoxrstudios8067 Год назад
Make the video please! Beginner here. Thanks
@lln6123
@lln6123 Год назад
My Assumption is that 3D-Asset-Markets will get flooded with highpoly-meshes, which are totally useless for videogames, unless you want to retopo everything. Am I wrong with that?
@keithsamjr
@keithsamjr Год назад
Don't know how.
@brianmcmahon7711
@brianmcmahon7711 Год назад
No idea what NeRFstudio is.
@EveryPoint
@EveryPoint Год назад
A nerf collaboration software suite that was started by a group of student at UC Berkeley.
@cgrosbeck
@cgrosbeck 7 месяцев назад
Be nice to have a complete GUI !!!!!!! So not all the python BS.
@apollodavis4090
@apollodavis4090 Год назад
Why do you sound like ben shapiro
@vikashWorld8713
@vikashWorld8713 Год назад
Jay shree ram ❤
@iMakeVideos_kz
@iMakeVideos_kz Год назад
I don't
@felipepascuali9446
@felipepascuali9446 Год назад
do that vid
@Piipolinoo
@Piipolinoo Год назад
Title of the video should be "why you can't make 3d models from nerfs using nerfstudio" ... cmon, this mesh is a joke.
Далее
NVIDIA Introduces No Code Instant NeRF!
6:55
Просмотров 39 тыс.
How Ian Hubert Hacked VFX (and you can too!)
22:26
Просмотров 95 тыс.
Новый хит Люси Чеботиной 😍
00:33
Is Nerf The End of Photogrammetry
11:17
Просмотров 71 тыс.
Electromagnetic Aircraft Launcher
15:09
Просмотров 1 млн
Photogrammetry / NeRF / Gaussian Splatting comparison
23:30
How AI Photogrammetry Is Changing 3D Forever
10:03
Просмотров 80 тыс.
Hands on With Nvidia Instant NeRFs
40:58
Просмотров 136 тыс.
I Built The First LAMINAR FLOW ROCKET ENGINE
15:51
Просмотров 842 тыс.