Hands on With Nvidia Instant NeRFs 

Dear Author , please load 1080p ! THis is great and informative video explain me a lot regarding NeRF settings but it's make me sad to watch it in 720p .

I really appreciate you sharing your insights and experience with this tool. Thanks, and I look forward to more

Some thoughts about making it a real time and a good quality system: 1. For estimating camera positions you could use the loftr transformer from Kornia library (and not colmap) for key points detection and matching, I think it’s much faster 2. For smooth mesh maybe neural tsdf can do the trick if you aren’t using it yet;) 3. It could be great if you add normals estimation for the reconstructed 3d coordinates Good job!

the automatic bezier curves on the camera paths... THANK you

This video is amazing. I just found out about you last night and already watched all your videos. Your hilarious.

This is simply amazing. Thank you A LOT.

Seeing this stuff from start to finish caters to my learning style. Soooo flipping helpful! Thanks for the tutorial! Have you seen Nvidia's 'nvdiffrec' yet? Apparently it's like photogrammetry, but it spits out a model AND a complete PBR material set!

Subscribed - wish you made more videos, they are valuable and educative!

Thank you Jonathan for a phenomenal and very effective tutorial. It could still be improved if it was made available in HD or higher resolution. Some of the fonts on the video content appear too small when I watch the video out of full screen.

I wish NeRF should be default in After Effects, Houdini, Unity and Unreal...definitely a revolution for XR!

It worked.....Thank you soo much

They need to implement the ability to render your instant nerf into a 3d rendering software. Something that’s not so gpu intensive. Something that could be modified to a mobile device.

An extremely well done video, congratulations! Could you please share the photos used for the bridge reconstruction? In case already done, where can I find them? Thank you.

Thanks for sharing.

hey i need help i was getting python: can't open file 'F:\Tutorial gp\instant-ngp\scripts ender.py': [Errno 2] No such file or directory and i checked under scripts and render.py is not there is that way ?

Great ... I have a question.. is possible to export a sort of point cloud? Would be great.

first created the fox nerf but after that when i used my own images and gave it colmap commad it doesnt gives me a transform json file what should i do it says D:\a\opencv-python\opencv-python\opencv\modules\imgproc\src\color.cpp:182: error: (-215:Assertion failed) !_src.empty() in function 'cv::cvtColor'

Great video thanks for the information! I was wondering if you have had any experience with reflective surfaces, As you know that is usually the Achilles heel in photogrammetry.

Nice work! Although very expensive

Is there a way to take your first dataset and json and compile it with a second one? I.E. string multiple rooms of a house together from separate datasets?

Great video mate! I was wondering how do you go about exporting the model + texture so as to use it with blender?

Awesome ! Is there a way to save RGB and depth and tother textures from a view ?

Can you export the file and take measurements on the 3D model?

Please i am having issues with the custom dataset. The rendering is poor.

i work myself as well as a non coder through all and have the same issues with python 3.9 and python 3.10 (what i use for another somehow important task for me) is there anyway to solve it without removing it ?

Do you know if it's possible to run a multi gpu set up ? Great video btw!

thx for soft mate

I wonder when some sort of documentation will appear?

Hi! thank you for the great video. Is there a way to render a cropped scene? Because the entire background jumps back when I render or reopen the scene. I want to render without too many clouds

Curious: could you mix in a couple higher definition images to increase the quality? If so, would you have to place different weights to get that better result?

Thanks for the breakdown, Jonathan! But how does one go about starting the GUI without initiating training for a new data set? I just want to be able to Load the .msgpack from a previously trained project.

Wonder if you can convert this to usable poly mesh

So like I can’t really use the mesh obj model?

Good day, I am having issues putting the object inside the unit box. What are the parameters am i suppose to change?

If someone made an iOS app that allows you to upload a bunch of pictures and send it off to a remote server with a GPU, that would be a very popular app.

Hello and thank you for the video, I find it really helpful. Could you please recommend me a "step by step" guide to install "Nvidia Instant NeRFs" on my windows PC from scratch? It would be very helpful to me. Thanks

:/ I'm getting 'colmap' is not recognized as an internal or external command, operable program or batch file. FATAL: command failed and I can't figure out why it makes me wanna tear my hair out

Can you help me please to make a decision between using Nvidia Instant NeRFs and Meshroom from AliceVision

Has there been an update to iNERFs?

Hi, is there any chance to export data that we obtained at .obj format ?

This stream was really helpful but for some reason my render.py script isn't exist. Also I've downloaded ffmpeg but can't find it destination to add to the path.

They should have easy online demos to use in allot of these kinds of things

I have a problem "'colmap' is not recognized as an internal or external command," Can somebody know what is going on?

Really work

Could you help me to fix this? thank you ERROR: Not enough GPU memory to match 12924 features. Reduce the maximum number of matches. ERROR: SiftGPU not fully supported

I Use Nvidia RTX 2060 Super. 32gig ram and AMD Ryzen 7 3800X 8-Core Processor. Will it be able to handle it?

Sorry if you said it in the video but, you can download that 3d? Like obj or mtl

Thanks for the video. Is there any way to rotate th scene? When i try to do it with my mouse it just spins in wrong direction. I tried to align the center but coudnt make it work

how to save 3D model or point clouds?

one question, is the 1080ti gpu still compatible with the nerf ai technology? or do i need to have a RTX series gpu?

Are these instructions still relevant? Just curious if you still need all this. I downloaded the instant NGP.

lmao i was tNice tutorialnking ths sa tNice tutorialng then i saw ur comnt

I am getting Memory Clear Error. i havE RTX3080, i used 170 Photos (Nikon). I will try with lower resolution images tonight. i hope it works

Hi there, I was trying to implement a project using this and was wondering if there was a way to crop (min x,y,z and max x,y,z) without using the gui (using the command line preferably) I am using an RTX 3050 Ti would be a great help to me if u can guide me on how to do it or where to look since as far as I can tell u're the only one who actually helps me understand what's going on Thanks a lot

Is this possible on a Mac M1?

Thanks for the straightforward directions. I got the app installed and it worked well, but now it says "This app can't run on your PC." Any ideas? Thanks

Do we need to learn coding

damn

can i do the same on colab

Can I run this in Google collab??

да сделайте вы нормальный человеческий интерфейс чтоб любой мог воспользоваться этой программой

I've had success with this build and have been messing around with using it (here's a test: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-JbiCMN2lPAQ.html). I had some issues, mostly confounding and inconsistent, but I'll mention them all here in case it helps (I'm pretty new to this stuff, so it might seem obvious to some). I'm using Windows 10, NVIDIA GeForce RTX 2070. I followed bycloudia's Github fork (github.com/bycloudai/instant-ngp-Windows) and video (ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-kq9xlvz73Rg.html). The build went smoothly the first time, but I did have some trouble finding the exact versions of some things. I used Visual Studio 16.11.22 (not 16.11.9) and CUDA 11.7 (not 11.6). I used OpenEXR-1.3.2-cp37-cp37m-win_amd64 (not OpenEXR-1.3.2-cp39-cp39-win_amd64 - this one gave me "Does not work on this platform." I chose different versions until one worked). I'm using Python 3.9.12 (this is what is returned when python --version is used on Anaconda Prompt, but, on Command Prompt, it says 3.9.6 (at one point it said 3.7 - confounding)). Everything went smoothly, and I first tried my own image set of photos shot outwards around a room. When testbed.exe was launched, everything was extremely pixelated. This resolution can be changed by unchecking the Dynamic resolution box and sliding the Fixed resolution slider (the higher the number, the lower the resolution. Things might go really slow, and it will be hard to check the Dynamic resolution box again. It's easier to slide the slider to a higher number, then check that box). My image set, though, did not produce anything recognizable as a room. Apparently this works better when looking inward at a subject. I had success with the mounted fox head example. Using the command "python scripts/colmap2nerf.py --colmap_matcher exhaustive --run_colmap --aabb_scale 16 --images data/" creates the transforms.json file. There's some inconsistency from what bycloudai says about the aabb_scale number. He states that a lower number, like 1, would be for people with a better GPU, and 16 with a moderate GPU. But, the NVIDIA folks say "For natural scenes where there is a background visible outside the unit cube, it is necessary to set the parameter aabb_scale in the transforms.json file to a power of 2 integer up to 128, at the outermost scope." For my above youtube example, I used 128 - this looked much better than using 2. This number, though, needs to be changed in the transforms.json text file, because only a number from 1-16 is accepted in the above command. The Camera path tab window is hidden behind the main tab window. Reposition your 3D scene using the mouse and scroll button on mouse, then hit "Add from cam" to create a camera keyframe (after creating a snapshot in the main tab). To play the keyframes, slide the auto play speed to choose the speed of playback, and click the above camera path time slider (so intuitive!). You'll see the playback in the little window. If you click READ, it will playback in the big window, but it seems to mess up the axis of rotation or something (not sure what this READ is, but I don't suggest clicking it!). All was going well, but when I hit esc and tried to render out the video, I had a few problems. First, I hadn't copied the the render.py script from bycloudai into my script folder. Once that was copied, I got an error about the pyngp module not being present (this seems to be a common problem). But, that folder was there. I removed the .dir from that folder, and I didn't get that pyngp error anymore. I got another error (this is where things are inconsistent and confounding again). Completely by mistake I realized I could run the render command in the Developer Command Prompt, but not the Anaconda Command Prompt. Worked perfectly. But...at one point while I had another image set training, everything froze, had to do a hard reboot. When I tried to run testbed.exe again, I got "This PC cannot run this program" Windows popup. After trying several things to get this to run again, I realized the file was 0KB. No other exe files had this problem, and I ran a virus check and everything was clean. I started a new folder, and re-did bycloudai's compile steps. After that, everything worked perfectly, including the rendering out of the video file in the Anaconda Prompt, and keeping the .dir on the pyngp folder (go figure). Hope that helps some folks. Oh, and check out some other AI stuff I've messed with here: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-MoOtNMgFOxk.html