Tutorial to create visual effects with NeRFs with Blender using the Nerfstudio Blender Add-on. This tutorial covers compositing Blender meshes over NeRFs, compositing NeRF objects in NeRF scenes, and additional details of the add-on.
Nerfstudio documentation: docs.nerf.studio/index.html
Nerfstudio Blender VFX Add-on script: github.com/nerfstudio-project...
Nerfstudio Blender VFX Add-on documentation: docs.nerf.studio/extensions/b...
Chapters
00:00 Intro and Setup
02:51 Compositing Blender renders over NeRFs
10:50 Compositing multiple NeRFs in a scene
22:17 Additional Details
26:48 VFX Breakdown
NeRFs (Neural Radiance Fields) are an upcoming method of 3D captures of environments and objects through machine learning, which have potential to create photorealistic visual effects. Nerfstudio is an open source API to train and render NeRFs. I created a Blender Add-on to enable renders to be composited using Blender to create visual effects. This tutorial shows the ways that NeRFs can be used for visual effects including composited with meshes in Blender, compositing with multiple NeRFs in a scene, portal effects, compositing NeRFs in real footage, and more. I also show how to import a Nerfstudio camera path into Blender, use NeRF render as an environment map, and show how the compositing can be achieved through Adobe Premiere Pro.
Arxiv technical write-up: arxiv.org/abs/2401.08633
2 авг 2024
