Тёмный

Spatial Memories 

InfiniteRealities
Подписаться 2,2 тыс.
Просмотров 8 тыс.
50% 1

We're proud to showcase some recent real-time work with 3D / 4D Gaussian splatting.
In January of 2024 we acquired a full 3DGS commercial license with Inria to allow us to offer 4DGS services to clients around the world. We've spent the last 10 months developing our custom 4DGS software pipeline, utilizing our own GPU cluster to batch process 100,000's of 4DGS frames rapidly, combined with our state-of-the-art custom built volumetric capture system(s). We can capture anything from complex character interactions for visual effects shots, or dynamic fast fighting scenes, sports, acting, even capturing and storing memories of family and friends for the future! The possibilities are endless.
Our focus is always on quality and high-fidelity. We don't cut corners.
The below video showcases some 6-dof spatial captures we took of Henry Pearce's family. These scenes are played back in real-time @30fps inside a 3rd party engine running in a 120fps virtual environment.
This is a culmination of years of hard work and dedication and we are keen to commercialize this technology.
Please do reach out if you're interested in our captures systems and 3D/4DGS processing services.
#spatialcapture #vr #virtualmemories #inria #3dgs #4dgs #aeonx #ir #ximea
Music
"Vision"
by megiddo music
Special thanks to Aras Pranckevičius

Опубликовано:

 

16 сен 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 54   
@renderdefender
@renderdefender 4 месяца назад
This is the stuff the Star Wars holograms are made of! 🤪🤘
@ScottishAtheist
@ScottishAtheist 4 месяца назад
Not so much bullet time, as balloon time, ballerina time, baby time.
@aromncoronado2005
@aromncoronado2005 4 месяца назад
This is bullet time 2.0
@eerotiainen8555
@eerotiainen8555 4 месяца назад
Very inspiring! Keep up the great work!
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Thank you!
@ChrisCapel
@ChrisCapel 12 дней назад
Dude cut to different angles and edit them together! Did you capture these? It’s like grabbing a performance all at once and then cutting it together instead of setting up each angle, lights, props, etc. This is crazy!
@infiniterealities4D
@infiniterealities4D 12 дней назад
Thanks it's all real-time you can view it from any angle you need to.
@Blooper1980
@Blooper1980 4 месяца назад
NEXT LEVEL!
@cg.man_aka_kevin
@cg.man_aka_kevin Месяц назад
Watching a person that passed away with this 4D gaussian splats feels more sad and touching... 😭🥹
@unnf9971
@unnf9971 4 месяца назад
What is this fever dream
@TheRealJerseyJoe
@TheRealJerseyJoe 4 месяца назад
Superb ! Love it. Great work as always.
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Thanks Joe!
@egalegalegalegal
@egalegalegalegal 4 месяца назад
Holy smokes, that looks amazingly sharp.
@marc-andrepiche1809
@marc-andrepiche1809 4 месяца назад
Incredible
@Movilavideo
@Movilavideo 4 месяца назад
This is insane!
@VidFFB
@VidFFB Месяц назад
I would love to see dancers recorded with this. Especialy breaking(breakdance).
@Mranshumansinghr
@Mranshumansinghr 4 месяца назад
I watched it 20 times already.
@Camtrack
@Camtrack 4 месяца назад
the next matrix movie should use this tech the whole timeline
@Daexx5
@Daexx5 Месяц назад
I was here before it went mainstream. It's awesome.
@joselitogonzalezgeraldo3286
@joselitogonzalezgeraldo3286 4 месяца назад
Genial
@lebasson
@lebasson 4 месяца назад
impressive.
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Thanks!
@jimgunzel
@jimgunzel 4 месяца назад
This is insane! Mind blowing, do you use custom code for 4d gaussian?
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Thanks. Some custom processes and playback tools, most of the training code is original. Nearly all of the published 4DGS code online does not work (as advertised) especially with multi-camera data. So we've had to improvise for the time being.
@surendirenparthasarathy9087
@surendirenparthasarathy9087 4 месяца назад
Will the playstation 5 be able to supoort this kind of graphics.
@infiniterealities4D
@infiniterealities4D 4 месяца назад
The Playstation 4 could do with a similar type of process with "Dreams". The PS5 easily.
@tonydu5658
@tonydu5658 Месяц назад
Exciting work! Did you implement 4DGS on your own or based on some research? Can the training results be viewed in Unreal?
@infiniterealities4D
@infiniterealities4D Месяц назад
Thanks. It's 3DGS as a flipbook essentially. We don't support Unreal at the moment as there is not a performant way to play them back quickly enough. We reached out to Epic but there was little interest.
@tonydu5658
@tonydu5658 Месяц назад
@infiniterealities4D Thank you for your reply. So your implementation is to train each frame in 3DGS and then play it, right? Very cool! I never thought it could be implemented this way! You guys are really great. Yes, currently there are few DCC software or engines that support the preview of 3DGS or 4DGS. The way we are using is to convert Gaussian splashes into Unreal's Niagara particle system using the 3DGS plugin. Maybe we can convert the motion of each frame of 3DGS into particles? Anyway, seeing the exciting effect of your demo is so inspiring, looking forward to more of your technical demos and keeping in touch with you.
@infiniterealities4D
@infiniterealities4D Месяц назад
@@tonydu5658 Thank you!
@Reliix1
@Reliix1 Месяц назад
@@infiniterealities4D This is amazing. I'm curious about this comment because I've heard Gaussian splats are more CPU friendly than pbr and photogrammetry. Also below you seem to say it can run on a PS5, so how can it not run in Unreal in a performant way? I am shocked Epic is not interested in this, this is the very cutting edge-how soon will these models be riggable for use? Thanks
@Leyverse
@Leyverse 4 месяца назад
This + AVP
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Just need Apple to sell in the UK :D
@Blooper1980
@Blooper1980 4 месяца назад
How was the hair captured?
@infiniterealities4D
@infiniterealities4D 4 месяца назад
With our custom multi-camera and lighting rig.
@Instant_Nerf
@Instant_Nerf 3 месяца назад
How many cameras? Will it be doable with.. I’m assuming u guys have it 360 and from all angles
@infiniterealities4D
@infiniterealities4D 3 месяца назад
176x and 360 all angles.
@Instant_Nerf
@Instant_Nerf 3 месяца назад
@@infiniterealities4D crap. So out of consumers reach. It loooks amazzzzing tho! ❤️
@infiniterealities4D
@infiniterealities4D 3 месяца назад
@@Instant_Nerf thanks!
@justmovies682
@justmovies682 4 месяца назад
How you doing it.. ? Have u seen beeble ai new depth map n mesh creation (NAB SHOW) this is better but we need to make it accessible to mortal beinga
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Lots of cameras and the 3DSG code base. Beeble's a multi-millionaire NFT baker he should have the resources to do this :)
@justmovies682
@justmovies682 4 месяца назад
@@infiniterealities4D please redo the same output with minimum number of phone, bringing it simplicity for indie creators.
@infiniterealities4D
@infiniterealities4D 4 месяца назад
@@justmovies682 not possible atm sadly, maybe in 5-10 years.
@ediiiwang8559
@ediiiwang8559 4 месяца назад
how to do.that?
@sergeigourski
@sergeigourski 4 месяца назад
How large is the 4D NeRF model?
@infiniterealities4D
@infiniterealities4D 4 месяца назад
Currently each frame averages about 10mb. With better 4DGS compression code we should be able to reduce this or reuse the splats more over time.
@spiderbite7849
@spiderbite7849 4 месяца назад
How many cameras were used?
@infiniterealities4D
@infiniterealities4D 4 месяца назад
176 cameras.
@spiderbite7849
@spiderbite7849 4 месяца назад
@@infiniterealities4D wow. all synced with timecode?
@infiniterealities4D
@infiniterealities4D 4 месяца назад
@@spiderbite7849 yes with audio (multi mic) sync
@user-jv6vk2mt3d
@user-jv6vk2mt3d 4 месяца назад
​@@infiniterealities4D What kind of camera? and resolution.. Don't it need an RGB-D camera?
@user-jk9zr3sc5h
@user-jk9zr3sc5h 4 месяца назад
@@user-jv6vk2mt3d technically when you know the instrinsic values of the camera you can infer the depth from the disparity of the images- but there are newer neural network driven approaches too
Далее
My observations on Gaussian Splatting and 3D scanning
16:32
БЕЛКА РОЖАЕТ? #cat
00:21
Просмотров 824 тыс.
Why I Live a Simple Life - My Story
16:17
Просмотров 684 тыс.
What is Volumetric Video?
7:44
Просмотров 18 тыс.
when every frame in a film is perfect
10:54
Просмотров 681 тыс.
I Tried a Disney Secret Project!
11:33
Просмотров 8 млн
3D Scanning Changed Again. NeRFs Are SO Back!
7:06
Просмотров 14 тыс.
БЕЛКА РОЖАЕТ? #cat
00:21
Просмотров 824 тыс.