Тёмный

Animated Gaussian Splatting - Unreal Engine 5 Integration 

Temporal Games
Подписаться 319
Просмотров 13 тыс.
50% 1

First look at integration of volumetric video content achieved with Gaussian Splatting in Unreal Engine 5. The demonstrated method involves efficient reconstruction, compression, streaming, and playback of 4D Gaussian Splatting, showcased within Unreal Engine 5 real-time environment.
This technology demonstration utilizes data from the Panoptic Studio dataset, a massively multiview system for social interaction capture, published in 2017 in the IEEE Transactions on Pattern Analysis and Machine Intelligence.
Portions of the materials used are trademarks and/or copyrighted works of Epic Games, Inc.
#gaussiansplatting #4dgs #animatedgaussiansplatting #unrealengine5 #unrealengine #volumetric

Опубликовано:

 

2 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 21   
@sidebarschocolate
@sidebarschocolate 4 месяца назад
Would be glad to learn more about your plugin. I'm currently working on 3D and 4D GS for my masters thesis here in the uk
@junyongyan9668
@junyongyan9668 Месяц назад
有时间的话,可以交流
@denizcarta9915
@denizcarta9915 5 месяцев назад
could i please get my full vollumetric adult films now, we have 2024 already. My quest 3 and rtx 4090 is ready
@ManuAudet
@ManuAudet 4 месяца назад
😂
@colepeterson5392
@colepeterson5392 2 месяца назад
Soon
@low.bow_1381
@low.bow_1381 2 месяца назад
Brother hear me out, AI gonna bust your nut in Future, Not holograms
@KyleCypher
@KyleCypher 3 месяца назад
how are you getting shadows casted with the gaussian splat?
@ROcheater
@ROcheater 4 месяца назад
This is nuts. Is there some sort of documentation on how to properly set this up and software that can be used to record the people in the scene?
@KalkuehlUncut
@KalkuehlUncut 24 дня назад
Wait, they can cast shadows?
@RwanLink
@RwanLink 5 месяцев назад
Can it works from a single camera angle?
@janklingner2694
@janklingner2694 5 месяцев назад
no, then its not viewable from every perspective
@RwanLink
@RwanLink 4 месяца назад
@@danny_invadio So if you have one camera with motion around the animated subject it should work right?
@AmanThangellapally
@AmanThangellapally 3 месяца назад
@@RwanLink you need to capture multiple angles simultaneously, if it's just one cam, then u are capturing only one shifting angle at a time
@Anomaliayt
@Anomaliayt 3 месяца назад
Wow!!!
@AlanFregtman
@AlanFregtman 5 месяцев назад
Can this run on mobile GPUs or like a VR headset such as the Meta Quest? Also, does it need a lot of storage?
@temporalgames
@temporalgames 5 месяцев назад
Yes, it can run on mobile GPUs. The focus of our research is on compression, which is the biggest challenge with Animated GS. We've currently achieved a 60x compression rate over raw Gaussian Splat frame representation, and are working on making Animated GS content streamable.
@VLADDIIisplayingwithgirls
@VLADDIIisplayingwithgirls 6 месяцев назад
you can make holographic scenes like this!
@temporalgames
@temporalgames 5 месяцев назад
Exactly. Holographic projections from the real world into the virtual.
@Aero3D
@Aero3D 5 месяцев назад
How can we try or make it? Livestream it?
@temporalgames
@temporalgames 5 месяцев назад
​@@Aero3Dour goal is to make livestreaming possible, but that requires substantially shortening the processing of raw footage and GS frame reconstruction. Existing third-party solutions might take up to 40 minutes per single frame to process. Our method only processes the changes between the frames, thus making rapid GS frame reconstruction possible. However, this would require further work to cover edge cases and various scenarios (e.g., when the scene composition changes drastically).
@Aero3D
@Aero3D 5 месяцев назад
@temporalgames can I stay in touch or follow progress somehow? I am creating a VR live events platform. As far as talent, we have multiple ways to capture, 2D/greenscreen for budget, but we also want to provide 3D solutions, such as a Kinect Azure. I tried 8 Kinects with volcap, and with Unreal, it's just not supported and all the livestreaming projects gave up or failed. I am hoping Gaussian Splats and a team like yourself may still make it happen. Thanks!
Далее
3D Scanning Changed Again. NeRFs Are SO Back!
7:06
Просмотров 14 тыс.