Тёмный

X-Avatar: Expressive Human Avatars 

AIT ETH
Подписаться 861
Просмотров 1,4 тыс.
50% 1

CVPR 2023, arxiv.org/abs/...
Abstract:
We present X-Avatar, a novel avatar model that captures the full expressiveness of digital humans to bring about life-like experiences in telepresence, AR/VR and beyond. Our method models bodies, hands, facial expressions and appearance in a holistic fashion and can be learned from either full 3D scans or RGB-D data.
To achieve this, we propose a part-aware learned forward skinning module that can be driven by the parameter space of SMPL-X, allowing for expressive animation of X-Avatars. To efficiently learn the neural shape and deformation fields, we propose novel part-aware sampling and initialization strategies. This leads to higher fidelity results, especially for smaller body parts while maintaining efficient training despite increased number of articulated bones. To capture the appearance of the avatar with high-frequency details, we extend the geometry and deformation fields with a texture network that is conditioned on pose, facial expression, geometry and the normals of the deformed surface. We show experimentally that our method outperforms strong baselines in both data domains both quantitatively and qualitatively on the animation task.
To facilitate future research on expressive avatars we contribute a new dataset, called X-Humans, containing 233 sequences of high-quality textured scans from 20 participants, totalling 35,500 data frames.
Project Page: skype-line.git...

Опубликовано:

 

1 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии    
Далее
Synthesia Launches #ai Avatars with Human Emotions
7:04
Bearwolf - GODZILLA Пародия Beatrise
00:33
Просмотров 359 тыс.
🛑самое главное в жизни!
00:11
Просмотров 67 тыс.
МОЮ ТАЧКУ РАЗБИЛИ...!
39:06
Просмотров 428 тыс.
Expressive AI Avatars Launch Event | Synthesia
21:26
3D Human Digitization from a Single Image!
3:30
Просмотров 33 тыс.
Bearwolf - GODZILLA Пародия Beatrise
00:33
Просмотров 359 тыс.