Тёмный

Unreal Engine 5 | Metahuman reading a poem | Cinematic | LiveLink - Test 

Arthur Baum
Подписаться 2,5 тыс.
Просмотров 30 тыс.
50% 1

Basically what the title says.
Dug out a little poem by H.P. Lovecraft and recorded my performance while reading it. Put it all together into a little cinematic and spiced it up with a simple 3-point lighting. Nothing more to say except that it is super duper fun to mimic my own facial expression. (:
Original poem:
The most merciful thing in the world, I think,
is the inability of the human mind to correlate all its contents.
We live on a placid island of ignorance
in the midst of black seas of infinity,
and it was not meant that we should voyage far.
The sciences, each straining in its own direction,
have hitherto harmed us little;
but some day the piecing together
of dissociated knowledge will
open up such terrifying vistas of reality,
and of our frightful position therein,
that we shall either go mad from the revelation
or flee from the light into the peace
and safety of a new dark age.

Кино

Опубликовано:

 

2 окт 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 82   
@GabiN64
@GabiN64 Год назад
In 15 years we will look back at this like how we can look back at the Heavy Rain 2006 demo
@ExaTechCorp
@ExaTechCorp Год назад
Haha
@alexmcaruthur6966
@alexmcaruthur6966 2 года назад
I can still tell this is a cgi because of the lips and eye movements aren’t as smooth. But everything else is realistic
@ArthurBaum
@ArthurBaum 2 года назад
Thanks. You're totally right. I'm working on solving this. (:
@davidpurple3698
@davidpurple3698 2 года назад
@@ArthurBaum Eyes are good - months in general are tricky
@ma2i485
@ma2i485 2 года назад
The light on his face is incredible, skin is very realistic
@han_pritcher
@han_pritcher 2 года назад
This is excellent. Only the mouth movements give it away. Two-Minute Papers recently had an interesting video with regards to facial performance capture. I'm not sure if the software demonstrated on that channel is commercially available yet but the prospect of having AR-Kit like precision tracking on any device with a camera is very appealing.
@Iancreed8592
@Iancreed8592 2 года назад
You get a better result than this if you use Omnivers's Audio2emotion (audio2face). Then you can manually tweak it with the sliders until its perfect.
@ArthurBaum
@ArthurBaum 2 года назад
@@Iancreed8592 I’ve been testing audio2face but from my personal experience the movements seemed a tad too mechanical und not very organic. Do you have other experiences? :)
@ArthurBaum
@ArthurBaum 2 года назад
Yes. You are absolutely right! I really want to work on the mouth movement. Maybe it’s just a Limitation of live link / Metahumans? Or maybe I need to adjust the mouth parameters manually.
@jso19801980
@jso19801980 2 года назад
i think he's too teethy, if you read out with your own mouth you hardly see your teeth, the top and lower lips also need to be sticky to each other if possible and slightly deform upon impact with each other
@BrendanCescon
@BrendanCescon 2 года назад
This is actually insane. Fantastic job!
@ArthurBaum
@ArthurBaum Год назад
Thank you. :)
@TheTgolProductions
@TheTgolProductions 2 года назад
This is actually so advanced. Please make a tutorial on how you make the meta humans look so realistic.
@ArthurBaum
@ArthurBaum Год назад
Lighting.
@nickfai9301
@nickfai9301 Год назад
Awesome. May I know what is your GPU, CPU and RAM?
@sabahoudini
@sabahoudini 2 года назад
This is pretty much 100% real but the inside of the mouth lacks the correct physics behaviour which makes it immediately distinguishable from reality. The way the inside of the mouth wraps around the teeth etc needs to be simulated properly and also the lips movement according to the speech.
@ArthurBaum
@ArthurBaum 2 года назад
Yes, you are right.
@DheLiriouS.ArtworkS
@DheLiriouS.ArtworkS 2 года назад
The only flaw I see, is the toungue movement that's lacking. Other than that, everything looks so clean and perfect. Awesome job
@Exploraptor
@Exploraptor Год назад
The last great hurdle does seem to be the lip movements. The key problem seems to be the lips don't move as if they are making those sounds. "Placid island of ignorance" the "Placid" "P" doesn't purse his lips together. Maybe there's something that can be done with AI ontop of these mo-caps to better sync the lip movements and the words.
@IamSH1VA
@IamSH1VA 2 года назад
Till 0:15 it’s hard to tell it’s metahuman… Nice work 👍
@DamielBE
@DamielBE 2 года назад
Nice quote from HP Lovecraft, at the start of his short story The Call Of Cthulhu.
@DrPix3l
@DrPix3l 2 года назад
The mouth is still the only big problem but that's still impressive
@ArthurBaum
@ArthurBaum 2 года назад
You are righty. Any idea how to tackle that problem?
@DrPix3l
@DrPix3l 2 года назад
@@ArthurBaum Unfortunatly in don't ! But maybe there is some tuto to improve metahuman 's mouth animation .
@Giga3D811
@Giga3D811 Год назад
@@ArthurBaum Use new manually sculpted blendshapes to trigger phenomes. Its a pain to setup, but great results
@TheDigiVault
@TheDigiVault 2 года назад
That's really cool!!!
@ErosSchiavon-w6c
@ErosSchiavon-w6c 11 месяцев назад
hi, great job! what did you use to record ypour face animation? i'm using livelink with an iphone 14 but the resoult is really mechanical...
@arianakis3784
@arianakis3784 8 месяцев назад
the body, where is? hahaahaha
@Tat2dTroll69
@Tat2dTroll69 Год назад
the mouth always gives it away
@JonoSeneff
@JonoSeneff Год назад
This is a beautifully restrained, character-driven utilization of technology. well done!
@darkseidgaming8521
@darkseidgaming8521 Год назад
I could not tell whatsoever that this was animated until he started talking. This is incredible. Definitely try to manually adjust things that the capture doesn’t get quite right and you’ll be golden.
@ArthurBaum
@ArthurBaum Год назад
Thanks. Already building a custom FaceCap helmet for the next project. (:
@darkseidgaming8521
@darkseidgaming8521 Год назад
@@ArthurBaum this is the first I’ve come across your work and just watched everything you’ve shared so far. Am curious, do you render on your own machine? Or utilize render farms? If you do it locally what are the specs you have on your machine and average render time for some of your more complex projects? I’ve only rendered smaller, extremely short projects at home and am wanting to start working on more complex things and just don’t even know if I’ll be able to in the first place lol
@ArthurBaum
@ArthurBaum Год назад
​@@darkseidgaming8521 I don't think you'd need a render farm for UE projects. Everything was rendered locally. This particular project was rendered with an RTX3060 in about 30 or so minutes. I recently upgraded to an RTX3090 and a new CPU. Render times got about 3-4 times faster ever since. Of course your hardware isn't everything. You always need to keep an eye on texture resolutions, shader complexity, amount of dynamic lights and so on. Once I understood one or two things about memory budgets my renders usually take about 5 minutes for a 10 seconds - scene.
@darkseidgaming8521
@darkseidgaming8521 Год назад
@@ArthurBaum wow. That’s insane. I usually work in Houdini and have never actually rendered anything in UE. Excited to finish something and see how long the render takes. I have a intel i7 and RTX 3070. Some of my Houdini renders have taken many many MANY hours. I’m very new to it all so it could’ve been poor optimization that I didn’t know could be adjusted. Still learning.
@ArthurBaum
@ArthurBaum Год назад
@@darkseidgaming8521 Well. Obviously both programs have different use cases. So it's not surprising. Houdini still beats everything out of the water when it comes to simulations. And those are usually complex as f**k. You will never achieve that level of quality in a real-time game engine unless you fake your FX with VDBs or flipbook or so. And even then that's only true for cinematics. For games it would be insane to use VDBs. Nevertheless working in a real time environment is just... It's liberating and the creative process is just different. I'm getting new ideas constantly because what you see is what you get. That's huge for me since I have a background as a DoP.
@RayRay-uw6ms
@RayRay-uw6ms 2 года назад
wow, this is amaazing!! this should be a feature film!
@gfxfilms2012
@gfxfilms2012 Год назад
That is really good!
@ZethuMashika
@ZethuMashika 2 года назад
I love this.
@supartwi
@supartwi 2 года назад
Wowww this is amazing!!
@dar780
@dar780 2 года назад
Wow, really nice. 👌
@albertoUnreal
@albertoUnreal Год назад
next feature: ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-zWcYN58Y9EM.html
@ArthurBaum
@ArthurBaum Год назад
What am I looking at? This looks even more unrealistic und uncanny, sorry.
@_ia3
@_ia3 2 года назад
это очень круто)
@Apuat
@Apuat 2 года назад
Wow. The lighting & texturing are great! This may be naïve of me but is it possible that the lips might lineup better if you took your audio and adjusted it in post production to fit the limitations of the lips from the animation?
@ArthurBaum
@ArthurBaum Год назад
Thank you. It's kinda hard to sync since there's no Timecode, no audio cue. Nothing. But I'll make sure to improve on the next project. :)
@MikeliousXD
@MikeliousXD Год назад
Looks really good. Only thing abit lacking is mouth animation.
@nikoltsenkova1110
@nikoltsenkova1110 2 года назад
This is amazing! How did you record the whole animation? I'm struggling with that part a bit. Thanks for sharing this with us, I'm truly excited to see how the MetaHumans will further develop!
@ArthurBaum
@ArthurBaum 2 года назад
Thank you! Basically a combination of Live Link performance, Take Recorder and a Mixamo animation for the body so it doesn’t feel so rigid when speaking.
@arielshpitzer
@arielshpitzer Год назад
from this range you need to track even the tounge 🤣
@martem000
@martem000 Год назад
Very cool!
@shaypayne
@shaypayne 2 года назад
wow this is truly amazing, Really great work! Your lighting really sells the realism. Do you have any tips on lighting ?
@ArthurBaum
@ArthurBaum Год назад
Thanks. Check out photography and cinematography lighting basics. StudioBinder would be a good YT channel for starters. ❤
@shaypayne
@shaypayne Год назад
@@ArthurBaum Awesome thanks for the reply, I really enjoy all your unreal stuff :)
@511recs6
@511recs6 2 года назад
Фантастика
@NUXLOO505
@NUXLOO505 2 года назад
Wow, look super cool just the latency of the lip sink
@lordkiller977
@lordkiller977 Год назад
Almost there, but still no look, lifless eyes.
@ngaloema1791
@ngaloema1791 Год назад
Tutorial Plz
@ArthurBaum
@ArthurBaum Год назад
There are plenty of tutorials for live link. I don't think the world needs one more from me. :)
@Пониманиеигры0
CryEngine 2013
@nintendians
@nintendians Год назад
looks great.
@SuperlativeCG
@SuperlativeCG 2 года назад
He knows what's coming.
@ibrahimmomoh
@ibrahimmomoh 2 года назад
This is really good but humans don’t speak with teeth showing all the time
@GeorgesEmmanuelArnaud
@GeorgesEmmanuelArnaud 2 года назад
thats awesome, live link iphone ?
@ArthurBaum
@ArthurBaum 2 года назад
Thank you. Yes! Just processed the raw data without any cleanup.
@trainingwheels8337
@trainingwheels8337 2 года назад
@@ArthurBaum How do you get this good results??? I also used live link but it was terrible and unusable. Got any tips on how to get this good mouth movement?
@ArthurBaum
@ArthurBaum 2 года назад
@@trainingwheels8337 I wouldn't say that my results are good, especially in the mouth area. But thanks. (: I don't know!? Do you have an iPhone with a true depth camera? Live Link really relies on depth information. That's why it's so powerful!
@GeorgesEmmanuelArnaud
@GeorgesEmmanuelArnaud 2 года назад
@@ArthurBaum are available for a quick chat ? or zoom or what ever ? I am gmt-4
@ArthurBaum
@ArthurBaum 2 года назад
@@GeorgesEmmanuelArnaud depends on what it is about. My time is pretty limited right now. Sorry.
@mrveguita
@mrveguita Год назад
How you made it?
@ArthurBaum
@ArthurBaum Год назад
With Unreal Engine.
@bomjfrompodval2977
@bomjfrompodval2977 Год назад
Hello, friend! I recorded the face and head animations with Take Recorder, but when I insert the animations into Sequencer, there are no head movements, only the face. What should I do?
@ArthurBaum
@ArthurBaum Год назад
There are plenty of tutorials about that workflow on YT
@Stasakusok
@Stasakusok Год назад
nope
@noname2031-w5r
@noname2031-w5r Год назад
teeth too aligned , speech lip movement big Fail
@ArthurBaum
@ArthurBaum Год назад
Thank you for your input.
@Giga3D811
@Giga3D811 Год назад
Ahh the good old jitter from the iphone face capture.
Далее
Учёные из Тринидад и Тобаго
00:23
БАГ ЕЩЕ РАБОТАЕТ?
00:26
Просмотров 111 тыс.
Celebrities Shutting Down Disrespectful Interviewers
17:44
Batman vs Darkseid
5:03
Просмотров 1,7 млн
The longsword duel from THE KING is on point.
10:55
Просмотров 2,4 млн
15 Perfect 10/10 Games You Must Play
17:57
Просмотров 1,2 млн
Blue Dot: A 3Lateral Showcase of MetaHuman Animator
3:57