Text To 3D Character Animation With AI • MOOTION

Подписаться 53 тыс.

Просмотров 26 тыс.

50% 1

Register as an AI creative for free at aianimation.com.
Checkout Mootion at www.mootion.com/?source=7
(Save 20% before the end of Dec '23)
Mootion Discount Code:
XCLXPFHL
Mootion Discord Server:
/ discord
This video is a showcase of Mootion, the new AI tool to create 3D animation for characters using a text prompt.
Plus it evolves into to an in-depth tutorial, where I take you through all the steps to work with the downloadable video file or 3D FBX file from Mootion.
------------------- -------------------- ---------------------
Times
0:00 - Awesome-ness
1:51 - Mootion
6:18 - After Effects Composite
7:45 - Blender
10:36 - OpenPose Blender Rig
20:42 - ComfyUI
22:22 - ComfyUI Results
24:32 - That's A Wrap
------------------- -------------------- ---------------------
Tools Used in this Tutorial:
Mootion:
www.mootion.com/?source=7
Mootion Discord:
/ discord
- Blender
www.blender.org/
- ToyXYZ's ControlNet Rig for Blender:
toyxyz.gumroad.com/l/ciojz
- MidJourney (For the Futuristic Tea Factory backdrop)
www.midjourney.com/
- Adobe After Effects
- ComfyUI
- Vast (To rent GPU's in the cloud)
cloud.vast.ai/?ref_id=91751
- Upcoming ComfyUI tutorial and Vast Setup: (*Text tutorial ...for now.)
aianimation.com/comfy-ui-anim...
------------------- -------------------- ---------------------

Кино

Опубликовано:

1 июл 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 46

@braveitor 7 месяцев назад

This is very good stuff. It's amazing how these tools have evolved in such a little time. Impressive. Good job and thanks!

@user-nh2ul8ii2w 8 месяцев назад

Looks so cool! Guess it can be the most genius motion generation product I ever used.

@aa-xn5hc 8 месяцев назад

Amazing, especially the second half

@LearningZoneLanguages 6 месяцев назад

Thank you for showing us. I can't wait to try it. I think we are facing a very interesting era.

@user-kc1ij1fl8v 8 месяцев назад

Looks amazing and fun

@mmilamix 7 месяцев назад

thank you so much - just tested for unity works well! hope that will speed up my cartoons

@casksandy 6 месяцев назад

Amazing! I look forward to us being able to generate our own characters. Maybe even uploading a JPEG of a character and the character is automatically animated.

@PieterLaroy 8 месяцев назад

Fantastic video! Thx!

@AIAnimationStudio 8 месяцев назад

Cheers, glad you liked it.

@aa-xn5hc 8 месяцев назад

Wow!!!! Amazing topic this

@AIAnimationStudio 8 месяцев назад

Thanks. Yeah it's going to be interesting to see this space develop.

@moonshineOficial 7 месяцев назад

Genial!

@ryebread1003 6 месяцев назад

I took a pass at a text->3D during the April AI rush. Ultimately the papers I was following just came to be too intensive for floating point operations (literally 100gigs of vram for a potted plant) Taking a whack at it again now that I have some compute time banked. Keep it up this is awesome work.

@FreedomArtAI 22 часа назад

amazing video!.I was wondering do you have a workflow to download? and I'm wondering how did you add the openpose rig as video for comfyui?.I subscribed!. and add animation from the openpose video to comfyui.

@dennisnewsky7890 7 месяцев назад

Hello! Thank you for sharing such valuable information with us! You have the best quality animation content I've ever seen! Tell me, is there already a way to obtain 3D models from 2D images?

@AIAnimationStudio 7 месяцев назад

Hi, thanks so much. Yeah you can do 2D to 3D models using something list CSM.ai . Plus there are a few others on the scene now too. Plus a slightly simpler but free (or paid if you need to skip the queue) approach is to use Dream Gaussian via Hugging Face.

@manifixdesigns 5 месяцев назад

@@AIAnimationStudiohow to do this animation in a1111

@hairgalleryusa8corp401 7 месяцев назад

How to make character bigger in photo

@lucilehujeux6934 7 месяцев назад

Hello, I’m new here, and I would ask you what is your computer specification? Thank you, your work help me a lot !

@AIAnimationStudio 7 месяцев назад

Thanks. My local computer is an M1 Max, Mac Book Pro. 32GB of ram. But for running ComfyUI. which I was running locally. I'm now running via the cloud. Renting 2 x 4090 Nvidia GPU's. I'll post a video about this approach soon.

@NobbySavage 4 месяца назад

Hi, is there a a way to lip sync 3D models? Or can we use 2D lip syncing tools available and apply them as a texture to a 3D model?

@AIAnimationStudio 4 месяца назад

Hi, whilst you can animate the mouth of the openpose rig it does'nt translate across as overly great lip sync. There are some pretty complex 3D head rig, lip sync approaches which are probably not what you're after. An alternative approach would be to pass your rendered footage of a character as a video clip through Lalamu Studio (demo) or synclabs.so where it attempts to add animated mouths to your characters aligned to your audio file. The results can be pretty good particularly if you're character isn't too stylised and has typicaly human proportions. For more stylised options you may have to go a bit more old school, and create the mouth shapes and animate manually in your 3D package.

@NobbySavage 4 месяца назад

@@AIAnimationStudio thanks, will check that out

@AlgorithimError 5 месяцев назад

can you please do the video on using auto rig pro to retarget the animation fbx

@AIAnimationStudio 5 месяцев назад

Hey. I actually covered retargeting the FBX animation to another Character rig here last week. Hope it helps. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-BabkaTF-kw0.htmlsi=Q46S0nSCFKbryxNk&t=247

@talhakatoonkhaana 7 месяцев назад

Does this program allow to upload your own 3d characters?, and generate animations of that character that only you will have access to?

@AIAnimationStudio 7 месяцев назад

Not yet, but maybe they'll add that in the future. So the approach with the FBX file download and transferring the animation to your own character is the best approach at the moment. In other platforms WonderStudio have made setting up your own character to use on their platform a bit easier. (Their platform turns live-action footage into, motion capture and applies it to a 3D model, plus matches the scene lighting).

@ghostsquadme 4 месяца назад

As requested: Hi! 👋

@aaagaming2023 8 месяцев назад

How capable would this workflow be of making a virtual music video of a rapper with as lifelike a look as possible?

@AIAnimationStudio 8 месяцев назад

Describe the rapper and I might give it a go on the weekend. If it needs to be a specific rapper some new face swapper approaches are working really well. Good quality lip sync though is still tricky, but different approaches are improving all the time.

@aaagaming2023 8 месяцев назад

@@AIAnimationStudio Yeah there are some decent quality lipsync colabs up. The other option is rapping it with UE5 face animator and deepfaking over the top of the metahuman with Deepface Live. The main thing Im looking for is if this Mootion can do lifelike rapping animation or if its still too generic. How does it handle fingers for example. Currently I have high quality Tupac and Eminem rap tracks made with AI voice clones. Just looking for the most realistic method to put them in music videos. So far however nothing has come close to licensed stock footage with lipsync and DFL dfm deepfaked over the top.

@AIAnimationStudio 8 месяцев назад

@@aaagaming2023 . Yeah the whole Metahuman approach is definitely the bets way I've seen for really good lipsync. Otherwise you're a bit restricted with Sad Talker Colabs/Discord, or D-iD etc and trying to pair it up with the body aniamation. I defintely think Mootion could make some cool rap moves. Plus (I think) there is some finger animation... but you might want more refined control, though it's the only text to 3D animation tool I've seen with decent results so far. Otherwise you could explore the Vid 2 vid wokrflows with Comfy UI, where it cna create the OpenPose/Controlnets from the video source and use that to drive the animation. Hmmm.... potential to get it all working... just needs some time and a bit of R&D to find a way that does'nt take too long.

@paygame01 2 месяца назад

Gimana cara nya

@zck2020 8 месяцев назад

In the future anyone will be able to make today's blockbuster movies.

@j.x.7655 8 месяцев назад

AI will generate different movies for everyone.

@sounder7564 8 месяцев назад

low sound

@AIAnimationStudio 8 месяцев назад

Yeah.. annoyingly.. rushed the export and didn't double check the Db levels. 🤦‍♂

@ze1st_ Месяц назад

9:42 I was here only for this thing and you didnt do it

@AIAnimationStudio Месяц назад

:-) ... here you go ... think this is what you're looking for.. ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-BabkaTF-kw0.htmlsi=LQoGydnCOlbq_QSL&t=335

@ze1st_ Месяц назад

@@AIAnimationStudio thx

@ryansaper 5 месяцев назад

These examples look awful. I was expecting something like the prompt/ run and fall down after tripping on untied shoelaces and then sitting on the ground holding your toes in pain. Maybe in a few years the tech will be there

@AIAnimationStudio 5 месяцев назад

It's already improved quite a bit since this video was first made at launch. You can now do multiple actions, one after another in a single prompt. Not sure if it would deliver on your described prompt... but maybe... It can now also do motion capture using your own recorded video to drive the 3D animation. Plus it also now lets you generate Stable Diffision (animateDiff style) animations directly from the Mootion generation as well as the FBX download. No doubt there's tonnes of areas that can and will be improved but as one of the first (if not the first) text to 3D animaton generations they're leading the way. So many new tools coming out and improving... it's a lot to keep up with 😅