One cool thing an amateur animator could do is having midjourney generate line art in the form of pencil sketches for your characters, then animate them as you described here. Then just clean up the line art as you would in the traditional animator workflow. AI did most of the keyframing and in-betweening, and now the human comes in to tidy up the work and shove the artifacts under the rug!
I've been wanting to make some fun videos of characters dancing, sort of like the dancing cats video I just made but with static backgrounds. I wasn't sure how to keep the backgrounds consistent and didn't want them morphing all over the place. This should be a good way to do it, although I might use Photoshop to cut the characters out from the background manually. Thanks for another great video!
Good to hear this was helpful 👍. Luma does still struggle with animating complex motions without blurring, but I think for dancing cats it should work pretty well.
@@Warmer_Bros I just re-read your comment. I also think it’s weird that it added the random lip movements. Maybe negative prompting might help to remove it.
I have noticed that @1:25 the motions cant be too huge. Ive used it to manually control facial motions or simple stuff like a character fallling to the ground or pointing their finger at their head etc