Тёмный

Refacer - Painting to Realistic (and Vice-Versa) in ComfyUI 

Подписаться
Просмотров 8 тыс.
% 463

Faces. Most of us have at least 1, and they're great fun to play with. This AI stuff seems to be zooming ahead really quickly, so I figured why not put a bunch of face things together, both old and new, and see how quickly it can generate? Thus, Refacer was born. Powered by SDXL, you can pop in any face and change it to whatever style takes your fancy! Realistic to anime, painting to realistic, cartoon to pixel art - it's all down to your choice of prompt and model :)
Want to support the channel?
www.patreon.com/NerdyRodent
GitHub:
github.com/nerdyrodent/AVeryComfyNerd
== Even More Info! ==
* Installing Anaconda for MS Windows Beginners - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-OjOn0Q_U8cY.html
* Installing ComfyUI for Beginners - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-2r3uM_b3zA8.html
* ComfyUI Workflows for Beginners - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-VM9snsuoqBc.html
* Photomaker - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-ZTck128jfFY.html
* Hyper SDXL - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-LAQYZWbmkwA.html
* Make an Animated, Talking Avatar - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-Z7TLukqckR0.html
* Reposer = A Consistent Character In ANY Pose - ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-SacK9tMVNUA.html

Наука

Опубликовано:

 

18 май 2024

Поделиться:

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист
Посмотреть позже
Комментарии : 56   
@Art0691p
@Art0691p Месяц назад
Excellent work. Thanks.
@Skydam33hoezee
@Skydam33hoezee Месяц назад
Lots of fun bringing Dutch heroes to life from paintings! Good results with the StockPhoto model, but even better with JuggernautXL.
@NerdyRodent
@NerdyRodent Месяц назад
Yup, been having all sorts of fun 😄
@JonMurray
@JonMurray Месяц назад
Totally and utterly lost but very interested hahah! New subscriber ✌🏻
@NerdyRodent
@NerdyRodent Месяц назад
Welcome aboard the AI train! 🚊
@runebinder
@runebinder Месяц назад
Really cool, although if I try an image with 2 faces changes the index sticks with the face on the left and doesn't swap to the other person on the right.
@AIAngelGallery
@AIAngelGallery Месяц назад
wow!
@thebonuslvl7181
@thebonuslvl7181 Месяц назад
very nice tx, u seemed to mention that this refacer goes the other way as well (making real faces into paintings, cartoons etc) yet whatever i write in the prompt, neg or change weight it tries to make it a realistic photo image.. any idea on what im doing wrong cos this looks like a very powerful tool i'd just prefer it the other way round?
@NerdyRodent
@NerdyRodent Месяц назад
Probably the easiest way is to grab the real to anime example from my patreon 😉
@alexgilseg
@alexgilseg Месяц назад
This is hellacool! However I'm struggling using the workflow to reverse the process.. How did you use this to turn photo into painting ?
@flyingdogsoft
@flyingdogsoft Месяц назад
Amazing examples! So license is fine and not so terrible limited as Face-ID?
@NerdyRodent
@NerdyRodent Месяц назад
Looks that way to me, but always double check!
@macbetabetamac8998
@macbetabetamac8998 Месяц назад
Awesome work thanks my furry friend!
@NerdyRodent
@NerdyRodent Месяц назад
Thank you too!
@francaleu7777
@francaleu7777 Месяц назад
Hi Nerdy Rodent, Thank you.. Is it possible to do the same no speciphic to faces? I mean full body or pictures without humans?
@NerdyRodent
@NerdyRodent Месяц назад
Give it a go and see 😉
@chrisgreenwell3404
@chrisgreenwell3404 Месяц назад
Great stuff , thank you :) I am looking for workflow that will take a face from image (a) and put it into image (b) with no prompting and keep all the facial details from (a).
@nirdeshshrestha9056
@nirdeshshrestha9056 Месяц назад
ipadapter does that
@Deep-Sea-Dream
@Deep-Sea-Dream Месяц назад
ROOP
@onewiththefreaks3664
@onewiththefreaks3664 Месяц назад
Reactor node for comfyui does exactly that.
@sinayagubi8805
@sinayagubi8805 Месяц назад
Amazing
@NerdyRodent
@NerdyRodent Месяц назад
Thank you! Cheers!
@suthamchindaudom6410
@suthamchindaudom6410 Месяц назад
I really like this workflow. You are awesome. Is there a way comfyui can convert a realistic portrait photo to a painterly photo or watercolor ,or anime without distort facial features of a person? Could you build such a workflow please?
@NerdyRodent
@NerdyRodent Месяц назад
Yup, all of those work too! If you want the pre-made configs, there are a bunch for sketch on Patreon, along with also painting and anime 😊
@suthamchindaudom6410
@suthamchindaudom6410 Месяц назад
@@NerdyRodent I've just log in to Patreon last Wednesday , but I don't khow how to find anyone who can built a workflow for convert img2painting , img2watercolor and img2anime . Could you sugggest some? Could you recommend where I can go and ask for this kind of workflow?
@NerdyRodent
@NerdyRodent Месяц назад
@@suthamchindaudom6410 best drop me a dm on patreon!
@PeteJohnson1471
@PeteJohnson1471 Месяц назад
I'm struggling to work out what the CLIP Model is, where to find it/place it. can anyone assist please? 🙂
@2PeteShakur
@2PeteShakur Месяц назад
Clip_Vision must be Clip-ViT-H-14-laion2B-s32B-b79k.safetensors in the clip vision folder of comfy models
@PeteJohnson1471
@PeteJohnson1471 Месяц назад
@@2PeteShakur Ahh cheers, Sorry for slow response, I've been logged into another account, I'll have another look and try that. Thankyou.
@2PeteShakur
@2PeteShakur Месяц назад
@@PeteJohnson1471 no worries, it's not bad but definitely not as good as doing it on auto 1111!😃
@davidrosbo4519
@davidrosbo4519 Месяц назад
Is there an option to do this in Forge? On an rtx4060 comfy would take 2 mins per image whereas forge does it in 10 seconds.
@randomprocess7876
@randomprocess7876 Месяц назад
is this workflow available on your patreon?
@NerdyRodent
@NerdyRodent Месяц назад
Yup, multiple versions on patreon!
@Beauty.and.FashionPhotographer
@Beauty.and.FashionPhotographer Месяц назад
SIMILARIZE would be holy grail comfyui Workflow now , after the REFACER has made photos from a painting. A cool challenge, where your Newton Photo would be made looking more like the painting of NEWTON you used, so a forcing of facial features towards the original painting sort of thing? .... not sure if this is even remotely possible....
@azmodel
@azmodel Месяц назад
I'm sorry, I'm very lost... I go to the repository I found a PNG file and that's it... I tried to replicate it manually on ComfyUI but I'm missing several nodes... So, is there any place in the repository where I can grab everything I need?
@NerdyRodent
@NerdyRodent Месяц назад
You need to load the PNG into ComfyUI. Check the links in the video description for the beginners guides to comfy!
@Hazzehh
@Hazzehh Месяц назад
Can't believe Newton had grey hair at 30
@NerdyRodent
@NerdyRodent Месяц назад
Ikr!
@sherpya
@sherpya Месяц назад
I had gray hair before
@arri6984
@arri6984 Месяц назад
Node type not found "IPAdapterAdvanced". The manager can't seem to fix this missing node. How can I install this?
@NerdyRodent
@NerdyRodent Месяц назад
You can drop me a line on patreon if you need personalised support 😀
@edmondyang
@edmondyang Месяц назад
Error occurred when executing LoraLoaderModelOnly: Error while deserializing header: HeaderTooLarge I am getting this on the LORA loader :( any tips?
@NerdyRodent
@NerdyRodent Месяц назад
Never seen that one! I'd guess at making sure comfy is up-to-date and the lora file is OK
@ponponych2
@ponponych2 19 дней назад
Лучше использовать IPadapter модель unnorm. Прям с силой 1.0. Копируется только лицо, а картинка рисуется по промту.
@LouisGedo
@LouisGedo Месяц назад
👋
@ismgroov4094
@ismgroov4094 Месяц назад
Thx workflow plz, sir
@lance3301
@lance3301 Месяц назад
His workflows are uploaded to his github link.
@steinscamus8037
@steinscamus8037 Месяц назад
No a1111 for this?
@NerdyRodent
@NerdyRodent Месяц назад
No tgate I’m aware of for a1111 as yet, but maybe in a few months time?
@KINGLIFERISM
@KINGLIFERISM Месяц назад
Am I the only one who thinks this needs a second pass? I guess I can do it but... shame he didn't put that in place.
@Beauty.and.FashionPhotographer
@Beauty.and.FashionPhotographer Месяц назад
such a great workflow.....was looking for adding real skin to Midjourney's Portraits Photos where MIJ failed to create real skin. This just might be a solution. i did encounter a hard stop though through installation. gave me errors, undoubtedly because of my Mac (Macs might have AMD GPU i am guessing?). so your workflow im Comfyui stopped here: Error occurred when executing AutoCropFaces: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is False. If you are running on a CPU-only machine, please use torch.load with map_location=torch.device('cpu') to map your storages to the CPU. as a newbie and not knowing what this all really means and how to fix this,..... it became now an amazing thing... which did not work....
@NerdyRodent
@NerdyRodent Месяц назад
Ah, probably need a different node with special Mac support instead. There are quite a few out there, so hopefully something works on Mac!
@Beauty.and.FashionPhotographer
@Beauty.and.FashionPhotographer Месяц назад
@@NerdyRodent it works now, for macs took the WAS SUITE Image crop node, it is not as precise as you get them from painting to real faces, even if i clone all settings, but maybe once i learn more, i can take sections from other peoples comfyui projects, where faces remain almost identical (for ex. supir)
@hugoleote
@hugoleote Месяц назад
I managed to make this work. You need the following custom nodes: cg-use-everywhere comfyui-art-venture ComfyUI-AutoCropFaces ComfyUI_IPAdapter_plus ComfyUI-PhotoMaker-Plus ComfyUI_TGate And the Clip_Vision must be Clip-ViT-H-14-laion2B-s32B-b79k.safetensors. Great work!
@2PeteShakur
@2PeteShakur Месяц назад
yeah that seems right no issues with that just use comfy manager for missing nodes - only had issue with model - seems was in the wrong node so changed it and all working now! ;)
@KINGLIFERISM
@KINGLIFERISM Месяц назад
at least someone isnt hiding information. Nice boss! Thanks.