Real Time Camera to AI in ComfyUI

Подписаться 36 тыс.

Просмотров 26 тыс.

50% 1

Get 4 FREE MONTHS of NordVPN: nordvpn.com/en...
Topaz Labs Affiliate: topazlabs.com/...
Real Time AI Generations using your Camera in ComfyUI.
Twitter: @toyxyz3
HOW TO SUPPORT MY CHANNEL
-Support me by joining my Patreon: / enigmatic_e
_________________________________________________________________________
SOCIAL MEDIA
-Join my discord: / discord
-Twitch: / 8bit_e
-Instagram: / enigmatic_e
-Tik Tok: / enigmatic_e
-Twitter: / 8bit_e
- Business Contact: esolomedia@gmail.com
________________________________________________________________________
My PC Specs
GPU: RTX 4090
CPU: 13th Gen Intel(R) Core(TM) i9-13900KF
MEMORY: CORSAIR VENGEANCE 64 GB
LCM Lora:
civitai.com/mo...
Real time custom node: github.com/toy...

Опубликовано:

21 сен 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 103

@enigmatic_e 10 месяцев назад

Topaz Labz BLACK FRIDAY SALE: topazlabs.com/ref/2377

@Vsmphoto 10 месяцев назад

Oh man, I could have used this last weekend. I did the same thing with Touch Designer and Compute Render, but this looks way faster and has custom models, which is crucial. You are great, and I love watching your videos.

@enigmatic_e 10 месяцев назад

🙏🏽🙏🏽

@digitalfun2072 10 месяцев назад

Wow, I am really wondering if TouchDesigner could send and receive the real-time image to ComfyUI. Sounds like a AI camera interactive installation project

@dbusmire 9 месяцев назад

Lmao same!

@Vsmphoto 8 месяцев назад

@@digitalfun2072 I was just looking into this. Were you able to make any progress getting it to output to touch?

@louward7823 4 месяца назад

@@digitalfun2072 DId you ever try this out? or get a better frame rate than the above example?

@pavpav8627 10 месяцев назад

Was just thinking about how to set something like this up and boom - here it is !

@enigmatic_e 10 месяцев назад

It was bound to happen

@rodneyjweltham150 5 месяцев назад

That is fascinating. I noticed that the processing is really slow. I would imagine you need a quantum computer to make that thing run smoothly, nevertheless it's interesting to see what can be done

@mohammedrashid1910 10 месяцев назад

damn this so cool. ai is now getting close to allowing content creators to just turn a camera on and make a cartoon in realtime. cant wait

@gabrielmoro3d 10 месяцев назад

It’s absolutely insane how fast this is 😮

@enigmatic_e 10 месяцев назад

I know right! It’s going to be crazy when this could run without any lag or frame skipping.

@ParvathyKapoor 10 месяцев назад

Wonderful! Thanks for the tut

@enigmatic_e 10 месяцев назад

Thank you!

10 месяцев назад

Nice :) Though this still needs to become much faster so we can say it's real-time. Maybe this would be a great candidate for the TensorRT compatible SDXL to show it's muscles. Nevertheless, it's awesome we have so much toys to play with.

@KolTregaskes 10 месяцев назад

Very cool. Have you also seen Krea? Someone has hooked that up to a webcam too and is basically the same thing, without ComfyUI.

@enigmatic_e 10 месяцев назад

No I haven’t. I want to check that out.

@jaharoni 10 месяцев назад

Quick with it!! Thank you for your dedication to these tutorials

@marcjoymedia 10 месяцев назад

Thank you so much for sharing. So many new possibilities!

@CouchstainCollective 3 месяца назад

What would be cool would be to turn this exact concept into a VR application

@MahmoudRadwan-j4n 7 месяцев назад

you can batch those generated single images photos into animatediff node or animate diff combine and create a gif or a video. Nice tutorial thank you :)

@Duckers_McQuack 9 месяцев назад

Though, one node we do need, is one that can create a virtual webcam being those generated frames :D

@AscendantStoic 10 месяцев назад

We are very close to having older games being remastered through rendering in real time using AI, it will be glorious 😊

@enigmatic_e 10 месяцев назад

That’s going to be crazy!!

@normalplayer163 7 месяцев назад

Great Video! Easy to understand! but I got stuck on the step where I have to run bat. I tried several time and that webcam app didnt show up. HELP PLEASE!!!

@JingIeFett 9 месяцев назад

I'm having issues opening CaptureCam. I did the git install, clicked setup bat and then after when I click run bat, a command window briefly opens and closes and then nothing happens. Any ideas?

@BrunoPiresBPS 6 месяцев назад

same here

@lunarlouie 4 месяца назад

@@BrunoPiresBPS do you find a solut8on to this?

@lunarlouie 4 месяца назад

did you find a solution to this

@TheAgeofAI_film 10 месяцев назад

Thanks for sharing, I have subscribed, this is very interesting, I love to try this in our short films...

@TR-707 10 месяцев назад

thanks for your video! Was looking for a solution for this. My plan is to just pipe a virtual cam/ desktop capture into comfy and this is a simple solution

@enigmatic_e 10 месяцев назад

Awesome!

10 месяцев назад

Great video, thanks !!

@Vsmphoto 8 месяцев назад

Is there a way to output your preview to another screen or to syphon?

@PedroKozovitsBarbosa 10 месяцев назад

i DON'T HAVE THE "LOADwEBcAM" NODE

@HiddenInformation10 5 месяцев назад

It works, but I have a question, could those photos somehow be made as a camera, for example for obs?

@JustMaier 10 месяцев назад

“This is if you wanna catfish somebody at some point” 😂

@enigmatic_e 10 месяцев назад

😂 you know its gonna happen

@wuetsby5448 8 месяцев назад

this is cool

@aimademerich 10 месяцев назад

🔥 🔥 🔥

@enigmatic_e 10 месяцев назад

🙏🏽🙏🏽🙏🏽

@Dante02d12 8 месяцев назад

The little app is confusing. It seemed to work at first, then stopped working. It created a new render image by itself first ,then I reinstalled it and it doesn't seem to do it anymore. I just don't understand how to use that thing. Any advice? It's super interesting for so many things!

@CineFlavor 9 месяцев назад

My LoadWebcamNode doesnt give me an option to load the image path. It just is blank and red. When I first drag the image of the node layout on for the preset it tells me there is no webcam. So all I have is a blank node with a title. What is this type of node called? Can I add it manually?

@enigmatic_e 9 месяцев назад

Have you updated everything already?

@enigmatic_e 9 месяцев назад

If you are on webcam 0 try webcam 1 or webcam 2.

@CineFlavor 9 месяцев назад

There is no option to choose webcam 0 or 1. Its just a blank node. Everything should be updated since i just installed it last week. My webcam is plugged in via USB so i'm not sure if that changes anything. it's the Elgato Facecam@@enigmatic_e

@CineFlavor 7 месяцев назад

The issue turned out to be that I needed to install the missing nodes using ComfyUI Manager@@enigmatic_e

@JeremyBotz 10 месяцев назад

I can't get past the computer vision init. It keeps saying cv2 module not found, i've confirmed openCV was installed. Need help

@juschilltech 3 месяца назад

Yall are KILLING your ssd

@InkaHacker 10 месяцев назад

Do you recommend using this on Linux or Windows? Would it be too much resource intensive for a RTX3060 while streaming?

@enigmatic_e 10 месяцев назад

I don’t think this is ideal for streaming, at least not now.

@kachuncheng-s1v 10 месяцев назад

thanks~! Is it possible to use the capture cam if I run my ComfyUI on Runpod?

@enigmatic_e 10 месяцев назад

Sorry not sure. I never ran it with Runpod.

@USBEN. 10 месяцев назад

Damn bruh real time deep fakes, oooo baby!!

@enigmatic_e 9 месяцев назад

🤣

@nickdivito4662 9 месяцев назад

Can you combine something like these new LCM models into Vid2Vid work flows to get faster render times?

@enigmatic_e 9 месяцев назад

Yes you could!

@louward7823 4 месяца назад

Did you try this out? or had any luck with better frame rates?

@Iamdevvvv 10 месяцев назад

We are now more closer to see whole world through ai😅

@enigmatic_e 10 месяцев назад

I wonder what AI will look like a year from now.

@shopbc5553 9 месяцев назад

I would want to output HD 30-60 p or even 4K 30; is it possible, and how big of a computer would I need to make?

@enigmatic_e 9 месяцев назад

I have a 4090 and I dont think I could do that with this gpu so not really sure.

@genAIration 10 месяцев назад

Sir how do you show up your embeddings? I mean like a pop-up one. I don't know this node

@enigmatic_e 10 месяцев назад

When I start typing embedding in the negative prompt, it automatically shows me embeddings I have available and I just select what I want.

@genAIration 10 месяцев назад

@@enigmatic_e oo I see. I use a lot comfy but always use sdxl models but i don't have any sdxl embbebings then thats cz its don't show up to me . Thx so much sir 🙏🏿

@jbiziou 10 месяцев назад

very cool,:) I got stuck at ,, ( Load WebCam Image Node was RED warning) I then ran the run.bat in the CaptureCam folder, and restarted but nothing worked. Launched OBS and started recording, and restarted Comfi, but still not working. Any Idea please ? thanks :)

@enigmatic_e 10 месяцев назад

Not sure what it could be. I would go on X and message the developer, he said to reach out to him if you run into problems. I put his link in the description

@jbiziou 10 месяцев назад

@@enigmatic_e Thanks:) will give that a try.

@jbiziou 10 месяцев назад

Ahhh think I got it. In the manager I loaded custom node for Webcam, and boom, the node is no longer red :) got the preview image in the webcam,, but its squashed, haha,, Progress though:) 1 step at a time

@jbiziou 10 месяцев назад

Last thing was ,, Had to rename the LCM lora to ( pytorch ), from LCM.

@koosiuhang5257 9 месяцев назад

where can i get the ModelSamplingDiscrete node , i tried the install the missing node , but not working , 🙏

@enigmatic_e 9 месяцев назад

that should be a native comfy node. Have you tried updating to the latest version of comfy?

@koosiuhang5257 9 месяцев назад

ya , i did manuel update though download the comfy ui zip file and copy and paste the extra node folder and work ! @@enigmatic_e

@frankyaKaBIGMAC2 10 месяцев назад

u sir r a fcking gangster og

@enigmatic_e 10 месяцев назад

🤣 thanks!!

@TheHologr4m 8 месяцев назад

so my little i7 laptop with GTX1060 3gb probably stands no chance at behaving anywhere close to your monstor of a machine.

@koningsbruggen 10 месяцев назад

Can I use a screencast as the output?

@enigmatic_e 10 месяцев назад

Haven’t tried it, might be possible.

@hiddenintheshadows530 9 месяцев назад

screen cast? It has Region Capture, you can capture your screen and feed it into ComfyUI. Once again @enigmatic doing only part of the full tutorial

@enigmatic_e 9 месяцев назад

@@hiddenintheshadows530 my bad I’ll try to do better. I’m still in the learning process. 🙏🏽

@liquidmind 7 месяцев назад

webpage is gone?

@liquidmind 7 месяцев назад

This site can’t be reached

@enigmatic_e 7 месяцев назад

@@liquidmind not sure, things in the AI world changes so much it’s hard to keep track of it all unfortunately.

@KennethEstanislao 9 месяцев назад

What’s your gpu?

@enigmatic_e 9 месяцев назад

It’s in description. It’s a 4090

@KennethEstanislao 9 месяцев назад

@@enigmatic_e nice! sorry I didn't saw it as some youtubers usually didn't put it anywhere! thanks for the reply!

@enigmatic_e 9 месяцев назад

@@KennethEstanislao all good. I recently just started doing it because many ask about. 👍🏽

@mick7727 7 месяцев назад

Lcm always looks trash for me. Must be the models.

@enigmatic_e 7 месяцев назад

Yea might need some tweaking of the workflow too

@Parzival047 9 месяцев назад

.....so many things missing :(

@enigmatic_e 9 месяцев назад

What is missing? I can try to include it in the description.

@Parzival047 9 месяцев назад

@@enigmatic_e bro I went on to install comfy UI, then I downloaded that aniverse, but how to add this aniverse into comfy UI? I try loading it but it just doesn't loads. At this point, I am just installing every model which is there 😭

@Parzival047 9 месяцев назад

If I follow your path to install this... Then. 1. Install comfy UI 2. ? 3. ? Then what should I do next such that it WORKS 😢

@enigmatic_e 9 месяцев назад

You save that model in your checkpoint folder. Are you new to comfyui? I have a tutorial on how to get started ru-vid.com/video/%D0%B2%D0%B8%D0%B4%D0%B5%D0%BE-WHxIrY2wLQE.html@@Parzival047

@Parzival047 9 месяцев назад

@@enigmatic_e yes bro new to comfy UI ❤️