CPU temps max out around 72 degrees which isn't bad at all. GPU's get into the low 80's though, but they're made for it and I've been running them for a long time 24/7 already without any issues. Jump to 28:16 to see the final build.
Similar build to mine, except I bought an older Dell workstation with a Xeon CPU and P5000 before upgrading the CPU (to E5-1650 v4) and RAM (to 256GB) and adding a pair of A6000s. The CPU and RAM were 2nd hand and cheap, and I got great deals on the A6000s, so it came in around $11,000 and the P5000 is a great spare (needed it recently when my desktop's 3080ti died.) I don't need an insane CPU, since most of the work is done on the GPUs. ETA - I first built it in Sept '21 with 1 A6000, added the second A6000 in Dec '22
Out of curiosity, what is the max resolution and batch size before OOM? It would also be cool to see what the iteration speed would be on like a 4 batch 200 and 300 range resolution we typically can run😂
Well it's honestly not very fast. The GPU's are primarily where the training speed comes from in DF Lab and the A6000's are slower than a 4090. The value comes from the large amount of VRAM which lets me either crank up the resolution and/or the batch size. So training a 320 res model at batch 4 is actually a bit faster on a 4090 than it is on 2 of these. But on the other hand, I can train stuff on these I can't even attempt with a 4090, like 640 res models, or high dims 512 SAEHD, or 448 AMP with stupid high dims. But the training speed is pretty slow when you do stuff like that.
Display Port is actually Display in for Thunderbolt. That motherboard have Intel Thunderbolt chip build in. So if you want to transfer video over Thunderbolt/USB3 you connect DP exit of GPU DP to input on the motherboard.
@@DruuzilTechGames You welcome. Also for optimal cooling use Arctic freezer 4U or Be Quiet but for TR PRO. TR PrO have right orientation for fans. it cost less and its far better solution for new TR or TR pro from Noctua.
I'm pretty happy with the temps I'm getting from the Noctua (low 70's at most), and I already have it. If I have to replace it though I'll look at the BeQuiet model.
I wouldn't really call it a "wrong" orientation. It just blows the hot air up, which gets quickly exhausted out of the case. I don't think it matters if it blows up or to the back of the case.
@@DruuzilTechGames Mostly blender and some small video projects. I am kind of an amd fan so unless it's a massive hit in performance, like ridiculously so, probably will use that approach. W7700 is $1k so a viable budget for me.
I had a W6800 Pro for a while and it wasn't bad, just not amazing for Deepfacelab unfortunately. 32GB was a pretty huge amount of VRAM at the time though so that helped.
AMAZING Setup!! Do you use both A6000 to train at the same time the same model? As far As i Knew multi GPU was not supported by deepfacelab, is that now possible?
Multi-GPU has always been supported, but they have to be linked cards to get any speed benefit (ie linked with an SLI or NVLINK bridge). Nvidia has dropped support for NVLINK now on current gen cards, which is why I still keep the A6000's (which are last gen).
I'm speccing out and have most of the components for a very similar build on the way. Only thing I'm missing at this point is the NVlink. Which NVlink bridge are your running? It is it the 3 or 4 slot one? Haven't been able to find a definitive answer to how the PCIE slots are spaced on the gigabyte board.
What are your thoughts on AIOs for TR cpus? I really want to get the asus ryujin3 360 but it doesnt state it supports TRS5 despite the previous gen staying it and this 3rd gen has a 32% larger cold plate...kinda annoying there arent many AIOs that fully cover a TRs IHS.
What TDP can the Ryujin handle? The new TR chips use like 350w. Also the plate on the AIO is usually round whereas the chip is huge and slightly rectangular, so you aren't getting the best/full coverage. I would use a cooler made for the chip personally. Also depending on if you're going to leave it running a lot, I prefer air coolers these days simply because they never fail (other than maybe one of the fans which can be cheaply replaced). Don't want your pump dying while you're on vacation or something and frying out your system.
@DruuzilTechGames it wouldn't berunning 24/7 so that's the good thing. The cold plate is square but not sure how much it would cover. I don't plan on overclocking it and it's a newer one that is designed for the latest sockets minus TR so I would think it would be sufficient considering it can handle a 14900ks overlooked and also considering AMDs page mentions a kraken 360 being compatible despite the cold plate being round and smaller. Super odd tho...
Such extraordinary setup ❤. But i admit it's beyond my paygrade, haha. Sir I'm trying to do a PC setup for gaming and partly for AI. I was thinking of 4090 suprim liquid GPU, and noticed you tried it about a year ago. Were you happy with that purchase? Is it a sustainable card? What motherboard and means of installation do you recommend for it to last? Thanks in advance for your experienced input.😊
I'm still using that 4090 in one of my Intel systems. The motherboard doesn't really matter so long as it's modern (ie in the last generation or 2). idk what you mean by "means of installation" though.
If you're going to vertically mount the card it requires a specific case that allows for that. If you're concerned about the weight of the card, you can buy a GPU brace for like $10-15 that'll help with that.
Glad!! To see u.. I have one question. You made teeth training. Is toungue also possible in deepface live. Because toungue get struck when we try to pull out and show in live
SD is pretty much on the GPU (idk if it can support more than 1) so I don't think that's changed. I've done some messing around with it on my older 3960x platform.
Is that crap used to mine crapcoins? Or is the new overblown by the media machine learning hype that will stay but as a cool tool but not the solution, as always, to real human like AI or solving economic and the rest of the world problems. YEAH, IT'S A DOUBLE DARE!
