It doesnt make sense though, I mean the only reason to get a 56 core xeon and populate 7 GPUs on those PCIe slots is if money is not an issue at all and the only goal is to save some space on your server room. I mean if you make 7 different PCs (with 8 core CPUs on each -as you would have shared e.g a 56 core to 7 GPUs - and one of the GPUs you would like to work with, also mind that there are even 1U cases that can facilitate that so you would need 7U , or if you can have e.g 2 GPUs in each case then you would need 4U and in any case 14U max) You would have saved at least 500 PER RACK and have potentially better performance (due to the lower count CPUs not only being cheaper but faster as well especially in low thread workloads) I mean the 56 core Xeon alone costs 6.5K euro
Thanks so much for the kind words STH! And credit where credit is due to our component partners: we appreciate you covering the amazing Kingston DDR5-ECC 6,000 memory so well. Kingston really knocked it out of the park with their 8-stick kits. Easiest 1st memory bringup experience we've ever had on any DDR5 platform. You just plug it in, set XMP, and it just works. Kudos to ASUS as well for making a board that can deliver the power needed to run the 56-core Xeon at its full clock speeds (assuming you can cool it, which took a custom AIO but Silverstone delivered for us there!). Xeon is a compelling platform if you can feed it all the power and cooling it needs. We really appreciate all the time you put into this!
Why not make it riser friendly I mean this mobo goes to waste if you plug 2 GPUs on it lol You could add an other 2U on top of it to stack the GPUs which would provide better airflow as well. Or, due to limited interest that cant excuse a specialized SKU in your production line, then at least make it kinda modular so make it possible to "slide" (and lock ofcourse :P ) an other rak on top of this one and make the rak capable of changing the backplate (or front plate) in order to facilitate extra GPUs via x16 risers that way. Now that's something I would buy for a dollar :P
@@billkillernic It's a rackmount chassis. That computer is not made to run massive 4090s, it's for Quadro and A-class cards, which run with blowers or passive cooling so the chassis fans provide airflow for them. You can fill all slots with GPUs if you use those, since they are dual slot designs.
@@LtdJorge No you can not (since you need single slot for that there are some single slot quadros but they are weak enough not to excuse the bandwidth each PCIe slot here provides) and qudros are actively cooled you are thinking about other lines such as Teslas but those are 2 slot as well.
That Falcon is every analyst's dream PC, and not meant to be used in a home theater setup, but in serious engineering work. Is it possible for Falcon to send that PC to us, so we can really put it to test? How about running Ansys on it to run a CFD of a fluid control component that will be installed on a spacecraft which will be orbiting the moon in couple years and compare the results to the Dell workstatiosn we currently use? That's what that Falcon is built for, and how it should really be tested and used.
Great video, had fun watching all of these configurations. I think you're right about the demand for high-PCIe connectivity, lower wattage systems with ECC support. With that said including power draw from the socket idle, under full load, and maybe running some VMs/plex transcoding would have improved this section of the video more. In essence you piqued my curiosity, but even visiting the main site article I'm not seeing the power consumption breakdown. For future content I think slowing things down, going into the power/performance metrics in various use cases more, and possibly splitting this into multiple videos would have shed more light and enthusiasm on these kinds of builds. Best of luck in 2023(and beyond)!
Sapphire rapids sounds like a nice platform to pick up used in 5 years for a boatload of PCIe 5.0 for cheap. Kinda like Epyc Rome is right now for PCIe 4.0.
I'm using the same chassis (SilverStone RM42-502) as Falcon Northwest RAK for a custom water-cooled 10980XE + RTX3090x2 system. This chassis handles them great
I have followed falcon northwest for years. Dream has always been to get one of their amazing systems, but I have never been able to justify the cost with all my other competing financial priorities. Oh well, I will just keep watching from afar 😊
I recently built a Xeon W system for my work with my software development. Intel Xeon W7-2495X 24C 48T, ASUS Pro WS W790 ACE, 512GB DDR5-4800 ECC RDIMM, ASUS ROG STRIX RTX-3090 24GB, WD Black 4TB SN850X and 2TB plus other drives, Corsair 5000D Airflow, Corsair HX1200, Noctua NH-U14S-4677 and Noctua 120mm case fans, Dell 34-inch Ultrasharp Wide, Ducky One2 kbd, Microsoft Mouse, Mackie speakers. The system is awesome. I considered an RTX-4090 but the current prices and melting adapters made me stick with my 3090.
@@Teluric2- I develop the TerreSculptor software, which is high performance heightmap creation and editing software. It currently supports heightmaps up to 1 million by 1 million meters, which is a 4TB heightmap array. And the internal code supports heightmaps up to 18 exabytes in size (2 billion x 2 billion meters). So I use the workstation to test the large terrain creation and editing in TerreSculptor. Plus I use the workstation for my Unreal Engine 5 game development. I am a professional game developer who went solo two years ago, I have two games under development.
We had a Genoa system actually we were building, but getting Windows working was a bit harder so we shelved that project as it might be too challenging for many to follow (but it was possible.)
@@ServeTheHomeVideoI’m on Milan 7343, and used windows to stress test it. But run unraid on it for my storage server, vm and dockers. doesn’t have PCIe 5.0, but great value for what I’m doing. Nice to see Intel finally competing again, I was stuck on x99 for too long
@@ServeTheHomeVideoplease post comparison results between these new Xeons against the most recent Threadripper Pro CPUs!! I’m really suspicious that the performance gain isn’t all that much
@@-blackcat-4749 I idle around 150w, with about 20 dockers running. Most disks spun down, but the SSD’s. Maybe 5-10% cpu usage. Lowest I have seen without the disks is about 110w. When I spin all the disks up and do a scrub, on all disks at once, and encode a video, plus about 80% cpu. I see about 450w. 200w of that is my drives. I run a lot of hardware: LSI 9300 i16 Sas expander 1660 super 20x hc530 hdd 4x u.2 p4510 2x 990p pro 4x 870 evo Big part of my low power usage is Unraid. Has slow writes to the array, but is perfect for media files. Everything important is on my zfs pool
Awesome video man! Side note, is it just me or do other people also wanna see the monolithic w7 2495x overclocked to the max under custom water cooling 🤤
This is a super fun collection of system across a bonkers range of performance. Liquid cooling high-clock & high-core CPUs really does unlock the full performance. My 73F3 16c/32t DIY workstation can keep a Cinebench R23 run at a nearly locked 3.9Ghz at 51C.
I’m running a 7343 and can do 3.9ghz consistently on all cores. You might be able to squeeze just a little more out of yours. Remember, you can adjust the TDP in the bios. Mine was only doing 3.5ghz all core, until I upped the TDP to 200w. I’m on air with the ARCTIC Freezer 4U, rated for up to 300w. Usually top out at 55c Default for yours is 240w tdp, but I would make sure it’s set to that.
The ACE board from ASUS and the ASRock w790 can be had for ~900ish (I think the supermicro board is around that price as well) and all things equal for what you get the SAGE is on the high side but reasonable. If you don't need gen 5 older Epyc/Threadripper/Xeon w can be had for some pretty good secondhand prices.
This is something I have wanted because I was looking for a chassis that could slot multiple PCIe bootable raid HBAs that need 16x slots for their 4 onboard M.2 SSDs. Even the cheap port expander PCIe SSD cards would scream on a mobo like this. Passive copper blocked SSDs and water cooled CPU is ideal for recording studios that need quiet disk recording with high speed and capacity. This is a perfect graphics editor and rendering server platform too I would imagine. If you slot a bunch of PCIe NPUs you could probably train/test AI models nicely too.
I use the Threadripper Pro version of that board in my home Unraid server except mine has Wi-Fi in it although I don't use i since it has dual 10G Ethernet. My board is in a monstrous 80lb Thermaltake Super Chassis (that's just the case weight with NO components in it).
I had to laugh at the sound test as I could not hear over the sound of my hpe server idling. Used is great on value but man do you pay in noise profiles.
I can see that the number of PCIe Gen5 lanes on this CPU and board just supercharged your enthusiasm. This ought to be your daily driver machine just to level up with Wendell ..... Oh, don't ever let Linus touch those W class CPUs, he will drop them (unintentionally....)....
Because I haven't heard anyone else say it in a review: All DDR5 RDIMMs, including the the 4800MHz JEDEC stuff, can be overclocked on this motherboard. Even the high density JEDEC memory has quite a bit of headroom.
It can be over clocked but a warning. These cpus have a tendency to bow if the memory controllers are stressed due to heat. Will damage the cpu badly. Hence the insane torque requirement on these.
@@nathanlowery1141 The bowing was unique to LGA1700 CPUs because of their unique 2 point hold down mechanism. I can assure you the LGA4677 CPUs do not bow with their 4 point hold down mechanism. The RAM on this platform does have a tendency to overheat without tons of airflow though when being stressed, especially when overclocked.
@@paulblair898 unfortunately not the case. Wendell had this issue and touched on it briefly. Said he got a replacement under warranty. Still waiting on my ram to build mine. Gonna run 6000 by 8. Hopefully won’t be an issue. Wendell pushed the clocks a bit. Maybe not pushing it quite as hard will negate it all together. Torque spec is 1 Newton so we shall see
@@nathanlowery1141 You are right that Wendell had that edge curling issue with a W-3175X, I had forgotten about that; in that same video Wendell mentions that the W-2400/3400 processors aren't supposed to have that happen because of different packaging/mounting pressure, I suppose time will tell.
You know, I'd love a guide to buying professional GPUs. Like a lot of people, I've grown interested in AI workloads lately, but I only have experience with consumer facing retailers (newegg, amazon, and so on), but I'm also pretty sure those aren't necessarily the best places to buy, for instance, an RTX 6000 ADA. A guide to retailers and the actual process of purchasing an accelerator for a system would be very welcome.
I'm tempted to go this way for a workstation, but the single-thread performance of the high-end 13th gen Core CPUs beat these Xeons by a considerable margin.
I built a W7-2495X, W790 ACE, 512GB, RTX-3090 system not for fast single thread operation, but for the multi-thread performance, the memory size, and the expansion. 13th Gen and Ryzen can't do that. As soon as 256GB DDR5 ECC RDIMMs become available here, I will be going up to 2TB memory.
I saw you on "Jeff Geerling" RU-vid channel, i was actually surprised to discover that you were Canadian, i always thought you were from the US (more specifically California) lol
How about a rig that a RU-vid creator might want: something with 512 GB RAM (for video editing) and a decent gaming GPU for after-hours entertainment? Or a build for a composer like Neil Parfitt which has 768 GB RAM for audio samples and the slots are used for music devices like DSPs?
I've been wanting to build a high core count fast PC for editing videos but new hardware is too expensive. Trying to talk myself into using a R730 as my desktop.
Holy moly, this PCs are on another level of epycness! 😲🚀 I'm pretty sure it could run a spaceship to Mars! 🚀🪐 This beast is ready for world domination! 😂
@@ServeTheHomeVideo I'm not worried about the CPU. Try running furmark on the GPU with a CPU stress test simultaneously, and you'll see what I mean. I have tested this extensively, and I had to add additional small fans to help cool the VRAM on a 3090
@@daveg4417 OK... I'm talking about rumours that there are problems with those early sapphire rapids processors. Including power use and power overhead. Also some problems with specific types of performance (so in certain applications or types of loads). But sadly I can't find any reliable source with details. Only place that has them and is mostly first hand is MLID's Broken Silicon Episode that features DAW Engineer. But that covered only power overhead (still a big trouble) and there is nothing about other issues. Reliable websites only talk about "problems" or "issues". None of them go into details. I would love to know the details and how big this really is.
Great Video and Great Uptake of Intel. It's a shame that AMD never has no Threadripper with Zen3 oder Zen4 out. Yes the 7950X has 16 Cores which is a Sweetspot thanks to Core Licensing but it lacks the PCIE Lanes for NVME Connection. You get on this Board 6 1/2 PCIE Bifurcation Slots so you can load very cheap 2x PCIE 5.0, and cheap PCIE16 to 4x NVME in every Slot. (except PCIE 6 which can only handle 2). When you run VM's it's nice to allocate a Drive on Hardware to the VM, so that you ie your Webserver is running on an Island with no connections to your Network. Our your Sandbox for Virus checking etc. The low Budget Version would be the Pro WS W790-ACE with a W5 Prozessor and only 5 PCIE 16x Slots. Costs around 200-300 less. That is something the Desktop Prozessors can't do and until AMD launches there 7000 Threadripper line, there are only Big Epyc, which cost a lot more. Intel has seized the moment for now, especially the lack of Zen3 Threadrippers.
You'd have to focus on AMX or apparently connectivity when talking sapphire rapids, because as far as I understand there's not much else going for them relative to bergamo or genoa-x. If they can't rely on intel-only shops for sales they're going to have to offer deep deep discounts to the paper price. The main interesting thing for compute is the hbm2e part, as phoronix benchmarks show if workloads can fit in hbm and dram be avoided intel can claw back some efficiency that they sorely need. 64GB is not enough for most workloads but next gen HBM3 should allow 256GB with the same 4 stacks they currently use. 256GB ram with presumably 112 cores is more viable than 64GB ram with 56 cores, might allow a number of workloads to go dramless.
We have a Xeon Max video coming probably in 2-3 videos. We also were going to do a Genoa workstation build, but it was so rough, especially compared to this, that we shelved that project after finishing the build part.
I’m going to runout and buy an intel like I have for 25 years! I’ve never owned an AMD. Bang for bucks is the bottom line. Come on intel, please let me have an amazing processor so I can do my work.🤜🏼🤛🏼🍀😎🇦🇺
Arent these chips DOA? I just looked at Puget Systems review where they compared it to a threadripper 5995wx and the threadripper easily wins while using half the power and is a 2-1/2 year old architecture (Zen 3 was released Nov 5, 2020). Am I the only one that thinks it's embarrassing that Intel, a company with a $17+ billion R&D budget (vs AMD's $5 billion), is getting beat by a 2 year old CPU?
So the Falcon NW RAK beats the 5995WX systems we have. The Lenovo is notably slower than AMD. Also remember you have PCIe Gen5 here so if you need the fastest storage/ cards it is not close.
Also to unlock the full potential of Sapphire Rapids you seem to have to run them at these high power levels (is this still within the spec or already overclocking?), I wonder how Intel wants to pitch these to the server vendors where power efficiency is super important. AMD still should be a bit more aggressive in this segment - the neglect of Threadripper might have cost them some hard earned mindshare.
Not sure why people are soo focused on power, it's the pros/customers demanding more cores and higher clocks. At this point in time power isn't a problem, if AMD normalise on the same process then the power will be similar anyway... same with Apple. There is no magic fix, its a physics problem not a design one.
A workstation build like that just seems silly imo. With all that bandwidth you could run a TON of honey badgers as an insane cache server. Main issue would be the measly dual 10GB connections (measly when you're talking about saturating 112 PCIE lanes).
What I don't get is all these creators showing these demo builds in cases that can't even take advantage of 80% of the lanes. I get you'd need to use extensions but where would you even mount the cards? Aside from HBAs and high speed networking cards what else can you do to take advantage of all those lanes? Seems overkill for a NAS so it's gotta have other uses that I can't think of.
@@ServeTheHomeVideo ... Now we're talking! Il go watch that. Thanks M8! Would however love to we these builds with a purpose in mind. Would make it so much easier to get a feel for the real world use cases. Extra plus if it's something especially cool :)
Well... After some thinking... I guess you could use one of these systems as a part of a 2 unit (failover and throughput) main controller for a massive 3 racks full of 40*10 gen3 m.2 decentralised "jbod"s with their own 40-48 core epyc drive controller being linked through both of those two mains. That would give you a throughput of 60 Gb per ethernet link (2 links per "jbod-which-is-basically-a-SAN-at-this-point", one to each of the main controllers for a total of 120Gb per jbod-san (wouldnt be saturated if each drive had a 3Gb/s read/write cap) and a full total of 120*10*3 Gb for each of these complete systems... Could be interesting! Nvm, based it on sata 3 speeds... Lol
I built a W7-2495X, W790 ACE, 512GB, RTX-3090 system to do my software development on, and game development for Unreal Engine 5 and Unity. I need the memory size and multi-threading. The W2400 only has 64 lanes, so it easily handles everything that I want. And 13th Gen and Ryzen don't have the memory support. As soon as the 256GB DDR5 show up here, I will be upgrading to 2TB.
What would you recommend for a WS/NAS/Virtualization station built with this motherboard? Looking at the Intel Xeon w9-3475X Processor... Any case recommendations for dual PSU? Not sure if I'm going rackmount, but will if necessary Also, how many GPU's can work on the motherboard? is it 6 or 7? I think that PCIe slot 6 has a quirk about it where it may not work as a full x16 slot... or, I could be wrong... was thinking of adding multiple NVIDIA RTX A5000, though I don't know how many will fit if they are too wide for a single slot....
The Falcon NorthWest RAK is almost what we need for our CAD instructor console, but we need to be able to access the ODD, if the motherboard could be placed at the 'top' of the chassis with PSU at the bottom, with a single ODD that overhangs the motherboard(should fit thanks to water cooling, it would be perfect for an Intel/AMD 7/9 series with a ****quadro**** GPU Alternatively, a single ODD towards the center that overhangs the motherboard
@@CheapSushi its too deep to fit in our instructor consoles, which are based on somewhat standard audio racks, the ODD overhanging the motherboard suggestion was to allow the OOD to take up the same depth space as part of the PSU shrinking the overall depth of the case. Also, have you tried to get someone not used to vertical ODDs to not break the drive or disk when using it? I personally wouldnt deploy this in a classroom unless in a tower configuration. I use a similar silverstone RM41 at home but my enclosed audio racks have extra space behind the rear ears, so while the chassis canot really be much longer than 17 inches, the cables have another ~3 inches of wiggle room except near where the door meets the rack on either side. The consoles at work need the rack and cables to be a little under 18 inches though preferably 16 inches, the RAK would leave no room to plug in cables even if we use right angle adapters. Oh, and while that silverstone works at home, it is an extremely tight fit at work, and we're looking for something else. We dont want to use actual servers because of how often insructors and students break machines, so we need to be able to have parts on hand to fix them, same day service isnt acceptable when we have to cancel 4 classes to wait for someone to drive ~150 miles with a replacement part, when i or someone else can completely re-build the machine in about 40 minutes, or replace a broken part in 10
@@CheapSushi Forgot to add, the RAK and RM4x, while too deep to fit normally, can fit if we use rails and some spacers screwwed into the ears to prevent it from being pushed in and damaging cables, letting it hang out the front a bit, but thats not ideal, i'd still opt for an RM4x just for the horizontal ODD
@@denvera1g1 If you're so worried about things breaking, like an ODD, then why would you even be considering a watercooled setup, that has even more points of failure? And not just fail but fail catastrophically destroying thousands of dollars worth of components? You clearly know what you want and can't have. It's like you're going in circles about things that don't make sense anyway for what you want. There are so many chassis options from Silverstone already. You can build your own. Why can't you just do that? Get exactly what you want? They have a ton of options. The RM41-506 and CS350 have a horizontal slim ODD option for example. The GD09 and GD08 are shorter depth with ODD options, and have rack mount part options.
What’s with the intel only? My mind was screaming to me to compare this to the recent Threadripper Pros. No graphics cards need anywhere near PCIe gen 5 and AMD has been destroying Intel in raw performance and performance per watt. Leaving out Threadripper Pros and even EPYC in a discussion of workstations seems almost negligent!!
hes mentioned in a few comments but his AMD system kept running into issues and complications wheres as this he just plugged and it worked and as such some of the AMD videos got shelved
I bought an ASUS Pro WS W790E-SAGE SE with the Intel Xeon w7-2475X processor and V-Color DDR5 memories 256GB (64GBx4) 5600MHz CL36 Overclocking R-DIMM SK hynix Original IC 2Rx4 1.25V ECC Memory DIMM registered for W790 work station It only works with 1 memory placed in slot B1, if I place 2 or more memories code 29 appears Does anyone have any idea what's going on?
Intel moving inn while AMD is "moving out" of the high end workstation marked Intel once left. I'm so glad to finally see some real competition in the CPU market. Now we are just waiting for Nvidia to get some serious competition in the GPU space
AMD is "moving out" only because it's much more profitable to allocate limited silicon to EPYC processors. Anyone can build an awesome EPYC based work station, so I do not really see the point of Threadripper.
The more lanes are supported, the higher the package pin count, the larger the cpu size and die size, the higher the cost. Consumer desktop processors would double in price if they supported 32 lanes and 512GB of memory. The Intel HEDT and AMD Threadripper are the platform step for high end desktop.
@@KuntalGhosh - It is possible that future consumer processors might get more HEDT features, but I wouldn't count on it. It would also be nice to have 4-Channel Memory controllers on upcoming consumer processors, instead of just 2-Channel, but I really doubt it. The thing is, in the Intel Xeon W2400 series, the W3-2423 processor sells for only around $500 USD and it has 64 PCIe5 Lanes and 4-Channel DDR5 Memory supporting up to 2TB. So it is cheaper to get into the W2400 series if you want those kinds of features, than it is to buy an i9-13900K. The W5-2455X 12-core 64-Lane 4-Channel retail boxed processor is only a few hundred dollars more than the 13900K. The W5-2455X is also 12 P-Cores and the i9-13900K is only 8 P-Cores. So adding the HEDT features to consumer processors will make selling HEDT processors impossible. Also, going with 32 Lanes and 4-Channel Memory means that motherboard and chipset costs will double. So expect the average motherboard cost to be $1000 USD instead of $250 to $500. There is a reason that workstation motherboards cost $1000+.
You have not used Adobe Creative Suite I take it :-) I am running through photos from the R5 (A1 photos are bigger) in Lightroom and that alone is over 30GB of RAM. Add in Premiere, Photoshop, and After Effects with a Chrome browser open and it is easily over 200GB without any VMs running.
@@ServeTheHomeVideo OK, thank you for the explanation. Although I still do not understand where the memory goes. 45 Mpixel photos should take no more than ~150 MB per photo. And even then, why do you need 45 Mpixel in the first place? 4K videos (which seem to be max resolution for RU-vid) is just approx 8 Mpixel. Chrome is known to be a memory gobbler, yes, but that is 'solvable' either by switching to a different browser, or closing some tabs. I run up to 5-6 Java IDEs at once, which each take 2-4 GB, and even then total system memory consumption is no more than 30GB, most often far less.
I do high-end 3D software development and video game development. I can easily use 768GB of memory. My W7-2495X 512GB system gets max'ed out often. I work with real world open world terrain systems thar can easily use the memory. 512GB only gives me a floating-point terrain up to 360km x 360km. I will be upgrading to 2TB as soon as the 256GB DDR5 show up here.
I slow down for these and do not drink coffee before filming (usually at 4:30-6AM.) If you want to increase the speed, RU-vid can increase it via the settings.
Meh its with Intel... there is a board that supports AMD but its old so I think zen 4 zen 3 is not supported ... this would be a killer render/crypto/AI/gaming server (e.g passing through GPUs to multiple VMs at near bare metal performance) if it had AMD support
@@billkillernic Stop talking about things you can't afford and you'll never bother to get. There are also multiple other servers by ASUS on their own website if you bother to research that have everything you want and more, like the ESC8000A-E12. But you can't afford them. So stop complaining.
@@CheapSushi Stop giving advice when your brain is smaller than a lizard's and ask from your mom to put limits on your RU-vid access and pay more attention in school.
Nobody should buy Asus products in 2023. The company is a sad shadow of its former self. Between blowing up AMD CPUs, forced install of their Armory Crate malware, and an overheating ROG Ally SD card slot.. it's all indicative of the trash they've become. Do yourself a favour, invest in better brands.
You mean like the other brands with exploding power supplies, melting power connectors, cases that start on fire, and other similar types of issues? If a person follows any of the tech channels, many of the companies have their issue or two. That is no reason to single out one of the top brands for every product they make that works just fine. If you personally don't like ASUS then don't buy it, but to post such a comment is low resolution thinking.
