Testing New Xeon CPUs for New Servers! 

Every time you tinker with servers I rethink my setup. Then I remember that I live in an apartment and the noise would drive me mad. I'll live my server tinkering vicariously through you.

RTX voice sounded slightly booty for the first couple cuts, still impressive how much of that server noise it cut out.

It sounds like there is a popping noise after you turned on rtx voice

I love vids on the Xeons. About a year ago I went with a E5-2690 and paired it with an Intel DX79 motherboard. Very capable chips for how old they are...

But honey, with more servers, I break less stuff you use.

@14:30 When you said Anecdotal evidence... For our big IT customers running VDI, we recommend modern chips with at LEAST 2.5 Ghz because of user experience. 3.0 Ghz and higher being even better. So yeah, you do notice clock speed changes like this at the desktop.

I was really disappointed when it faded back from black after the intro and Jeff wasn't a slicktop!

I like how you're making really good use of RTX Voice in these server videos. Even if there's a tiny bit of artifacting, it's great.

first vid of your's to pop up in my suggestions less than a day after it was uploaded. you deserve more subs. you make things very entertaining, dawg

Just bought a pair of e5 2660 v3’s 10 core 20 thread at 2.6ghz and a 3.3ghz boost I’m very excited!!!!

If you're looking for something a bit newer, I highly recommend getting into v3 haswell xeon e5s, some of them are dropping heavily in price, and ddr4 and 2011v3 motherboards are getting cheaper.

I love your Intel Bunnymens :D

As usual, great video thanks Jeff. The Sierra Nevada seasonal sounds awesome. I made a Coopers Hazy IPA clone in November and tapped the key just last Wednesday... Sensational. Possibly the best extract kit and closest clone recipe I've ever done. So good I've done a second batch over the weekend because the first key won't last that long!! I wish I could get those same eBay prices you see here in Aus!!

Good choice on the Supermicro X9 range. Very much a bang for buck platform. I went for an X9dr3. CPU wise I got 2x E5-2690 v2. Means for my home lab with vmware has 40 cores and 96g memory and not at the prices you'd expect. I went BargainHardware who did deals to beat ebay prices.

Love rtx voice thing is a masterpiece for video game voice chat while u have a fan running

Fascinating content, I'd love to see more on this CPU

Put a coaster under your beer!!!! THAT TABLES SO NICE!!!

The X56xx CPUs are Westmere-EP, not Nehalem. Also, for reference, I have a pair of E5-2670v2 (115 W, 2.5/3.3 GHz, 10C/20T), with 1600 MT/s RAM I have in CB20: 239 single- and 5252 multicore, and in CB15 108 single and 2438 multicore. These CPUs go for around $50-55.

For your problem with the single threaded minecraft server their is a forge mod called MCMT its works just fine with other mods and all kinds of weird loads (mostly so make backups!). I tried it on my 24 thread machine and it works! I saw a huge tps boost and even with 8k mobs it was still 20tps with 60% cpu usage. In short it makes your minecraft server do fancy multithreading stuff...

Gave a like straight away! hope you and your family stay safe during covid!

Great video as usual. I get to live vicariously through you and not make my wife shut down my eBay account...

I really enjoyed this video! I was really struggling picking a cpu. Thank you

Nice timing. Yesterday I put two E5-2650LV2 10c/20t into one of my Proxmox servers to up the cores (12 to 20) and reduce the power (95W to 70W). Cheers!

I went from dual e5-2670v0 to quad e7-8880v2. I did all the same on paper comparisons, but for my actual work loads (rendering/encoding) I seemingly went DOWN in performance. So... to ebay I went and got a quadro m2000 and with that I got the gains I was looking for. Also, experienced the same conditions with memory, went from 1600 to 1866. Love the videos! Need more homelab stuffs!

Keep doing this server stuff. Your guac set up video was great, not only do I use it at home, I set it up at my dad's workplace and my workplace to allow devs to work on systems at work from home cause covid. 👍

The advantage of these old xeons is not clockspeed but price, RAM capacity support and Registered ECC support. Also you get a lot of PCI-e lanes and cache.

I'm not really surprised at this result, since you're getting about a 10% IPC uplift from Sandy to Ivy added to the increased clock speed.

I was actually very disappointed when you cut away with the shaver but cut back in with your hair intact...

I, personally, like the E5-2590 v2 - 10 Cores/20 Threads Base Frequency 3.0 GHz Boost Frequency 3.6 GHz TDP 130 Watts.

CPU wattage draw is dependent on the workload as well as frequency and load. Recently I was benching my 3950x, and in cinebench R20/R23 I would see a max of 145-150 amps in spikes, 135ish amps continuous over a run. Switching to prime95, one of its workloads could push the CPU to a continuous 165amps. If you watch your monitoring program as prime runs the self test mode, you can see it switch between the various workloads based on the power consumption/CPU freq/CPU temp. Try Prime if you want to see those CPUs hit 130W in HWinfo. In my testing, my highest power draw was at 4Ghz all core whereas one of the lighter prime95 workloads would run at 4.2 all core, but pull half the power draw (~80amps), while still registering as 100% CPU use.

Excellent taste in shirts, I see.

I rebuilt my server/desktop (back in 2016) with a Xeon E5-2658 V3 (12C/24T). It's been a great CPU!!!! Runs cool and will run 24/7 under heavy load with no problems. Under load (using a 212 EVO), the CPU never goes over 60C. At the time, I paid $170 for it. This was before Ryzen came online. So.... This E5 was a great upgrade to get I7 performance for AMD pricing.

Maybe this is helpful for you. Im currently running a 2x e5 2690 workstation and the cpus draw at max 135w each, which is exactly what intels sais is there tdp. This workstation previously used 2x 2620, which with their 90w power draw matched there tdp perfectly. A funny thing i found out though is that in another server i messed with, which had 2x 2628l v2, the cpus never reached their tdp of 70w, running a max of somewhere ~ 40W, remind you these are v2 so ivy bridge, while still holding their boost clock consistently. I then installed 2 2637v2s just out of curiosity. These apparently have a rated tdp of 130W (i should mention those are 4c 8t cpus), but again zhe max power draw i saw in hwmonitor was something like 91.something. So yet again way lower than the tdp while holding their clocks. It was then when i looked at these cpus in particular when i found the die is pretty much the same as it is in the i7 3770, both having same core/threadcount and nearly identical clockspeeds, et voila also nearly identical power output in cinebench, 95w that is, just what intel sais the tdp of the 3770 would be. So it seams like while the tdp of the sandy bridge xeons match their real power draw, things look a lot different for their ivy bridge models, having power draws much lower than their tdp. I guess it was done to let their newer cpus be placed in the same power categories as their previous v1 chips. Long story short, i think your v2 chips do exactly what their supposed to do, its just their tdp that is set too high:) Hope i could help someone with my little story 😂

"what happens in the holodeck stays in the holodeck" , Professor Moriarty 2421AD

1. The i7-7820X is a Skylake-X CPU, not a Kaby Lake-X one. 2. Cinebench R15 doesn't use AVX. 3. The E5-2650 does turbo up to 2.8 GHz, just look at its Intel ARK page.

Great build!

I'm actually going to be building my first home server soon. I picked up a dual-socket LGA2011-3 board from Asus and one E5-2698 v4 with 64GB of ECC registered RAM. I wanted the opportunity to upgrade in the future by adding a second processor, RAM and cooler. In the end, though, I've spent more than I needed to just to avoid the associated noise and cumbersome form factor of an existing decommissioned server. Moral of my story thus far: if you have the space for a rack and you need server-grade equipment, just buy a rack and some decommissioned servers. It's so much easier and foolproof. Also, when picking out the intel chips you want, don't forget to pull up the Wikipedia List of Xeon Processors, since the tables in the page include helpful information like core turbo state configurations, which can be incredibly impactful when the chips run too hot or just have too many cores to maintain an all-core max turbo. Something to note: the Wikipedia tables do not make a distinguishing indication between the v0 and v1 revisions of these processors, so it can be a bit confusing, and detrimental to your plans, as they are on different sockets and chipsets. easiest way to remember is that v0 was on LGA1567 and even the best processors are cheap as hell because the motherboards don't fit in anything, and the v1 is the first generation on LGA2011.

Hey Jeff ,long time follower of the channel, first post. I have an HP z620 workstation with a couple e5-2696v2 @2.5ghz base, 3Ghz all core boost (12C/24T 30MB L3 each) , and 128GB DDR3 1866, and the performance is stellar. while is not a 1RU server, it's quite silent (bedroom silent), allows huge expansion internally and they are dirt cheap. Just shy of a 1950X Threadripper performance in Cinebench R23 (15162pts for my couple e5-2696v2s) Speaking of value CPU probably the E5-2650v2 is better bang than the v1 or the E5-4627 v2, normally faster DRAM clocks too.

Was I the only one that thought that after the intro he would be bald 😂

Give this man views and likes to help him justify his Ebay and Servers lol

I haven't cut my hair since March. I feel personally attacked. :P

As an impoverished gamer I'm running a E5-1650V2 in my 'gaming' PC. It's an old HP Z420 and I keep lusting at higher core counts but my current CPU is the sweet spot between core count and single thread (4.1Ghz). On R15 multi thread it's cpu score is 1093 and it's single thread is 144. I've shoehorned an EVGA GTX1080ti FTW3 into the case and its just enough to play all my games but I've just downloaded Control and it's going to be interesting to see if the power supply melts.

Wouldn't the E5-2689/2690 (3.3Ghz all core turbo, 115W | 38USD shipped) or E5-2650 v2 (3.1Ghz all core turbo, 95W | 34USD shipped) be better?

I've got that problem with eBay at the moment too. Want to turn my current tower server into a rackmount for my new rack, so looking at chassis. Had to use all the willpower at my disposal to not buy the 3x IBM x3550 m3's with dual x5650s and 64GB RAM for AUD$120 each, shipped, that popped up the other day. To use as a lab.

This channel seems to know exactly what I want... x79 and 2011 socket content galore. I also still dream of the ultimate 2011 chip, and spent way too much time browsing the Intel Ark and then checking prices on eBay. It's almost an addiction (I'll never admit!)... and your videos certainly aren't helping lol. I would LOVE to see a render farm setup using these old sandy/ivy bridge processors. (This also means you'd get to buy more servers?!) Also, your beer choices have been on point. Sierra Nevada definitely knows what they're doing.

For single-threaded load performance on 2011 v1/v2 socket servers I use the E5-2637v2. It turbos to 3.8Ghz, has 130W tdp, 4C/8T, and go about $35-40 the last time I bought them on ebay.

I really think a good way to go for a virtualised environment where single thread performance is important would be the 2650 v2. Its 8 cores and 16 threads with a 2.6ghz base clock. At a little under double the price and the same power draw as the v1, I think its a good way to go

For like €90 (per cpu) you can get the 2697v2 btw, a nice little 12 core

I never knew E5 4600 works on 2600 platform :) My workstation is an E5 2690 V2 awesome cpu! And my server is 2x E5 2650L V2 :)

Yay! Finally a beer I can actually purchase here in Sweden. Had one of those around Christmas. It is a-OK! 👍🍺

As someone with servers and switches in my bedroom I would prefer raw audio rather than the crackle from RTX Voice. But, it does a good job most of the time.

Been wondering how to get past the Sandy-Bridge level without breaking the bank (in other words, the dreaded wifey veto), hadn't thought to look at the 4-socket SKUs... nice find. With all the CPU architecture-level flaws out there now, you might actually be more secure without hyper-threading anyway, heh.

I have a 6800K that will pull 128W max at 4.0 GHz under full non-AVX load. The TDP is 140W. Right now I'm pondering setting the long duration limit to 65W because it's now in a NAS.

A render build would be cool to see with those

Show your wife the cost of a new Dell server vs the nice used Supermicro affordable ones you are buying :)

Maybe try out those 4 way Xeons in a 4 way xeon setup :-)

Is that a beer in the video? Damn dude...

i really like using X5675 cpu's in my dell poweredge r610 and r710 servers, there so powerful for 95W cpu's.

I do use 2x E5-2667 v2 which can boost to 4GHz while still having hyperthreading. Thats the best of both worlds for me personally. That includes a fat load of RAM aswell from a lucky ebay buy of 16x 16G DDR3 RDIMMs from someone from my country (means smaller bullsh* chance)

Hey Jeff. What is the name of the jazz group that plays in your videos? Each video you produced with the jazz group is quite relaxing.

You need a pair of Kill-o-watt meters then run both test machines over a given timed task. Could the Power supply be the choke point for the extra watts?

I ended up using dual E5-2696 V2 CPUs. They're 12-core 24-thread each. All core turbo is 3.0 GHz, single core a bit higher. 120W TDP. They're the same specs as E5-2697 V2 except 100MHz lower frequencies and cheaper. **Make sure your motherboard is compatible. All ASUS boards are. Other vendors I'm not sure

My biggest problem with these old servers is that I have expensive electricity, a 100w constant load costs me about 150$ a year, so something like a 1st or 2nd gen ryzen is much more attractive (or was before the cpu supply shortage), even though I lose out on cheap (and ecc) memeory and compact server chassis.

Please turn down the gain on your microphone, you're clipping and it's causing RTX Voice to introduce popping and crackling when clipping. Turn the gain down whilst recording and then up the volume in post if you need it louder (so long as it doesn't clip in post)! Great video otherwise!

Great video. I think I missed the model number of the motherboard. I noticed you don't take any anti-static precautions and happily touch the connection pads on the CPUs etc. Obviously this never rcaused a problem for you.

i going back in the holodeck where everything works lolz great video

Have you had a look at the Xeon E5-2696 v2 CPUs? 12 cores and 24 threads for not much more money.

WIndows is the mafia, you don't have to update but if you don't choose so either it will happen anyway or random things are just randomly not going to work.

I would like to see comparison of low power, normal and high TDP chips as you suggested. Because even I'm confused on numbers that you shown...

Using an E5-2620 V2 should be an option 2.1 GHz base clock, 95W TDP and also about 20 Dollars on eBay. Its an alternative to the E5-2650

I grabbed one of those chenbro servers you featured previously and noticed these while I was looking at the chenbro's. Went through the same process checking to see what CPU's should work and was wondering if the 4 series would actually work since multiproc can be a bit wonky depending on the motherboard OEM. Good to know they do work but I don't really need another server since I already have a v3 machine that will be my vm box. I really dont need another server... But so cheap! You might want to start looking into v3 machines for anything heavy on the processor, prices are really low on the lower end and even the 2678 v3 is a good little CPU for ~$100ish

I got a pair of E5-2680v2 cpus for my R720 that I do all my goofing around with. Got a good deal on them and I think they will last me the usable life of the server.

The issue with server power draw is as much CPU as it is RAM. ECC registered and buffered RAM runs very hot and sucks a lot power. On my server, I had to put a temperature cap on the. RAM because it would overheat during intense workloads.

I run Xeon E5-2660 v3 @ 2.60GHz for my nas. Not a bad chip.

I was rocking a E5 1650 v3 Which is great in an HP Z440... I decide with black Friday and some cheap ram to buy a Asrock b550 motherboard and get a ryzen 4700g with integrated GPU Thanks to that I got 8 cores 16 threads and 128gb of ram with 126gb for the system. In total it was a little spendy with the total system costing 805 USD for the ryzen, the Z440 was 600 with 64 gb of ram and all the parts I used for it. The insane part is the ryzen full system load from the wall is about 58 watts... The z440 just on was about 300 watts and full load was almost 400 watts... The Ryzen system also runs about 2x the speed of the z440 system in multi threaded loads and about 1.5x in single threaded all while only using about 5-15% the power! It is great... Personally I would love 3 other systems and to setup Proxmox cluster along with a mass storage server... I don't think my wife would let me spend another 3k on that though plus the server rack and then I would have to build a server closet... oh well I can dream. One last thing. Where I live the power cost is about .25 per KWH so it was 64.05 USD a month for the Z440 and the ryzen system is 7.14 USD that saves me 682.96 a year !

I've been going between a pair of E5-4655 v3 QS (135w TDP) and E5-2630L v3 (55W TDP) CPUs in my Dell R730 running Proxmox. WIth the Proxmox CPU governor set to powersave, my idle power consumption (with a few VMs running, under 10% CPU load) between the two solutions is about 10 watts. That's also with the RAM running slightly faster on the 4655 v3 CPUs (2133 vs 1800MHz). Under heavier loads of course the power consumption increases, but as for general 24/7 relatively idle loads there's nowhere near as much of a difference as you might expect.

Sausage fingers ftw! btw, during your ad, you can clearly see long it took you to film that part. (The cinebench is a giveaway)

the 4627 almost seems like its some weird workstation chip. like some org really wanted the fastest 16/16 they could get given it doesn't have the highest speed I doubt High frequency trading

My 2x E5 2689 (v1) also throttle back from 130 to 100W after a few seconds on Supermicro X9DRI-LN4F+. Despite +2 C on the balcony, with -20 C outside. I guess thats just normal for these high TDP cpus.

Running 2667 v2's on my home servers, they're awesome. Most especially for the single threaded as I also have a minecraft server.

omg save your marriage, you can buy server but you cant buy wife 😂

I was about to say 'why not 2560L" you only lose 200mhz off the base clock for a 70w TDP, but then you said 'minecraft' I've been using L5640s in my file servers, and then x5675-x5690 in my non-file servers that need frequency. Recently replaced the dual x5690 server with a single 3700x(yes i know R710 doesnt officially support X5690, but it seemed to work fine for 3 years after upgrading from E5649) Thank you Ryzen for unofficial ECC support, but I wont be replacing my file server till AM5-DDR5 and true ECC uDIMM support. Taking that dual x5690 server offline reduced my idle power draw from my UPS by about 430w, but that probably also has to do with the fans. Oddly, the dual x5690 seemed to struggle with many OTA TV recordings with all 12 cores hitting and staying at their boost frequency of 3.6ghz, where as the 3700x, runs fine at 2.2ghz i'd almost call them idle under the same work load. Pretty amazing considering that neither computer had a video card(usb video out) Due to the fact that, currently, the 3700x is more than powerful enough at 2.2ghz, the 'under load' power draw of this server is less than 100w, though there are no spinning drives like in the R710(725w) I do have an all flash 16 drive portable file server that i use for keeping off site backup up to date (MATX case with carry handle) that machine is using a Ryzen 5 Pro 4650G and ECC, that processor was hard to get ahold of, but i finally got it for only $260. If i run into less issues than my primary over the next several months, i might just swap their roles till i can build a replacement for my old dell C2100, though, i'll still use the portable server to sync between local and off site.

Tge wife's E5-2690 sits down at 1.73ghz when its idle (DX79SI mobo from Intel). And bounces around 3.8 when its working. According to task manager. I like it. Barely does anything until you need it. Lol, I want one.

the 7820x is Skylake-X

Love your sarcastic remarks and ofcourse your work. Big fan sir. Love from India. It's always great to see fellow senior geeks tinkering with servers. Regards. 😊

Do you think that the missing single-threaded performance might be due to some NUMA configuration? I can only suspect that the thread is on the core of one CPU, but the memory allocation is in the RAM of the other CPU.

It would seem that using a non-windows OS would lead to more consistent benchmarking. At least it wouldn't be installing updates in the middle of your work.

I'm determined to use my server in part as a VR system along with streaming throughout my house I've made mine fairly quiet. I'm using a pair of 5690s as they are the most threads with the highest frequency just need a new riser and better cabling to run a full sized gpu like my Radeon 7 that I've retired from my main rig with a 3070.

Can you please do an updated video on mineos for truenas in 2021? Thanx.

bro, you are saying linode wrong, the right way is LINOOOOOOODE

Would be nice to see a budget ryzen 3600 build with ecc ram as well

Why don`t you set the power settings on High performance in Windows before you started cinebench?

Right now, I don't see the point of buying Xeons V0 or V2, having V3s at bargain prices, unless you want to take advantage of those old specific servers. I Bought 2x Xeons 2678 V3, a Huananzhi T8D, and with a little of undervolting and turbo unlock, I'm getting in Cinebench r20 7706 points in multicore and 261 single core. I just paid 78€ for each Xeon. It is performing in multicore really close to a Ryzen 3950X for 540€: - Huananzhi T8D = 144€ - Xeons = 78*2= 156€ - 128Gb DDR3 1866mhz ECC Memory = 240€

Yay!!! More Clustering with Proxmox! Still trying to buy a house so i can get some room to set up some more servers to i can play with proxmox clustering

Great info as usual. Are we any closer to the (not really) dual X99 review yet?

You could have just buy 2650v2. They're great and dirt cheap on Aliexpress (not on ebay, ebay prices are too expensive)

Check out the new Segway King! Smooth :) Also great video etc, I totally don't need a server, but i REALLY want to build one and get it working just because..... Maybe ill stat with a simple NAS....

Just a thought but the way intel binned their cpus they averaged 130w but may not be the rule to all of the cpus sometimes cpus do much better and sometimes they do worse, so it is possible that you got an excellent cpu in that it performs at ~105 watt what a normal one would perform at 130, by this same standard I am unfamiliar with their other cpus in the same line but it is possible they were designed for the next step up but ended being binned down to the 4627 which would indicate they perform better than average 4627s but worse than what they were initially designed for. As well could just be something else limiting power after this is not my forte so to speak. Great video awesome content!

LGA2011 is still great value. I think V3 currently offer the best price/value, especially with the remake boards from AliExpress

I still think e5-2680v2 is sweet spot 1400/128 cinebench r15 (full turbo unlocked). Idle temps are in 30C using noctua dl14.