NUMA NUMA make Raspberry Pi go ZOOMA

Подписаться 743 тыс.

Просмотров 156 тыс.

50% 1

Raspberry Pi 5 gets 10-15% speedup with 100 line Linux kernel patch. And what if we could save 50 megawatt-hours of power annually, just with a software patch for older Pis?
I'll walk through the NUMA Emulation patch that supposedly boosts Pi 5 performance, as well as some other new performance-related developments coming down the pike!
Mentioned in this video:
- Pi 5 NUMA Emulation Patch: lore.kernel.org/lkml/20240625...
- What is NUMA? lse.sourceforge.net/numa/faq/
- x86 Fake Numa for CPUSets: www.kernel.org/doc/html/v5.8/...
- Pi 1, 3 A+, 3 B+ S2Idle patch: lore.kernel.org/dri-devel/202...
- Raspberry Pi 5 A2 Command Queueing thread: forums.raspberrypi.com/viewto...
- My 2019 blog post on A2 microSD cards: www.jeffgeerling.com/blog/201...
- Pi 5 4GB model outperforming 8GB model: github.com/raspberrypi/firmwa...
- Overvolted Pi 5 from jonatron: jonatron.github.io/randomstuf...
- My video on M.2 NVMe on the Pi 5: • SBCs: It's time to dit...
Support me on Patreon: / geerlingguy
Sponsor me on GitHub: github.com/sponsors/geerlingguy
Merch: www.redshirtjeff.com
2nd Channel: / @geerlingengineering
3rd Channel: / @level2jeff
Contents:
00:00 - There's something off about Pi 5
01:27 - NUMA NUMA?
02:27 - The NUMA Emulation patch
04:29 - 50 MW of power savings (ish)
05:35 - microSD: A2 finally faster than A1
07:18 - Some Pis are slower than others
08:29 - Return of the Bloopers

Наука

Опубликовано:

3 авг 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 335

@alexlandherr 23 дня назад

I keep hearing some 20-ish year old pop song when reading “NUMA NUMA”…

@Pc_User_Pro 23 дня назад

Name: Dragostea Din Tei

@jonmarler 23 дня назад

Not gonna lie ... I am just the tiniest bit disappointed that we didn't get a tiny little clip of Jeff re-enacting that viral video clip here somewhere ... ;)

@DoctorX17 23 дня назад

God, has it been that long…

@vel0city96 23 дня назад

MAYA HEEEE, MAYA HOOOO

@roostertechchan 23 дня назад

I had to pause Jeff and find the song :)

@YouCanHasAccount 23 дня назад

Wholeheartedly agree with the kernel maintainer. This should be fixed in the firmware and not with some fake NUMA hack that adds eternal technical debt.

@guiorgy 22 дня назад

Valid point, but the author also pointed out that the feature already exist for x86_64, so he was just extending it to ARM. Seems a bit unfair to not treat them equally. Then again, it could be argued that the x86 part shouldn't have been there to begin with 🤷‍♂️

@s-x5373 22 дня назад

@@guiorgy it exists on x86 for allowing experimenting and virtual machine hacks I believe here it is discussed as a performance patch, it should not be used like that

@bepamungkas 22 дня назад

@guiorgy, that's not what the cited commit do. Said commit define arch specific code (under arm64) and promote them to generic since RISC-V also behaves similarly. I.e one code apply to multiple arch, so it make sense to promote them to generic. The newly introduced patch add new behavior either specific to ARM or Pi (the numa_emulation.* files). But the way it implemented, by directly patching base driver, carry the new behavior to base. So there are now 2 codes, one for generic, and one for Pi, both resides in base. IMO, it will be unfair to moved it into base driver (rahter than make it arch specific or move it outside the kernel) since base have dedicated maintainers that may or may not have the capability to verify the changes.

@dennispadiernos 23 дня назад

My favorite blooper was "Raspberry Cake"

@kevinroosa1315 19 дней назад

It's a slightly wider Raspberry Pi.

@Suidloc 23 дня назад

petition to have these epic oldschool thumbnails from now on.

@marcoroose9973 22 дня назад

NUMA NUMA

@Count_Smackula 23 дня назад

The outtakes make me laugh. Glad I'm not the only one who trips over their words.

@sevendaysin8374 23 дня назад

Please keep the outtakes! Funniest way to end every video =)

@markarca6360 23 дня назад

@@sevendaysin8374 Reminds me of Technology Connections 💡💡💡💡

@Sam-qn4ly 23 дня назад

lol, love the thumbnail. the video should have been uploaded in 240p to really fit the vibe :)

@JeffGeerling 23 дня назад

Heh, and maybe sung throughout!

@blackhole7818 23 дня назад

If You didn't know, your channel had been categorised as a server channel by RU-vid. Now everytime I watch your videos I get recommendations for home server videos. Alongside yours.

@JeffGeerling 23 дня назад

Heh, RU-vid I don't think knows how to categorize things as well as it used to. I watched a video on antenna SWR measurement and now half my feed is ham radio stuff!!!

@markarca6360 23 дня назад

NUMA stands for Non-Uniform Memory Architecture. This was already used in supercomputers.

@YourWaterDispenser 23 дня назад

NUH UH its a parody name form the hit song Dragostea Din Tei

@Brahvim 22 дня назад

_Huh._ I think I was taught that the "A" stood for "Access".

@allenswackhamer5450 21 день назад

Its not new at all. All multi CPU machines have it, so basically any server that is running in a DC right now. numatop etc... are old tools

@wileamyp 20 дней назад

NUMA is particularly important for compute nodes with multiple CPU sockets or multiple GPUs.

@JsemPO12 23 дня назад

I know this is totally irrelevant but yesterday I ate the best orange ever

@joonasfi 20 дней назад

Congrats! How did it feel coming out?

@jasonwnc 21 день назад

Thank you Jeff for bringing back the bloopers! Such a pleasure to watch your videos. I’m sure they are, but I hope the Raspberry Pi Foundation is watching.

@SumGuyzClone 23 дня назад

In one of these bloopers, you need to just roll with it and “skat” to a fake beat. XD

@frankbohnen2347 21 день назад

Every Sunday, I look forward to your videos. Always so informative. Please, more bloopers at the end. It makes it even more joyful to watch and shows how much effort goes into making these videos. THX for creating all this contends.

@Neilhuny 22 дня назад

Absolutely fantastic video! Surely no-one else packs so much information in to such a small footprint. There is a week's worth of testing, playing, checking, reading and (mainly) head scratching in this video. Most of your videos, tbf

@syrus3k 23 дня назад

Sleep states can be super useful if you're doing battery powered Pi stuff!

@foldionepapyrus3441 23 дня назад

At the reported power saving not really, its such a tiny change to an already pretty small idle draw. If they can push it further then it would be great, but right now you get more benefit than reported here just dropping the minimum clock speed, and under volting type fiddling, at least on the Pi's I've played with - more power saving is nice though.

@syrus3k 23 дня назад

@@foldionepapyrus3441 I have personally only played with the sleep stuff on the Pico which is obviously very different but interesting nonetheless

@michaelreed9048 23 дня назад

Happy to see the bloopers back :) Thanks for the continued great content!

@l0pher 23 дня назад

Thanks for the blooper reel again. Love it

@anneallison6402 22 дня назад

Jeff I began watching your videos just before the pandemic and I can tell you after all this years I finally understand everything you say. You are gold!

@greentravels2850 23 дня назад

"NUMA NUMA" 👍 Interesting look into some issues, I'll have to remember these as they get fleshed out.

@mattybbg6850 23 дня назад

A doff of the cap to you and your 100% accurate shirt sir!

@Rushil69420 21 день назад

Loving the thumbnail shuffle. You screaming up at the Pi is easily my favorite one lol

@optical_ideas 23 дня назад

Kinda interesting. And outtakes are always great 😄 i wouldn't mind if you include them every video

@Kitteh.B 18 дней назад

Thumbnail and outtakes made this a fun video. Thanks for the smiles 💜

@Ancipital_ 22 дня назад

Your content just keeps getting better and better.

@nickjohnson410 23 дня назад

Awesome video title. Made me chuckle. Thank you!

@haydenc2742 23 дня назад

Awesome, tweaking the system to make it run faster...always a bonus! Oh man...saving power globally Jeff...gives new meaning of "hack the planet" I really miss the blooper rolls from your video's! Keep em coming!!!!

@aquilafasciata5781 2 дня назад

My Pi 2 has been running 24/7 for the past 4 years as a PiHole server

@gregspeakman9337 22 дня назад

Great vid Jeff. It makes sense of the core speeds.

@RootiferasRetroGameplay 23 дня назад

Ah I'm looking forward to seeing Pi5 overvolt video. There will be smoke!

@JeffGeerling 23 дня назад

Well... hopefully not, but maybe!

@zambonidriver42 23 дня назад

Outtakes! Woohoo! Cracked me up.

@Sierra-Whisky 15 дней назад

The concept of NUMA deserves so much more attention. Some types of workloads can benefit so much from understanding NUMA and using it right. On the other hand NUMA can cause serious performance degradation when done wrong.

@StormWarningMom 21 день назад

Bloopers at the end giving Technology connections vibes (which are awesome btw)

@thomasrolfe8438 22 дня назад

lol that’s the best thumbnail I’ve seen in years

@mikekopack6441 8 дней назад

LOVE the bloopers at the end !!!!

@willboswell_ 23 дня назад

jeff, i appreciate everything you do. ive learned more shit about computers from your channel than from any friend, teacher, or youtuber

@reggiep75 22 дня назад

Glad to see that I'm not the only one looked up that song and the meme mime video too.

@hoyschelsilversteinberg4521 22 дня назад

Your bloopers are so good lol.

@davidpower3102 22 дня назад

The thumbnail is brilliant.

@zeljkanenad 23 дня назад

Very insightful! Thank you

@iestynd100 23 дня назад

being this early is proof im chronically online

@Josstrigaming 23 дня назад

I feel this

@MarcoGPUtuber 23 дня назад

Hit the bell icon to be early every time. Solidify your chronically onlineness.

@djvincon 23 дня назад

Same

@SpaceDoodle2008 23 дня назад

Very descriptive title!

@heighRick 22 дня назад

Thanks Jeff, helps a lot!

@mjmeans7983 22 дня назад

Now that the company has changed, maybe the reason is actually something like this: How do we keep the price from tanking when we have limited production capacity? Fan boys will pay for early access, others will wait. A few months later release improvements to keep it in the news and increase interest to avoid sales drops. If production bottlenecks are eliminated, release all the remaining planned (but secret until then) 'improvements'.

@levieux1137 20 дней назад

My own experience has also been that it's mostly memory accesses that make RPis dog slow. Just try to build anything using "make -j $(nproc)" on it and compare with any other board. It's systematically twice as slow as other boards with comparable CPUs running at same frequency, unless you're running single-core. The worst of it is actually that their DRAM random access times are quite good, but that doesn't suffice.

@AB-Prince 23 дня назад

shoutout to the generation that remembers dragostea din tei.

@Rottinator95 23 дня назад

Love the outtakes 😂

@cognisent_ 15 дней назад

My god, the bloopers are back, hooray! 🎉

@allenellisdewitt 23 дня назад

Numa Numa indeed

@Fataha22 22 дня назад

8:21 I love they just flat out calling out Jeff for the title 🤣

@sysadmin-info 2 дня назад

The end is the best. It happens to me very often. :)

@jakobfindlay4136 23 дня назад

I saw both thumbnails this one is much better

@foobar6846 19 дней назад

NUMA is super important when you deal with multiple sockets (and chiplets) and things like PCIe passthrough in virtual machines. It's bad enough, performance wise, to have to cross between NUMA cores on the same socket, it's brutal when you do it across sockets. Increased latency, limited bandwidth, you name it. I think I agree with the kernel developer, this is something the firmware should deal with, not something you should emulate in the kernel.

@foldionepapyrus3441 23 дня назад

The idle power state is pretty cool, though when you are talking less than 3W draw anyway without it and the saving is so small it hardly matters for most Pi users. Though it is always nice to see more support for low power states it really matters so much more when the system actually has meaningful power draw when idle but not in a low power state. Being able to shed 20 or maybe even over 200 watts on a system with much more and higher power hardware is when the low power states really shine.

@JeffGeerling 23 дня назад

Definitely; I would love to get better idle support (and have software that isn't constantly pinging the Internet (and using CPU cycles) on my AMD workstation... 60W idle!

@supaschwamal 20 дней назад

Love your Dalek poster. I've got it too!

@HurricaneRainbowOG 22 дня назад

your outtakes were funny :)

@PhillipRhodes 23 дня назад

NUMA NUMA. Also, "nanu, nanu!" 😛

@JamesJones-zt2yx 23 дня назад

Numa Numa...and now I need to go listen to a certain song.

@ilovefunnyamv2nd 23 дня назад

I'm sure Jeff is trying to tell us something important, but I can think is: Vrei sa pleci dar nu ma nu ma iei Nu ma nu ma iei, nu ma nu ma nu ma iei

@terrorpup 21 день назад

LOL, I like Jeff how you are trying to hide the camera remote behind the Coffee Mug. That's good to know, thanks for the video. I got my first Raspberry Pi 5 8 Gig a couple of months ago. I kinda one those anger community users, that wasn't happy, well you know. So I figure I give it a tire to see if it's any better, plus I want to update the hardware for my gitlab, that currently still running on RPi 4 x 4. I going to get the Argon V3 and switch from SD to NVMe. Thanks for your videos.

@JeffGeerling 21 день назад

Now you know my teleprompter secret!

@var67 23 дня назад

Geerling: Dutch last name. Brolsma: Dutch last name. KOINKIDINK?!?! I think not.

@RaduRadonys 23 дня назад

Who is Brolsma?

@var67 23 дня назад

@@RaduRadonys Gary Brolsma, internet legend who sang Numa Numa on his webcam.

@RaduRadonys 23 дня назад

@@var67 Thanks, I've never heard of him until now :)

@var67 23 дня назад

@@RaduRadonys No shame in that, it's TWENTY years old now.

@WillVowels 19 дней назад

Pi-a-hee! Pi-a-hoo! Pi-a-ha! Pi-a-haha!

@RalphHightower 20 дней назад

"Intriguing." -- Spock That's interesting and if the code boost makes it to ROM or the kernel. PS: And thank you for not playing that forgettable "Numa Numa" song by that Radar O'Reilly lookalike, otherwise, I would have to Rick-Roll you.

@i_Kruti 20 дней назад

We need more Behind The Scenes........!!!!

@maneeshs3876 22 дня назад

Nice video, now it's clear how much Raspberry Pi software is lagging in hardware optimization.

@punkdigerati 23 дня назад

Each new upgrade felt like an ad segue

@chimichanga5964 23 дня назад

that thumbnail killed me

@JeffGeerling 23 дня назад

@notsonominal 22 дня назад

_Without recompiling the kernel_ ... but then we don't have a reason to put on a fresh t-shirt?!

@pablopoo 23 дня назад

Sometimes you won't compile release versions with all compiler optimization options turned on, or add some features, for stability reasons, but will be cool to have a distro with all bells and whistles turned on, just for fun :)

@JeffGeerling 23 дня назад

Raspberry Pi OC OS

@iXen000 23 дня назад

NUMA NUMA

@benmorris9925 22 дня назад

Would you be able to a video comparison between the on-board audio jack on a raspberry pi 4 vs a USB audio card? I think there is an interesting history there between board versions. Love your content dude 🎉

@scaredyfish 23 дня назад

Pet peeve: you can’t multiply Watts like that. 1 Watt for a year is still 1 Watt, because it’s a unit of energy over time. The unit of energy is Watt hours.

@JeffGeerling 23 дня назад

Should've been 50 MWh (the h is so important there)

@Brickkzz 23 дня назад

DRAGOSTEA DIN TEI!

@karstentopp 21 день назад

You just earned one more subscriber.....

@wolbart 23 дня назад

Great ending! :)

@JeffGeerling 23 дня назад

I don't always do bloopers, but sometimes I do :D

@kevinwhite9919 23 дня назад

idle would be great, as long as any cec trigger can take it out of idle.

@lasersimonjohnson 23 дня назад

We NEED Pi hibernation modes.

@KG4JYS 23 дня назад

lol! I remember using MicroSD cards on orange and raspberry pies. Glad those are a thing of the past.

@jeremybarber2837 23 дня назад

Numa numa!

@aarocka11 23 дня назад

Numa Numa Yay!!!!!

@selbie 21 день назад

Bold of you to summon the ancient lore. I would downvote but I'm stunlocked with +10 Emotional Damage from finding out Numa has reached the 20 year mark.

@JeffGeerling 21 день назад

Half a lifetime ago... :O

@gipilot1 16 дней назад

NUMA NUMA! *Quick Dance Break* I would love to see, if these patches would affect the non-pi SBCs with the same performance and power efficiency improvements.

@JohnSmithYoutube 23 дня назад

Ooh first! I've been into Rasperry Pi for a while but the only NUMA I've ever heard of isn't computing related 😂 Love your videos, Jeff

@trmazi 22 дня назад

NUMA NUMA!

@iam.jasonhoward 23 дня назад

💯

@coolergappney1943 22 дня назад

The numa numa guy recently re- made his video from way back

@ZupaMolo 21 день назад

AHA GREAT BLOOPERS

@untoldtitan 23 дня назад

Numa Numa ftw

@caspianmaclean8122 22 дня назад

Idle power saving could help battery life on pi-based handheld consoles.

@SP-ny1fk 23 дня назад

Numa numa eh numa numa numa eh

@owenness6146 23 дня назад

Numa Numa

@timvanrooyen 22 дня назад

oh there’s a mouse behind the cup

@mikk150 22 дня назад

Numa Numa yei

@alexanderwingeskog758 23 дня назад

Wow the sleep state thing, just bought another Pi Zero 2 W that I have connected to a small battery (7.2 AH) and 30W smallish solar panel (with charger) to see if it (I don't have that much sun where I live) could "run" forever :-) and that would be awesome with even less power if not doing much work... But then again, I was thinking of making do something that will probably not let it into any kind of power saving mode anyway...

@JeffGeerling 23 дня назад

Yeah a lot of times the sleep states are less useful for use cases where you would use a Pi-but still nice to have available nonetheless. I've started using Picos in some places where I used to use Pis, and even there, I think it would be nice to have better 'sleep'/idle support.

@michaelweichhardt 14 дней назад

Giga Flaps

@MarcoGPUtuber 23 дня назад

Numa Numa? Is this the advent of Dragostea Din Geerling?

@Daily_Bugler 23 дня назад

Haha you viewed The Register website… Thats Jiffy on a watch list…

@AmeOFF 23 дня назад

lol the thumbnail

@Ironic-Social-Phobia 23 дня назад

The outro needs the TC background music...

@JeffGeerling 23 дня назад

Haha, I always hear it in my head while I'm editing that bit.

@miarosa 23 дня назад

"numa numa" as asked in the video

@KernelFault 23 дня назад

A red light next to your camera that turns on with the HVAC might be helpful.

@JeffGeerling 23 дня назад

I actually have most of it in Home Assistant, I just haven't had the time to wire up an automation for 'recording' that works for me. I can't just trigger it on the studio lights because sometimes I have those on when I'm not recording a video. And I'm still working on better automation for my recording / saving video files off the camera.

@michaelcummings7246 23 дня назад

@@JeffGeerlinganother thing to keep in mind is at least 90% of your viewers are in rooms with fans etc or other places with more than 40dB background noise and wouldn't even notice it as much as you do during editing 😉

@JeffGeerling 23 дня назад

@@michaelcummings7246 Heh, true-but the rumble is annoying because of the frequency, and my HVAC unit also seems to not play nice with AI noise removal, making for some weird audio if I try removing it in post. Easier to just not have it going!