How to self-host and hyperscale AI with Nvidia NIM 

I like your magic world magic ( ai code) men

I didn't even watch the video cause I was engaging with the sponsor so much

NO, nvidia is evil

is this a ad?

no thanks

All thanks to CloseAI and other big tech using their GPUs for training dumb AI models that can't even solve a simple mental ability problem, like really, I asked GPT-4o to solve a simple class 9 mental ability problem and it failed, even with options it failed and kept giving the wrong calculations, thus approved that AI is dumb, and non tech people are dumber. Humans, am I right?

At the end of the day it's all about the money: Even for the loser behind fireship.

@@jurycould4275 so? you want him to work for free? lol

​@@jurycould4275 what other thing can equip you with access to resources for staying alive other than money?

What is Nord VPN style?

Such day would in most cases would never come , ai has fascinated a large amount of non coders too and these non coders have become a large part of viewership of such videos even though they basically understand nothing about coding , so channels now have started to talk on ai more and more and they gain more views and they are not wrong who doesn't want more views and more money to buy rtx 6090 , thanks to listening to my yap session which wasted 34 seconds of your life and if you are still reading it wasted 38 secs of your life

I listened to a cutie for 38 seconds

gotta sell those shovels

@@AwindowBest use of 38 sec 🙌

​@@AwindowYeah as if that 44 sec of me writting this reply and reading your comment will make any difference. Lol know your obsoleteness you pleasent bot.

Fr

Yea i lowkey miss the frontend stuff, but the “100 second of X” gave him the platform to be knowledgeable on all things CS. I loved “The Code Report”, its just all there is to report on these days is AI, despite the fact im sure meaningful computer science is still being done in other subfields

Remember when this channel was called Angular Firebase?

market forces

Now it's an informerrcial channel

it'll be a real giveaway when the audio synthesis engine outputs "K 8 S are you shitting me?" in a sexy flirty voice

I'm pretty sure it will be something like "Guys, we need to get rid of that JavaScript garbage."

@@DdDd-pl3nt*immediately rewrites self in holy C*

😂😂😂😂😂

IKR. How is he supposed to give us a good review when he is literally being paid by them? I know this channel is more of a news channel, but still kinda sucks

Guess what? Everything he discussed and showcased in this video still applies to FOSS frameworks like pytorch-rocm. Get that bag, Jeff.

​@@hardikgupta8496When did Fireship ever do reviews of Nvidia products?

@@hardikgupta8496 This is not meant to be a review, he's just explaining how it works. Where did he say he was doing a review?

As does everyone, thats how you actually get paid, this is a LIVING like anything else. Thats kind of the point of trying to become a big youtuber, especially a tech one where a majority probably know what ad block is. He isn't giving you news out of the kindness of his heart cause he is your older brother. He is growing his channel for the sake of getting more deals and sponsors. No one tries to grow their user base to millions as a hobby to continue working a 9-5.

Shovels

hopefully they are wealthy enough to provide good linux gpu drivers :(

Can't wait to see their reaction once the bubble pops

Isn't it obvious? The somehow is by selling the product that you need hundreds or thousands of in order to run an AI efficiently at scale...

@VoidHuskie Didn't people used to say that about Ryzen ten years ago?

Another infiltrator from Dinosaur Enterprises, I see! 🦖🦕

Completely agree, it manages to have more fkn downsides than good sides for society

​@@FriedRice3519 You can say that about most of modern technology though. The internet and its contribution to social media, computers leading to sedentary office jobs, smart phones, tv, video games, military and any mass destruction weapons (nukes come to mind), and the concept of modern finance, banking and money as a whole. We wouldn't have a capitalist system if society as a whole "mattered." Yet everyone is defending that system because they are trying to save their 9-5 jobs from AI instead of having a discussion how we should get politicians who are more open about reducing what the work week looks like thanks to AI. Things don't exist because it's "better for all of society", things exist because there are multiple ruling classes competing with each other for power and AI is the new tech that the ruling class is trying to capitalize on. It doesn't matter if its corporations, or government. OpenAI is funded by the United States DoD now and has a former member of the NSA on board while the Chinese government is pouring billions into AI this year alone. This wont go away and be "expunged" just because people don't like it. No more than the internet and smartphones will be "expunged" cause people are complaining how people these days are glued to their phones.

@@FriedRice3519You sure you're not just downplaying the very real possibility of AI technologies destabilizing the tech industry as we know it? Maybe the downside is that you need to learn more stuff lmao

Probably not, but probably just required a minimum 🙂

Probably AI generated script/talking points. Most LLMs were trained on SEO derived text, so it outputs content like that a lot.

He should've just said it the entire video then. Just one word "H100" repeated over and over again.

@@darkspace5762 he doesnt get the check if the manager doesnt approve it

He said it already! The video is *SPONSORED*

No better bandwagon to jump on than NVIDIA.

Ironically , your comment got stolen by AI , i just saw a bot posted it few minutes ago...

@@user-fr2jc8xb9g lmao, I thought you were joking. I had to look just to confirm...what a world lol

These days that the first key to the kingdom

How is he getting sponsored by Nvidia? He was sponsored by Docker last time?? What's next? He's going to be sponsored by Internet 💀💀💀

@@jiwachhetri7317 next is him sponsoring himself

@@Thewhiteandorange 😂😂

⁠​⁠@@jiwachhetri7317 The European Union 💀

well DUH!

And for 30k that's kind of a steal.

Blade runner style

​@@RottenMuLoT real steal

I would hope that the creators of Nim will sue the shit out of nvidia. Unfortunately I remember when Google stole the name “Go” from another programming language and got away with it :(

Hopefully

Welcome to C

adult site link bot stealing DarrenReidAu comment from 14 minutes ago.

You haven't looked very hard. I'd list links but I'm off the clock

Yes

yes

Yes

yes

we can make it a minute extra for getting excited to checkout the Nvidia crap and see what we are up against. Of course an extra 2 minutes for yelling at Jeff for doing this to us. How could he?

my mand sold his soul to GPUs god.

They manufacturer things. I would hope they have inventory.

@@DoctorMandible They design things

Host the NIM on AWS or Azure, no competition

30k gpu = 6 minute video..

I mean... I wouldn't mind trading my kidney for an h100 👀

It seems like you can use it in the cloud or on your own hardware. In the cloud auto scaling will probably rival the biggest AWS surprise bills. On prem you'll probably need to have enough hardware for it to scale.

Its not meant for individuals, it is an enterprise solution. He is showing it because he got paid. You'll never be able to use this unless you like really expensive side hobbies.

at least $30k in tech parts

my bet is at least 100k

Can't blame him

"Yes."

Let the man make money, and someone might actually find this useful

Let Jeff get that bag. Literally everything in this video can be implemented with completely open stacks. It's no different than SageMaker except that with NIM there are a few less middlemen between you and Jensen's jacket supplier.

​@@GSBarlevthis is true of almost everything Amazon does. Yet they're filthy rich. Open source "tools" existing is NOT THE SAME as a PRODUCT.

Interesting, how much the sentiment is shared..! We all need bread.

Ugly

I do.

Calm down a bit, would ya

Its built directly into docker. There could be alternatives to a service mesh level system like Kubernetes, but there are very few options. Most infact rely on kubernetes. No one wants to make all of those services from scratch.

You don't, this was an enterprise Nvidia ad and Fireship doesn't care about self taught programmers anymore.

Got that backwards-the AGI is _Sam._ Every request sent to the ChatGPT API is answered by Alt-Man personally. He's the ultimate Mechanical Turk.

@@GSBarlev hey I like that chess reference. But really what was Sam thinking when he started working on CloseAI? Really tech is turning into a marketing industry and less of an innovation industry, I wonder what ever happened to innovation? Did he went on a long vacation or something? Or did Sammy boy stabbed him?

This