How to self-host and hyperscale AI with Nvidia NIM
ฝัง
- เผยแพร่เมื่อ 7 ต.ค. 2024
- Try out Nvidia NIM in the free playground nvda.ws/4avifod
Learn how to build a futuristic workforce of AI agents, then self-host and scale them for any workload thanks to Nvidia NIM - a platform that containerizes AI models and runs them on any GPU with Kubernetes.
#programming #ai #nvidia
💬 Chat with Me on Discord
/ discord
🔗 Resources
Nvidia NIM nvda.ws/4avifod
CUDA in 100 Seconds • Nvidia CUDA in 100 Sec...
Docker 101 • 100+ Docker Concepts y...
🔥 Get More Content - Upgrade to PRO
Upgrade at fireship.io/pro
Use code YT25 for 25% off PRO access
🎨 My Editor Settings
Atom One Dark
vscode-icons
Fira Code Font
🔖 Topics Covered
How to scale AI models
How to self-host an AI model
Nvidia H100 GPU
Will AI replace humans in the workforce?
Try all the NIMs for free right now in the playground nvda.ws/4avifod
I like your magic world magic ( ai code) men
I didn't even watch the video cause I was engaging with the sponsor so much
NO, nvidia is evil
is this a ad?
no thanks
And here we are, Nvidia trying its best to take the whole monopoly doing it Nord VPN style
All thanks to CloseAI and other big tech using their GPUs for training dumb AI models that can't even solve a simple mental ability problem, like really, I asked GPT-4o to solve a simple class 9 mental ability problem and it failed, even with options it failed and kept giving the wrong calculations, thus approved that AI is dumb, and non tech people are dumber. Humans, am I right?
At the end of the day it's all about the money: Even for the loser behind fireship.
@@jurycould4275 so? you want him to work for free? lol
@@jurycould4275 what other thing can equip you with access to resources for staying alive other than money?
What is Nord VPN style?
Fireship just casually switched from Web Dev channel to AI channel
I think his account is now being run by a sentient AI
Fr
Yea i lowkey miss the frontend stuff, but the “100 second of X” gave him the platform to be knowledgeable on all things CS. I loved “The Code Report”, its just all there is to report on these days is AI, despite the fact im sure meaningful computer science is still being done in other subfields
Remember when this channel was called Angular Firebase?
market forces
Now it's an informerrcial channel
Pretty sure the first words out of AGI will be "Kubernetes? Are you shitting me?"
it'll be a real giveaway when the audio synthesis engine outputs "K 8 S are you shitting me?" in a sexy flirty voice
I'm pretty sure it will be something like "Guys, we need to get rid of that JavaScript garbage."
@@DdDd-pl3nt*immediately rewrites self in holy C*
😂😂😂😂😂
Selling shovels never looked this lucrative!
It's ok guys, this is AI Jeff. The real Jeff is hanging out with Jensen on the beach
No better bandwagon to jump on than NVIDIA.
Ironically , your comment got stolen by AI , i just saw a bot posted it few minutes ago...
@@AfifFarhati lmao, I thought you were joking. I had to look just to confirm...what a world lol
me 6 minutes ago: Oh a Fireship video great!
Me now: AI is a disease on this planet and must be expunged, also I just watched a 6 minute ad.
Another infiltrator from Dinosaur Enterprises, I see! 🦖🦕
Completely agree, it manages to have more fkn downsides than good sides for society
@@FriedRice3519 You can say that about most of modern technology though. The internet and its contribution to social media, computers leading to sedentary office jobs, smart phones, tv, video games, military and any mass destruction weapons (nukes come to mind), and the concept of modern finance, banking and money as a whole. We wouldn't have a capitalist system if society as a whole "mattered." Yet everyone is defending that system because they are trying to save their 9-5 jobs from AI instead of having a discussion how we should get politicians who are more open about reducing what the work week looks like thanks to AI. Things don't exist because it's "better for all of society", things exist because there are multiple ruling classes competing with each other for power and AI is the new tech that the ruling class is trying to capitalize on. It doesn't matter if its corporations, or government. OpenAI is funded by the United States DoD now and has a former member of the NSA on board while the Chinese government is pouring billions into AI this year alone. This wont go away and be "expunged" just because people don't like it. No more than the internet and smartphones will be "expunged" cause people are complaining how people these days are glued to their phones.
@@FriedRice3519You sure you're not just downplaying the very real possibility of AI technologies destabilizing the tech industry as we know it? Maybe the downside is that you need to learn more stuff lmao
I still cant belive that Nvidia somehow became the wealthiest company in the world.
Shovels
hopefully they are wealthy enough to provide good linux gpu drivers :(
Can't wait to see their reaction once the bubble pops
Isn't it obvious? The somehow is by selling the product that you need hundreds or thousands of in order to run an AI efficiently at scale...
@VoidHuskie
Didn't people used to say that about Ryzen ten years ago?
Day 0 for not talking about ai
Such day would in most cases would never come , ai has fascinated a large amount of non coders too and these non coders have become a large part of viewership of such videos even though they basically understand nothing about coding , so channels now have started to talk on ai more and more and they gain more views and they are not wrong who doesn't want more views and more money to buy rtx 6090 , thanks to listening to my yap session which wasted 34 seconds of your life and if you are still reading it wasted 38 secs of your life
I listened to a cutie for 38 seconds
gotta sell those shovels
@@AwindowBest use of 38 sec 🙌
@@AwindowYeah as if that 44 sec of me writting this reply and reading your comment will make any difference. Lol know your obsoleteness you pleasent bot.
sponsored by nvidia? this man both made it and lost his soul
IKR. How is he supposed to give us a good review when he is literally being paid by them? I know this channel is more of a news channel, but still kinda sucks
Guess what? Everything he discussed and showcased in this video still applies to FOSS frameworks like pytorch-rocm.
Get that bag, Jeff.
@@hardikgupta8496When did Fireship ever do reviews of Nvidia products?
@@hardikgupta8496 This is not meant to be a review, he's just explaining how it works. Where did he say he was doing a review?
As does everyone, thats how you actually get paid, this is a LIVING like anything else. Thats kind of the point of trying to become a big youtuber, especially a tech one where a majority probably know what ad block is. He isn't giving you news out of the kindness of his heart cause he is your older brother. He is growing his channel for the sake of getting more deals and sponsors. No one tries to grow their user base to millions as a hobby to continue working a 9-5.
Fireship is big now, it's even doing 6 minute ads.
Sponsored by Nvidia, good for you bro get that bag.
These days that the first key to the kingdom
How is he getting sponsored by Nvidia? He was sponsored by Docker last time?? What's next? He's going to be sponsored by Internet 💀💀💀
@@jiwachhetri7317 next is him sponsoring himself
@@Thewhiteandorange 😂😂
@@jiwachhetri7317 The European Union 💀
Guys, i think that AI killed Jeff and now runs this channel.
well DUH!
Did NVIDIA pay you per mention of the "H100"?
Probably not, but probably just required a minimum 🙂
He should've just said it the entire video then. Just one word "H100" repeated over and over again.
@@darkspace5762 he doesnt get the check if the manager doesnt approve it
He said it already! The video is *SPONSORED*
finally i can host my own custom ai girlfriend
And for 30k that's kind of a steal.
Blade runner style
@@RottenMuLoT real steal
now nvidia is gonna eat all the search results for my favorite programming language
I would hope that the creators of Nim will sue the shit out of nvidia. Unfortunately I remember when Google stole the name “Go” from another programming language and got away with it :(
Hopefully
Welcome to C
That studering got me 😂😂😂
Discharge the old patient: Web dev
Admit the new old patient: AI
The Nim (formerly nimrod) language team now bites their ass so hard that they didn't protect the acronym.
Finally nvidia bought fireship before NIM could replaced him
"[Most people] underestimate what they can do in ten years."
Fusion power startups: *Allow us to introduce ourselves*
"don't worry, this tool that can make all human workers obsolete won't make you obsolete. It's about augmentation not replacement"
"This video is sponsored by Nvidia and they didn't just tell me to say that"
It will create new jobs that the AI which is created to replace all jobs won't be able to do, of course! Tired of hearing the same old lie every time tbh.
You know you like a channel, when you first like the video and then start watching.
And then unlike the video, when you realized what the video was about.
@@andrevvv Or liked it again because you want to not make the AI overlords angry.
I wonder how YT weighs like and dislikes at different quarters of the video... Or even more fine grained like first 15 seconds...
Well that's nothing to be proud of.
fireship:
fireship AI channel :
my mand sold his soul to GPUs god.
Super cool, congrats on the sponsorship!
Your videos are works of art. Concepts, Wording, Jokes, Knowledge, Memes, just everything incredibly on point.
Can't believe i just watched a 6 minute ad. Bravo Vincent!!
This is better than some ads you've done. The real difference in non-sponsored videos is that the jokes are relentless and borderline NSFW. In sponsored content, it's like using your library-voice when at XMAS dinner with your partner's family. Thanks for all the videos!
"AGI is highly speculative and a dumb image of the future"
**proceeds to propose a slightly less speculative, slightly less dumb image of the future**
Humans will always be preferred over AI, I know this breaks your heart as a programmer, but that's just the truth of it. God made us, we made AI, it's a pretty simple concept to grasp.
I mean. It's definitely the funniest ad I've seen today. Well done!
Skip this video, unless you want to watch a 6:43 minute NVIDIA ad?
I do.
Calm down a bit, would ya
The subtlety of the voice stutter to continue the joke that he is an AI is 🤌🏻
I have yet to see anything LLM related that will replace something like a Lawyer, a Programmer or a Doctor. At best they will be helpful tools to MAYBE boost their productivity in specific scenarios.
You haven't looked very hard. I'd list links but I'm off the clock
Firesip more like Sponsorship🤑🤑🤑
6 minutes ad...
Yes
yes
Yes
yes
we can make it a minute extra for getting excited to checkout the Nvidia crap and see what we are up against. Of course an extra 2 minutes for yelling at Jeff for doing this to us. How could he?
Congratulations on the NVDA sponsorship! 🎉
Fireship: what's the best js library?
LLaMA: React
Meta: 😅
Nvidia sponsoring you... Damn!!! Congratulations buddy
The video was interesting but the comments about the sponsored content was fascinating too.
my man sold his soul for gpus
30k gpu = 6 minute video..
I mean... I wouldn't mind trading my kidney for an h100 👀
Recently i "somehow" got access to H100 GPU, Nvidia is a sponsor of today video. 😁
You were the chosen one, destroy the sith not join them. You were my brother Jeff I loved you
Good work getting a sponsor from them while throwing shade at the same time, it’s a fine line but you did it well 👏. I would have blown it with prompts like “Nvidia.. generate me.. a bag” 😂
So the adult site link bot stole your comment and got all the likes.
@@mc1993lol good catch, they must be running Nvidia NIM to steal content so quickly.. 🥁 🙄
The only job that can be easily replaced by an AI is the CEO, but I wonder why we haven't seen that yet
Ai can't burn through money that fast yet
Commercial AI has too many safety checks and effectively too much of a good conscience to be a CEO.
tech CEOs are dumb idiots who have no idea how AI models work, and they are the only ones who now how to burn corporate money to rob humans and conduct big layoffs.
Thereby guaranteeing all incompetent ceo's, instead of merely 99% incompetence.
@@ibendover4817😂😂😂
I love this channel. This is the first video that feels like an ad and somewhat phoned in though.
I am happy for Jeff to get a paycheck though, he deserves it.
Just hope he will go back to his more funny and critical content.
NVIDIA promoted propaganda.
Didn't expect this from you Fireship.
Then you weren't paying attention this whole time. All developers sell out. Unless they made Temple OS.
@@MarvinPowell1 Right, new dev pipeline is Jr dev > mid level dev > Sr Dev or architect > tech influencer with the option to skip Mid and Sr dev if you get a FAANG job out of college for a few months. Just gotta make your first "Why I quit Google/Meta/Microsoft/etc" video and the checks will write themselves eventually.
me too
I am amazed how all this lead to asking the model 2 questions and both answers were completely wrong! This sums up the situation with LLM's so far.
finally a worthy oponent to run "hello world" in
I love 7 minute ads from my tech "news" channel
I’m pretty sure this is an AI voice now. Jeff finally automated himself completely. Sad days.
so basically It's nvidia's version of google's Vertex AI ?
This video did not make me laugh. Is this an Nvidia commercial channel now or was this just a one-off to pay the bills?
"Yes."
Let the man make money, and someone might actually find this useful
Let Jeff get that bag. Literally everything in this video can be implemented with completely open stacks. It's no different than SageMaker except that with NIM there are a few less middlemen between you and Jensen's jacket supplier.
@@GSBarlevthis is true of almost everything Amazon does. Yet they're filthy rich. Open source "tools" existing is NOT THE SAME as a PRODUCT.
Interesting, how much the sentiment is shared..! We all need bread.
I'm just here to listen to the wizard speak his magical spells
The irrational cope and anger from some people over this sponsored deal really gives some insight into why teachlead may have turned on his audience and turned into a troll.
TH-cam commenters truely are gormless turning on creators over silly shit, might as well prioritise that bag instead of keeping a bunch of borderline middle schoolers happy.
Nice, fella got a NVIDIA sponsorship going.
Grab for the stars.
So Nvidia now wants to compete with AWS and Azure? Are they sitting on their own inventory or what?
They manufacturer things. I would hope they have inventory.
@@DoctorMandible They design things
Host the NIM on AWS or Azure, no competition
People who are hating on Fireship, first of all it's a tutorial not a review. Nvidia sponsored him to make a tutorial. It's not something out of this world. It's not like Jeff is making a paid review of NIM. As long as he doesn't do that I think we should be fine
This channel amazed me with its content🎉
What I am missing here is the context: I mean this is the tool and it can do this and that but how to integrate it in a real application? What about the customer's data running through these services hosted on other companies servers, will be data safe from exposure? Whould be nice a 100 seconds orientation tour :). thanks
Me without any knowledge of AI,
just watching the fireship video to look cool.
NOICE.
It’s very impressive how you got paid to advertise this but at the same time completely dismantle how f’d up it is.
bro u are inspiring people to take our jobs
shovel sellers... gj on securing that bag Jeff 👏
man, i sure wish i wasn't so fucking slow.
i would love to be cutting edge.
you guys live in a fascinating world!
You are hysterical dude. I love the sarcastic dry humor.
The audio at 3:26 might be unintentional but it's a nice touch
Today was death of a star
Please don't say the video is sponsored 30% in the video, this is supposed to be a informative channel so I want to know if the info is biased or not right away.
Sam IS the AGI...wake up sheeples
Got that backwards-the AGI is _Sam._ Every request sent to the ChatGPT API is answered by Alt-Man personally. He's the ultimate Mechanical Turk.
@@GSBarlev hey I like that chess reference. But really what was Sam thinking when he started working on CloseAI? Really tech is turning into a marketing industry and less of an innovation industry, I wonder what ever happened to innovation? Did he went on a long vacation or something? Or did Sammy boy stabbed him?
I miss the days where jeff would talk about new frameworks, now its mostly ai 😂😢
selling your soul to nvidia before being replaced by nvidia
We boosting the stock with this one boys 📈📈📈📈📈📈
I can't wait to start working with my AI agent team:) I just need 15-20% incraese in quality of agent's output - at the moment accuracy is to low to scale it. In pharmaceutical industry we need 95-99% accuracy.
I love the part where you followed FTC guidelines and clearly stated that this was an ad
Fireship getting more views than some JRE episodes is something
Comedy with news as usual, solid gold.
Cyborgs and Human Processing Unit pods are the way of the future, and NIM is a stepping stone it it.
This is why I love Nvidia. Removing humans and replacing them with AI is the future of society that will benefit everything and everyone.
This is the most sarcastic ad I've ever seen
man ollama is proving more powerful by the day, FIRESHIP please do a video on AnythingLLM
10 years from now:
“hi there my child got access to the keypad of my Apple house and I’m locked out for 13 days. Can you help me?”
“I can absolutely help you! First off try adding Elmer‘s glue to the keypad!”
I hate being invested in a video only for someone to say it's sponsored!!
This is easily your second best Nim video!
im glad you're moving into a more profitable area than webdev 👍
I was waiting for the real nvidia jab but nah my man fireship really did the sponsor and acted like it was totally cool...nobody is safe
seems fun!
Good work getting a sponsor from them while throwing shade at the same time, it’s a fine line but you did it well . I would have blown it with prompts like “Nvidia.. generate me.. a bag”
adult site link bot stealing DarrenReidAu comment from 14 minutes ago.
Decrease the workforce by 90% in order to increase CEO bonus by 4%. Reality of this unfair world. This line is so real.
I miss the old Fireship
Gamers now be dying to get their hands on H100 GPU like the 4090 is not enough
Wow, thank you for the 7 minute commercial. Next time do us a favour and announce it at the very beginning instead of half way through
I miss your old videos when you talked about JavaScript and not AI
Holy crap, Nvidia is very-very serious about making the pickaxes.
I was just toying with codestral on ollama running in my local machine, very impressive to run a model locally
We can’t escape Kubernetes can we?
I think fireship no longer human, he just the first human plugged into the machine by Nvidia
The bag on this video must have been huge.
Pretty sure you are already augmented by serveral robots measured by the quality and frequency of your content. Chapeau
Mozilla has a similarly cool technology called Llamafile which bundles cross-platform LLMs into a single portable package that exposes an OpenAI compatible API.
Congratulations on the Nvidia spo!!!!!