Fine Tuning LLM Models - Generative AI Course
ฝัง
- เผยแพร่เมื่อ 11 ก.ค. 2024
- Learn how to fine tuning LLM models. This course will teach you fine tuning using using QLORA and LORA, as well as Quantization using LLama2, Gradient and the Google Gemma model. This crash course includes both theoretical and practical instruction to help you understand how to perform fine tuning.
💻 Code: github.com/krishnaik06/Finetu...
✏️ Course developed by @krishnaik06
⌨️ (0:00:00) Introduction
⌨️ (0:01:39) Quantization Intuition
⌨️ (0:34:03) Lora And QLORA Indepth Intuition
⌨️ (0:56:26) Finetuning With LLama2
⌨️ (1:20:35) 1 bit LLM Indepth Intuition
⌨️ (1:37:33) Finetuning with Google Gemma Models
⌨️ (1:59:45) Building LLm Pipelines With No code
⌨️ (2:20:33) Fine tuning With Own Custom Data
🎉 Thanks to our Champion and Sponsor supporters:
👾 davthecoder
👾 jedi-or-sith
👾 南宮千影
👾 Agustín Kussrow
👾 Nattira Maneerat
👾 Heather Wcislo
👾 Serhiy Kalinets
👾 Justin Hual
👾 Otis Morgan
👾 Oscar Rahnama
--
Learn to code for free and get a developer job: www.freecodecamp.org
Read hundreds of articles on programming: freecodecamp.org/news
![[1hr Talk] Intro to Large Language Models](http://i.ytimg.com/vi/zjkBMFhNj_g/mqdefault.jpg)
![[1hr Talk] Intro to Large Language Models](/img/tr.png)
this was the best course i have seen when it comes to fine Tunning. I have already fine tuned 5 models before this video and now this time next year it should be 500. Only because you have streamlined fine tunning for me.
This is a amzing tutorial end to end and if someone wants to learn the fine tuning concepts with hands on lab. Thanks Kris !
Krishnaik sir you are a blessing
Thank you soo much, I was looking for something just like this for the past few days !
Thank you for sacrificing your hair to teach us 🙏
LOL
Thanks a lot 👍👍 lots of value ❤
Quantisation is such a simple thing. Can’t believe the time being spent on it. There are videos out there which are far more effective for your time
धन्यवाद!
Krish Naiikkkk my favourite ❤️
Amazing!👍💪😂
I have a job interview tomorrow to get a genAI job, I barely know anything about it, but I am going through this tonight right now, if I get the job tomorrow I will come back and post a thank you.
all the best!!!!!!!
did you land the job?
thanks to you i finished my masters degree
He is one of the best teachers. Stop spreading lies
video dropped when i cooked!
👍👍
Krish my guy!
Can we apply this fine tunning for the custom LLM which is taught in this channel freecodecamp
Sir where's the previous video?
Can i get link?
In my opinion krish naik haven't taught well in pw(physics wallah) (skills) courses, and he skips things ... See when he first starts he will tell you we did this previously.... 😂😂
That's not fair criticism with regard to this video.
While critiqueing, pls be specific especially with content.
I have watched his videos on youtube. He is decent in teaching basics and he passionately teaches. In the case you aren't able to follow him, I can understand your concern as he has an Indian accent. Krish shares his content free of cost on yt and GitHub. He seems to be software person who has moved into AI. He may not be an expert in Statistics or math.
Can i use my laptop cpu for this crash course or gpu is required?
You can do everything with a cpu.
But if you want to try, Google colab offer free limited gpu processing.
Gpu only accelerate things.
Instead you can use small models by using cpu that are enough for learning.
When you Learnt the concept, you can build small things and tune them and find job with it, after that, company paid for thousands of gpus for processing models that you have access to
u can use google colab and change runtime if gpu required
What writing pad do you use?
What happened to his hair 😫😫😫, he is getting into legend stage..
How can I publish my coding video on this channel?
I don' t understand why people call pre training the process of training the model for the first time. Pre training is training and fine tuning is a second training.
I am so poor.
How may I contribute to American Coders. 2yr. & under Coders?
Thanks.
Do a new video on MoRA and ReMoRA. It leaves LoRA and ReLoRA in the dust.
Not helpful , it felt like just going through some pre written notebooks and just explaining very simple things like lora and quantisation , did not explain importance of parameters in training arguments etc. Not a useful course
18:04
The previous video link: th-cam.com/video/Vg3dS-NLUT4/w-d-xo.html
§ ILLUMINATI ! § CHICELEDO ! §
So now going to low quality youtubers? But for free, i don't blame you
he has almost 1 million subs for a reason. and u could just close tab go back to minecraft.
@@mlmachine i don't care about fake followers. He is not of the channel quality as I can judge easily
@@ah89971 What do you mean by quality?
1:05:47
Forth view 🎉
Umm… my guy, you are making several technical mistakes here. Not saying you’re completely wrong but the conceptual understanding is weak in several places. But a good attempt nonetheless.
First view
thanks, amazing channel, we need course about Microsoft AI-102
Sir, instead of uploading podcasts, please upload new videos on UI&UX design contents
First
Not watching
Boo
Isnt this guy known for selling low value courses to misguide college students? Why is freecodecamp not doing background checks?
Can you elaborate? A lot of us might not know what he has done
He is into genai so i dont expect more
Yes, he is that guy.
He is also known very well for his aggressive marketing besides being well known for misguiding college students to sell his low value courses.
@@sadmanishrak9529bro what are u talking about?
Thank you for your info
He only teaches superficially. He is not explaining any step in depth.
Dude is repeatedly digging his nose throughout the video. It's disgusting and unprofessional. He doesn't even use hand sanitizer thereafter. Certain things are not meant to be done on camera.
well if you were here to study or learning, your focus would be on the shared screen. People who complain NEVER succeed in life. 😉