No clickbait, no long intro, no over-excitement. Just pure, straight-to-the-point content, with real-world examples and neatly divided sections. You are a hero
holy heck dude, you just taught us magic. This is the magic! not even the fine tuning, but the data set generation! data sources! all the pieces I have been searching for!
Be wary that OpenAI prohibits the use of their models to generate training data (no competing closure). It's hard to detect, obviously, but it's useful knowledge imo regardless.
One thing I really like about your videos is that it always comes with really quality examples. And the examples are pretty much practical oriented. Do make the embedding video.
@@AIJasonZ Absolutely agree. Very helpful and i like the speed you go, staying on topic. Please make the embedding video! Very interested to see your take on it.
I thought the opposite, this was like watching someone assemble a nuclear reactor. I'm more confused about AI after watching this. You need to be a master programmer to properly view this video.
One of the best and most straight forward tutorials i have Seen after 5 years of ComputerScience! Keep it up now i am honna binge eatvh your other videos
Greaeeeeeeeeeeettttttt ! I have been surfing through internet for last 6 months for this type of workflow tutorial and here you have just made it. Thank you so much for this. My biggest question was how to prepare my own data to finetune a specific AI model for my use case. You have explained that part very easily. Now I can start making my own chatbots. P.S I am not a tech guy .... just an accountant.😅
Thought it was another clickbait meme video, and here am I, writing a comment about how cool it is, straight to the point, stuffed with info, super interesting, informative and useful in case someone needed to make his language model and was searching for info on it
Holy Crap, JZ? Oh my God! I stumbled upon your channel because I've been looking into AI stuff and I was like "I know this voice and this face". This is a great video!
In my experience, with embedding you have to be careful with the data you use. It's text only, so you can't use a source that makes references to any images or graphs, which means that you will have to rewrite those portions manually so that the information is embedded properly. If you don't do that, then your knowledge base makes no sense. How much that is a problem really depends on your use-case. Also, anything that has to do with calculations can be a problem, such as different methods of capital gains calculation. The embedded knowledge base can be good enough to allow for the model to explain how a calculation method works, but it's not necessarily going to understand them or be able to talk about them in a dynamic way. Which in the case of AI, means it's going to hallucinate, rendering it useless for those topics. I'm still waiting a bit until we have better access to plugins, so that we can create a system that's more like a body of multiple models, which each handle specific aspects of the data. I think there's a possibility there
But you can create embeddings to the images too. Or it's to hard (I use text-ada-002, and don't know about some techniques(models) for image embeddings. But I'm sure google has one, so it's possible...
great video Jason - also my first ever comment on TH-cam. Most practical tutorials on AI so far imo - I would be keen to see a video where you set up a vector DB and load your own data
v good tutorial, that goes through a lot of stuff, from overview, datasets, even dataset creation, downloading, finetuning and even uploading a model; wow
This will be great for generating NPCs for computer games. You don't need a massive model for NPCs, you just need a fine tuned model that encapsulates the NPCs personality.
Real thanks from another Jason man, clear and concise video! As a high schooler, I'd like to create an LLM project, so I hope I can follow through after I do my research :)
Where is my hug this guy button. Bro? You're a real life person? F' Yeah to this content Brah ! You kick Butt as impressively as Mike Tyson in his Prime with this niche. Could we Train it to do design specific things using third party software?
This was super informative and I learned a lot. Great video!! Not to be rude, see this as a constructive comment, be aware of some typos you have along the video. It's not like it bothers me much or anyone, but correcting those little details add up to make your content even better! Good luck and I hope to watch more of your videos :D
I clicked the subscribe button! Jason, can you do a video on embedding and perhaps LLM in specific technical domain such as writing code or providing answers to physics questions.
Oh man, this is so good, i always confused about when should i finetune LLM, this makes things super clear; Also falcon 40b seem to be an awesome choice!
Beyond excellent. Damn. Reminds me of Yolo and Stable diffusion in a way. I have got to read the papers sometimes and try tot write a C implementation. This is beautiful!!!!!
Hey Jason, really nice job! I love what you're doing! Just curious, if you could answer, where did you receive your knowledge/training on AI/ML/DS? Was it with a specific university program, online course, completely self taught, etc. Thanks!
Thanks for that man, very instructional... and yeah the 40b really bombs out colab for me... but the 7b is sort of piss poor. Having said that, the day when coders and users stop complaining about the power of a given application will be a fairly interesting day indeed!
There is ZERO chance all of you here understand what he is saying. Fine tuning models, downloading models, installing models......?! I thought AI was an improvement, this is too advanced for the smartest humans.
@@AIJasonZ maybe deploying these models on MS Azure so we can have their API and for the next video try making a simple streamlit app with that API Really appreciate the work you are doing. This just saved me hours of my work. Thank you very much
@@AIJasonZ Thanks Jason, have you seen any of the coursera or edX courses for Machine Learning Engineering, data science in ML or NLP? or any of the ones from CodeAcademy on Computer Science, etc? Do you think any of those certifications would give me closer to the knowledge you have?
@@TheAIBlueprint I know I'm not Jason, but my advice as someone who is also interested in this subject, learn from the internet and chatgpt! Personally, I have just dove into the hugging face documentation and find myself after only a day fully understanding jason's code. There is never a magic tutorial to teach you what you want to know, just dive in and find the information yourself. Best of luck!
thanks for this amzaing videos. looking forwards to your next videos for embedded knowledge base and creating a chatbot for UI using these trained models.
Ey 😊 awesome. I created a conversational api with context management in Java. I've used gpt-4 and learnt allot. I'm hoping I can make use of this as well. Nice video.
No clickbait, no long intro, no over-excitement. Just pure, straight-to-the-point content, with real-world examples and neatly divided sections. You are a hero
You understood that? I wish.
YES! Getting tired of those time filler AI videos, almost didn't watch this one. Now subscribed
Aaaah just like the good ol days 😅😂
@@668771knuckle down and study practice study practice, it's not that difficult 🤷🏽♂️
specific use case: filter videos for overexcitement and clickbait, then tag them
holy heck dude, you just taught us magic. This is the magic! not even the fine tuning, but the data set generation! data sources! all the pieces I have been searching for!
Thanks so much mate!! That means a lot, DM me if you get any question pls!
Literally brother you have taught us prompt engineering wizardry, there’s no other way to put it.
I’ve been generating massive data sets and manipulating in python then bringing it back to fine tune. Shits getting wild out here
@@DeepDiveNFTlol sounds like fun, what kind of general use cases do you have?
Be wary that OpenAI prohibits the use of their models to generate training data (no competing closure). It's hard to detect, obviously, but it's useful knowledge imo regardless.
One thing I really like about your videos is that it always comes with really quality examples. And the examples are pretty much practical oriented. Do make the embedding video.
Thanks man, that means a lot! 😬
@@AIJasonZ Absolutely agree. Very helpful and i like the speed you go, staying on topic. Please make the embedding video! Very interested to see your take on it.
I thought the opposite, this was like watching someone assemble a nuclear reactor. I'm more confused about AI after watching this. You need to be a master programmer to properly view this video.
@@AIJasonZ +1 on make the embedding video. Really great stuff :)
Honestly, I love how you don't put a clickbaity title or thumbnail, and how you explain it well but also fast.
honestly, I was not expecting jin yang to teach us but I'm all for it
straight to the point, loved it
One of the best and most straight forward tutorials i have Seen after 5 years of ComputerScience! Keep it up now i am honna binge eatvh your other videos
Great Video! I would love to see a video on how to create an embedded knowledge base and use it along side this fine-tuning.
most underrated channel in AI. Thank you for the effort you are putting into this.
Let's be honest. Who here clicked because you thought he was JIMMY YANG?
Who’s Jimmy Yang? 😂
@@shuzhu6633 the comedian in the thumbnail
jian yang
I'm not 😂
That's 😂
Very good teaching style. I also liked that you actually went through the process ourself. Thank you very much
Omg this is the best one I have seen so far!!!I’m planning to train one of my own model soon!!
Fantastic video once again, can’t wait for the next embedding one 😊
Your audio gradually went from studio recording to cathedral ambiant. Hey thanks for the info. Love it ♥
Greaeeeeeeeeeeettttttt ! I have been surfing through internet for last 6 months for this type of workflow tutorial and here you have just made it. Thank you so much for this. My biggest question was how to prepare my own data to finetune a specific AI model for my use case. You have explained that part very easily. Now I can start making my own chatbots.
P.S I am not a tech guy .... just an accountant.😅
You should ditch your boring profession.
Really appreciate your free thought. Will try to follow you closely.
Bad audio Dude. However, this is Exceptional content... finally... a workable explanation. Thank You.
Thought it was another clickbait meme video, and here am I, writing a comment about how cool it is, straight to the point, stuffed with info, super interesting, informative and useful in case someone needed to make his language model and was searching for info on it
This is an amazing video that helps me make sense of the Azure Open AI playground to train my model. Love this.
Excellent video Jason. Well organised and easy to understand.
Would love to see the video on the knowledge database. Thank you for this!
well done! looking forward to the embedding video too
This channel is going to be huge.
Finally I've found an AI video that I don't understand at all! It's funny that there is actually so few experts willing to share their knowledge
I'm glad i found this channal! wonderful work!!
Bro you've done something wonderful for the world with sharing this video 🎉👏 As an app dev I learned something I didn't know I needed to know
keep the good job Jin Yang，your top follower from shanghai
I have been spinning my wheels on a project and this video unstuck me - thanks a million!
Holy Crap, JZ?
Oh my God! I stumbled upon your channel because I've been looking into AI stuff and I was like "I know this voice and this face".
This is a great video!
Hahahah hey Eric! Long time dude
This is such a relevant and timely video. Thanks bud. PS I love all your silicon valley video titles
Awesome! I'm totally new to fine-tuning. I'm looking forward to fine-tuning a model with thousands of private 4K images!
I'm commenting before I watch the video because that thumbnail is so god dammed hilarious.
Edit: Now that I've watched this, I want to like it again.
Great content! A how-to without any fluff what so ever that is easy to follow.
Learning so much from you. Thank you for making this.
Great video. Small tip though - Inform the users which tools are free and which ones are paid.
In my experience, with embedding you have to be careful with the data you use. It's text only, so you can't use a source that makes references to any images or graphs, which means that you will have to rewrite those portions manually so that the information is embedded properly. If you don't do that, then your knowledge base makes no sense. How much that is a problem really depends on your use-case.
Also, anything that has to do with calculations can be a problem, such as different methods of capital gains calculation. The embedded knowledge base can be good enough to allow for the model to explain how a calculation method works, but it's not necessarily going to understand them or be able to talk about them in a dynamic way. Which in the case of AI, means it's going to hallucinate, rendering it useless for those topics.
I'm still waiting a bit until we have better access to plugins, so that we can create a system that's more like a body of multiple models, which each handle specific aspects of the data. I think there's a possibility there
I think the Bard team also realized this....
But you can create embeddings to the images too. Or it's to hard (I use text-ada-002, and don't know about some techniques(models) for image embeddings. But I'm sure google has one, so it's possible...
Thanks for sharing. It was helpful for understanding the fine tuning process. Can you also make a video on KnowledgeBase embedding? Thanks
This is just amazing! waiting for your embedding model
One of the best, to the point, goldmine of a tutorial
Looking forward to the video on embedding a knowledge base
Coming soon, stay tuned!
Excellent lesson on Fine tuning. You are a good teacher. Thanks. Please make he next video I am now subbed.
great video Jason - also my first ever comment on TH-cam. Most practical tutorials on AI so far imo - I would be keen to see a video where you set up a vector DB and load your own data
Hah thanks, first comment means a lot to me! Will get more content :)
All thriller no filler. Wicked vid well done sir
Excellent video Jason! Step by step examples are really helpful
I like it. Because your video i can follow it every step. It's important for a newbine .
Thank you for sharing this. This will definitely help. Also epic thumbnail 😂
v good tutorial, that goes through a lot of stuff, from overview, datasets, even dataset creation, downloading, finetuning and even uploading a model; wow
Thank you! Let me know if anything else missing!
I am now waiting for your tutorial on the reborn Guidance :) Regards! @@AIJasonZ
This will be great for generating NPCs for computer games. You don't need a massive model for NPCs, you just need a fine tuned model that encapsulates the NPCs personality.
I want an AI that has no morale, no ethics and doesn't sugar coat anything. A free AI without limitations humans put on it .
Google the "DAN" prompt
Real thanks from another Jason man, clear and concise video! As a high schooler, I'd like to create an LLM project, so I hope I can follow through after I do my research :)
Great information. I am interested in the embedding style. Would love to see a video of that.
Finally someone show it in the most simplest way
Bloody awesome video - concise yet detailed! Looking for upcoming vids
I'm floored by your content. It is amazing 👏👏👏👏👏👏
Where is my hug this guy button. Bro? You're a real life person? F' Yeah to this content Brah ! You kick Butt as impressively as Mike Tyson in his Prime with this niche.
Could we Train it to do design specific things using third party software?
Man this is exactly the sort of guide I was looking for. Thank you very much.
Absolutely loved the video mate! super focused! You inspired me for my own channel! thanks and keep it up! :))
Came for the thumbnail stayed for the content
Yeah that thumbnail told me all I need to know about doing something like this.
This was super informative and I learned a lot. Great video!!
Not to be rude, see this as a constructive comment, be aware of some typos you have along the video. It's not like it bothers me much or anyone, but correcting those little details add up to make your content even better! Good luck and I hope to watch more of your videos :D
What an amazing to the point video! You're an amazing human being Jason. Keep doing you!
I clicked the subscribe button! Jason, can you do a video on embedding and perhaps LLM in specific technical domain such as writing code or providing answers to physics questions.
Thanks mate! Coming soon, stay tuned!
Oh man, this is so good, i always confused about when should i finetune LLM, this makes things super clear; Also falcon 40b seem to be an awesome choice!
I have been looking for you for so long. Thank you so much for this. Now I can ditch open AI api key and use this for free for my usecase.
Great job Jason! Very helpful!
really helpful and straight forward. Subbed !
Brilliant mate. Keep these coming
Good Job Jason 👨🏽💻
give this man a cookie, dude thank you !!!!
Beyond excellent. Damn. Reminds me of Yolo and Stable diffusion in a way. I have got to read the papers sometimes and try tot write a C implementation. This is beautiful!!!!!
Excellent tutorial on finetuning Falcon 7B
brooo....God bless you for this...gained a ton
Good stuff Jason🤙🏻
excellent tutporial! thank you for sharing.
What i have been wanting to do for the longest while, might just do it when im free
30 seconds in and my brain is already hurting
Hey Jason, really nice job! I love what you're doing! Just curious, if you could answer, where did you receive your knowledge/training on AI/ML/DS? Was it with a specific university program, online course, completely self taught, etc. Thanks!
Self taught hah :) chatGPT definitely helped a lot!
really interesting! nice video! 🤗
As someone who coded for 40+ years, watching your videos is like watching coder porn. Cool stuff!
🤣🤣This is the best compliment I got ever hahah, appreciate it mate!
I think its a language barrier for me. I don't understand what he is saying, he has a really heavy accent so I think I miss 75% of his words.
Thanks for that man, very instructional... and yeah the 40b really bombs out colab for me... but the 7b is sort of piss poor. Having said that, the day when coders and users stop complaining about the power of a given application will be a fairly interesting day indeed!
There is ZERO chance all of you here understand what he is saying. Fine tuning models, downloading models, installing models......?! I thought AI was an improvement, this is too advanced for the smartest humans.
Solid introduction. Would love to see some simple 10-minute training videos.
What kind content you want to see in that 10 min video? :)
@@AIJasonZ maybe deploying these models on MS Azure so we can have their API
and for the next video try making a simple streamlit app with that API
Really appreciate the work you are doing. This just saved me hours of my work. Thank you very much
Yes please, waiting for knowledge base embedding video ! 🎉
Great video. Helped create a much tighter solution for our client.
Wow, what a sick video. Thanks so much!
how did you know and is the special token that used
Hey Jason, great tutorial! What kind of training does one need to do in order to have the programming and understanding that you have? thanks
Thanks for the kind words! I think you can start with prompt engineering!
@@AIJasonZ Thanks Jason, have you seen any of the coursera or edX courses for Machine Learning Engineering, data science in ML or NLP? or any of the ones from CodeAcademy on Computer Science, etc? Do you think any of those certifications would give me closer to the knowledge you have?
@@TheAIBlueprint I know I'm not Jason, but my advice as someone who is also interested in this subject, learn from the internet and chatgpt! Personally, I have just dove into the hugging face documentation and find myself after only a day fully understanding jason's code. There is never a magic tutorial to teach you what you want to know, just dive in and find the information yourself. Best of luck!
Great Video! Keep up the good work
Great video mate! Keep up the work (Y)
thanks for this amzaing videos. looking forwards to your next videos for embedded knowledge base and creating a chatbot for UI using these trained models.
Excellent work.
What kind of paid projects energize you and make you feel excited?
Ey 😊 awesome. I created a conversational api with context management in Java. I've used gpt-4 and learnt allot. I'm hoping I can make use of this as well. Nice video.
@9:45 Yes, please and thank you. Also thank you for this.
the stronger the accent the better the learning. Don't forget the yellow circle around your mouse and get closer to he mic and zoom in more
I appreciate this. Subscribed.
Awesome video! So many great resources. Demystified a lot for me. Thanks!
This is fantastic info, thanks! Subscribed.
Thank you Jin yang
Good work dude! This is super useful!
Great concise tutorial, thanks!👍
Amazing Thumbnail, I IMMEDIATELY thought of "Hot Dog, no Hot Dog"! 😀
@AI Jason, the problem with Kaggle datasets is the quality. Some of the datasets are randomly generated and some others are low quality data