OMG! how did i not know about this stuff? Ive literally googled to try n figure out how to run language models locally on my pc. I found this when i downloaded a workflow for my comfyUI (AI art) for training LORAs. After 2 days this was the first one that actully fully works, and its super cool, as im using 2 different AIs talking to each other to make art and such. :P I cant wait to explore what else I can use this for.. lol Thanks for introducing me to ollama, and language models in general! NOTE: Its Sept, 2024, and it is now on windows, as thats where im running it. :P
Amazing video. Very clear and concise! Would you consider doing another video on ollama? I'm trying to figure out how to add my own documents to ollama3.2. Ultimately I want to add the newest documentation to a new model. I am using a docker image with a container volume if that makes any difference.
Thank you, glad you enjoyed it. Underrated is perfectly fine with me, channel is really about organising my thoughts, just feel lucky other people find it useful
I installed the llama2:70b wow it is super good, but it is heavy on my machine. it uses up 50 gb ram, and running my 5090x at 70 percent and still it is nearly uses up all of my 3090 GPU. it is a bit slower than the 7b but the answers are so much more complex and nuanced. Im blown away.
really wish your channel got more attention compared to the L4 "influencers"....seems like youtube "programmers" prefer entry level sensationalist memelords )):
I’m okay with the level of attention it gets, the channel is my tech therapy. I just feel very lucky that other people don’t mind watching my therapy sessions
@@chrishayuk i appreciate all REAL senior level wisdom you've bestowed on the internet!! thinking about how the techlead still gets hundreds of thousands of views sometimes makes me have an aneurysm haha
@@jocool7370 nope, you’ve learned something that model can’t do. That’s the true path to knowledge and understanding. Now go learn more things it can and can’t do, and compare with other models
OMG! how did i not know about this stuff? Ive literally googled to try n figure out how to run language models locally on my pc.
I found this when i downloaded a workflow for my comfyUI (AI art) for training LORAs. After 2 days this was the first one that actully fully works, and its super cool, as im using 2 different AIs talking to each other to make art and such. :P
I cant wait to explore what else I can use this for.. lol
Thanks for introducing me to ollama, and language models in general!
NOTE: Its Sept, 2024, and it is now on windows, as thats where im running it. :P
Amazing video. Very clear and concise! Would you consider doing another video on ollama?
I'm trying to figure out how to add my own documents to ollama3.2. Ultimately I want to add the newest documentation to a new model. I am using a docker image with a container volume if that makes any difference.
thank you, i will try and do another ollama video soon, got a few ideas
Thank you @Chris For Sharing This. Very Informative
Glad it was helpful!
Great video, really enjoyed this! Thanks Chris
Thank you, wasn’t the video I intended to record that day, glad it worked well, and you enjoyed it. Thank you
What a great little underrated channel. I love how you present information in such a clear manner. Instant subscribe!
Thank you, glad you enjoyed it. Underrated is perfectly fine with me, channel is really about organising my thoughts, just feel lucky other people find it useful
You are a great teacher and you speak tech very well in such a way that it encourages one to watch the whole video
Thank you so much 🙂
Great video Chris! You're one of the smartest person I know!!!
Too kind and right back atcha
Curious how we could setup use case for project context prompts?
Thanks for this awesome video, subbed 🙌
I installed the llama2:70b wow it is super good, but it is heavy on my machine. it uses up 50 gb ram, and running my 5090x at 70 percent and still it is nearly uses up all of my 3090 GPU. it is a bit slower than the 7b but the answers are so much more complex and nuanced. Im blown away.
really wish your channel got more attention compared to the L4 "influencers"....seems like youtube "programmers" prefer entry level sensationalist memelords )):
I’m okay with the level of attention it gets, the channel is my tech therapy. I just feel very lucky that other people don’t mind watching my therapy sessions
@@chrishayuk i appreciate all REAL senior level wisdom you've bestowed on the internet!! thinking about how the techlead still gets hundreds of thousands of views sometimes makes me have an aneurysm haha
Very very kind of you
Thanks for making this video. I've just tried OLLAMA. It gave wrong answers to 3 of my 4 first (and only) prompts. Uninstalled it.
these things depend on the query and the model
@@chrishayuk Then they're useless?
@@jocool7370 nope, you’ve learned something that model can’t do. That’s the true path to knowledge and understanding. Now go learn more things it can and can’t do, and compare with other models