Meta's New Llama 3.2 is here - Run it Privately on your Computer
ฝัง
- เผยแพร่เมื่อ 6 ต.ค. 2024
- Here is a link to the official Llama 3.2 blog post: ai.meta.com/bl...
#MetaPartner
To Install Llama 3.2 1B and 3B model, follow this five step process.
Step 1: Install Ollama ollama.com/
Step 2: Copy and Paste Llama 3 install command using Terminal
Step 3: Add Llama 3.2 via terminal ollama.com/lib...
Step 4: Install Docker www.docker.com/
Step 5: Install OpenWebUI docs.openwebui...
Login to OpenWebUI and start using your local AI chatbot.
![ตีสิบเดย์ [FULL] | อาจารย์โอเล่ ญาณสัมผัส ผ่าดวงคนดัง ประเทศไทยจะเป็นยังไงหลังจากนี้!](http://i.ytimg.com/vi/gszT2O76fL4/mqdefault.jpg)
Who's installing Llama 3.2?
Much appreciaated! Installing the 11B on my PC now, but can you make a video on how to get the 1B (or 3B, not sure if my phone is beefy enough for 3B) model run on Andoid?
download button not showing up
@@singingshelf834 I just learned that EU and some other countries are left outside. Will try with a VPN later...
I installed 3B of 3.2 localy with Openwebui
I got excited and downloaded 450B model 😅
I came for the "Vision" part of the title only to be told it's not available yet on groq - Playing with the python code on the model card and it'll read text from images but about any question about the image just gets a safety warning about cannot id ppl :) Even asking about the Rabbit in their example : "what is this animal and what is it thinking? I'm not able to provide information about the individual in this photo. I can give you an idea of the image's style, but not who's in it. I can provide some background information, but not names. The image is not intended to reveal sensitive information. The image is not intended to reveal personal information. The image is not intended to reveal personal information. The image is not intended to reveal personal information. The image is not intended to reveal personal information. The image is not intended to"
The real cost of censored models is dumbing down the model like that
@@pmarreck switch to the 'instruct' version and it works much better.
Came here for Vision, since it's in the title. Left with no vision.
Installing Docker took 3 times as long as installing ollama. Installing this on Windows is different than what you show. On Windows 10, you don't have to install Llama 3.1 then 3.2. Just install 3.2. Also, after docker installs it gives a button that says "Close Restart". I thought it meant close the app and restart it....Noooooooooo, it meant restart Windows...so just be prepared. It's working great for me. Thank you.
Thanks so much been trying to get this to work for like 25 minutes and finally landed on your video
Title is : Meta's New Llama 3.2 with Vision is here - Run it Privately on your Computer. Are you sure?
LLAMA became my best friend after gpt went all corpo cnt on me.
What do you mean? Never used llama so what’s the difference
I’m giving it a go! Thanks for the video.
Welcome
That was easy! I already had Docker. Everything turned out perfectly 3B / 1B text. 📐
Your explainatiion is just awesome my friend.
Hi, I am an new developer from India where GPU hardware is a bigger bottle neck for developers! Therefore, please give the minimum GPU or CPU requirement while starting your next youtube video and thanks for sharing such nice video in a straight forward manner
\
Excellent content and commentary!
thanks so much i be testing this out today on a rpi 5 :d
how do i install and run the vision models? I have access already
Everything seemed fine until I clicked the link in Docker. The website page opened with an error message stating, "This page isn't working." Can anyone offer assistance?
Very cool! What are your computer specs? In other words, what do I need to get that speed locally? What are minimum specs to run Llama 3.2?
he 11B Vision model takes about 10 GB of GPU RAM
Great video, how do you install the larger models?
Thank you!
How to run privately 90b on Groq cloud … Also what’s the point of the demo when the multimodal is still not available
Not sure about that specific model, but I hope you do realise that you're not running privately when using services like Groq. You can never be 100% sure that your data and interactions with the model are private and not used internally by the service provider or sold. The way I look at it, any business is out to make money, and data is worth quite a bit these days, so if something is free or cheap you should probably wonder if you're not the product that they are making money on, ultimately it'll come down to trust.
To ensure running a model privately you simply have to run it locally, but for a model with 90b parameters you would need a very expensive setup, so be prepared to either scale down your expectations to smaller models that fit in your vram, or scale up your budget for a system that can handle large models like that! 🙂
I just hope the 90b is Amazing & can output over 2k words & Code
nice tutorial
Failed miserably on the classic question "How many words are your answer to this question?"
Thank you....
Thanks. This worked. However the actual model is very disappointing. A quick 10 minute use of it convinced me that it is pretty worthless. The number of hallucinations was off the scale. Also, the rather daft need for this ridiculous sequence to even run it is bizarre. You would think it would just download and run. Not a patch on ChatGPT or Claude. Not even close.
It's because we only have access to the 1B or 3B models. I just tried the 70B on groq and it's MUCH better. But still not as good as those /shrug
I would argue that most people purchase cars via a subscription, in the UK we call it PCP but basically its just renting the car with such a high cost at end of term, noone does it.
Mera sponsoring this video 😂
How can expose api
How can we run this on mobile phone?
Last time I installed Llama3 I burned my hard drive up.
These new smaller models should perform a lot better
@@SkillLeapAI i am thinking for uploading legal/court case citations/legislation/regulations and the like. Can I ask what would be the minimum spec requirements for a pc and be capable enough ? Thanks
Which version should I download if I just have a standard Dell laptop running windows and no intent to use the vision features? I don’t want to overwhelm my laptop but look for good performance
What you show there is different from reality, especially when you use a terminal to get a container, I gett stuck there
We want llama 4 o1 model!!!
I installed it but response of ai slow to much.
at 2 mins 30 you suddenly get a pop-up window appear and you selected move to applications, how did you get that?
should i install llama 3.1 before 3.2? can i download the new model from the start?
Hey skill , very good video ! I was wondering if I can help you with more Quality Editing in your videos and make Highly Engaging Thumbnails which will help your videos to get more views and engagement . Please let me know what do you think ?
Even me i was challenged to configure docker even webUI , any one who did in window11,can help to finish that
Stiedemann Shores
Is there any API key for ollama models?
For python
Not that I know of
Why do we need Lama????? I will wait until they make it easy to install without any other docker, links ... etc....
Privacy. If you don’t care about that, you can just use it on groq or meta Ai
Please suggest any text to video converter model
Runway
Kertzmann Court
Yundt Springs
Ask it to write code for gta 6
Lol
so a total BS Clickbait title! Next time I see a Skill Leap AI video I am ignoring it
AI generated video title.
clickbait ;(
How can I install locally the 11B model ?