OpenWebUI + Ollama : Stop paying for ChatGPT with this New, Free & Easy Alternative.
ฝัง
- เผยแพร่เมื่อ 14 เม.ย. 2024
- In this video, We'll be talking about how to self-host your own ChatGPT Clone that is better & faster than ChatGPT / GPT-4 Itself. It is a fully free option for those who don't want to pay for ChatGPT and are looking for a free and better alternativ to it. You can use it with Mistral AI's Mixtral 8x22b, LLaMa, Gemini and OpenAI API.
- วิทยาศาสตร์และเทคโนโลยี
It's cool that ollama lets us download a bunch of LLMs but the responsibility of assessing the local system's capability of running them falls solely on the user.
Thanks for the video. How fast is it tho? Just seeing the video it looks slower that Chatgpt 4?
Hi, Thanks for the comment! That mostly depends on which model you run and your system config.
@@AICodeKing I didn't understand, coz chatgpt 3.5 and 4 work well on my PC. What ideal requirements are required for it to run like them?
I have a Ryzen 7 3750H, 16.0 GB, 1650ti
@@afzalux174 Most AIs profit from a modern graphics card. I have a 4080 with 16GB of RAM and if the model fits into the graphics card, it's blazing fast.
1. Include Ollama & openui git source link.
2. How was the response time and ram consumption of mistral.
3. Is there specific need for GPU configuration.
1 I agree with,
2 It is not worth going over given each model is going to be so widely different, not to mention you would even set it up to run faster or slower by opting more or less ram into it.
3 Some do some dont' again it depends on the model itself, not to mention it's library. Have a good day.
The better question I would ask is how do you keep the information fresh, how do we combined models, and what do we do for a backup... Okay maybe not that last one
Any idea if and how we can enable internet access so that if I write a prompt about asking weather then it can fetch the latest info?
You'll need to use something like langchain to do that. I'll cover it in upcoming videos.
@@AICodeKing looking forward to it, thanks!
can this be used offline on the computer without internet connection
Yes
@@AICodeKing do you know if theres an ai model that is good for math or python or if there’s one where you can upload pictures
how do i do the docker part?
You can go to Docker's site and get it installed from there. It is an easy wizard installation.
Yo bro nice videos
Funny I like the calm voice. It is especially good for annoying setups. Why must everything scream excitement like the video host from The Fifth Element.
Thanks Man! Feels Good to see such comments.
Consider infusing the upcoming video with a dash of excitement! The current vibe might be as lively as a sloth in a hammock-let's amp it up.
It's just who I am. But, I'll try. Thanks!
I completely disagree. There's absolutely no need for "excitement" or an "amped up vibe" for these sorts of videos.
It's an instructional video, not entertainment.
I felt the same, videos are good btw