@@danielhabibio thanks! The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome. P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉
@@NickWinters thanks I appreciate the comment There’s another one coming, on Llamafiles (I’m feeling bad it’s taking so long but coming) and I’m also going to start doing Lives soon. Subscribe if you’re interested 😊 Have a great day
@@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know Do you use LM Studio just for the chatbot? Or are you building something with it? Would love to learn more 😉
@@Rozy_333 no worries, it’s a good question! I should have been clearer about the requirements or where to get them. I don’t use windows myself but I will double check. Do you have Python installed already? If not, you will have to download and install it (check www.python.org/downloads/windows/ ) In the video I: 1 Created a virtual environment (this isolates what you install in the project, it’s optional but recommended) 2 Activated the environment (only needed if you do step 1) 3 Installed the Python OpenAI module 4 Created the code and ran it
@@Rozy_333 I do have a Discord server that I should adapt to support this channel! I could help you more in a chat and learn more about what you’re doing, whenever I can discord.gg/kyy5ncWsMa
It needs a fair bit of memory, I’m running on an M1 Air with 16GB Which models have you tried? Start with a smaller one. How much memory do you have? Soon I am going to show a lighter approach that although slow, runs on a raspberry pi
This is the first tech tutorial I've ever seen that was recorded in the woods!
@@danielhabibio thanks!
The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome.
P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉
Mine too!
@@NickWinters thanks I appreciate the comment
There’s another one coming, on Llamafiles (I’m feeling bad it’s taking so long but coming) and I’m also going to start doing Lives soon.
Subscribe if you’re interested 😊
Have a great day
Finally, I found a well-made, no-frills, guide to installing local LLMs!
@@luciferovonnachtosphere thanks 🙏 I really appreciate
I've been using LM Studio as it just works. Super easy to build plugins with the server as well to get functionalities that aren't in the app.
@@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know
Do you use LM Studio just for the chatbot? Or are you building something with it?
Would love to learn more 😉
@@DiogoNeves I've built my own RAG app for it. If you're in the LM Studio discord you'll see my post on it.
I'm much preferring LM Studio than GPT4All - thanks for the tutorial :)
@@aca95aks thanks 🙏 yes, I really like the simplicity and interface of LM Studio. Have you tried any of the other alternatives like Ollama?
6:36 how did you set up it? I mean I'm using windows so what the path you put it? Sorry I am a beginner I don't know if you catch what I mean 😅
@@Rozy_333 no worries, it’s a good question! I should have been clearer about the requirements or where to get them.
I don’t use windows myself but I will double check. Do you have Python installed already?
If not, you will have to download and install it (check www.python.org/downloads/windows/ )
In the video I:
1 Created a virtual environment (this isolates what you install in the project, it’s optional but recommended)
2 Activated the environment (only needed if you do step 1)
3 Installed the Python OpenAI module
4 Created the code and ran it
@@Rozy_333 I do have a Discord server that I should adapt to support this channel! I could help you more in a chat and learn more about what you’re doing, whenever I can discord.gg/kyy5ncWsMa
U need a supercomputer for this. The regular m.2 mac, can’t handle this. Way too slow…
It needs a fair bit of memory, I’m running on an M1 Air with 16GB
Which models have you tried? Start with a smaller one. How much memory do you have?
Soon I am going to show a lighter approach that although slow, runs on a raspberry pi