How to Run Local AI Models - in 5 minutes

แชร์
ฝัง
  • เผยแพร่เมื่อ 28 ม.ค. 2025

ความคิดเห็น •

  • @danielhabibio
    @danielhabibio 6 หลายเดือนก่อน +13

    This is the first tech tutorial I've ever seen that was recorded in the woods!

    • @DiogoNeves
      @DiogoNeves  6 หลายเดือนก่อน +5

      @@danielhabibio thanks!
      The coming videos should also have an outdoor twist too 😉 hopefully gets more people in the flow and woods are just awesome.
      P.s. I promise I’m not building a bunker in the woods to hide from our AI overlords 😉

    • @NickWinters
      @NickWinters 4 หลายเดือนก่อน +1

      Mine too!

    • @DiogoNeves
      @DiogoNeves  4 หลายเดือนก่อน

      @@NickWinters thanks I appreciate the comment
      There’s another one coming, on Llamafiles (I’m feeling bad it’s taking so long but coming) and I’m also going to start doing Lives soon.
      Subscribe if you’re interested 😊
      Have a great day

  • @luciferovonnachtosphere
    @luciferovonnachtosphere 6 หลายเดือนก่อน +3

    Finally, I found a well-made, no-frills, guide to installing local LLMs!

    • @DiogoNeves
      @DiogoNeves  6 หลายเดือนก่อน

      @@luciferovonnachtosphere thanks 🙏 I really appreciate

  • @yorkie4k
    @yorkie4k 6 หลายเดือนก่อน +3

    I've been using LM Studio as it just works. Super easy to build plugins with the server as well to get functionalities that aren't in the app.

    • @DiogoNeves
      @DiogoNeves  6 หลายเดือนก่อน +1

      @@yorkie4k totally! I’m now also looking into Llamafiles and SQLite-vec. Both really cool too, but LM Studio is still the simplest and most accessible I know
      Do you use LM Studio just for the chatbot? Or are you building something with it?
      Would love to learn more 😉

    • @yorkie4k
      @yorkie4k 6 หลายเดือนก่อน

      @@DiogoNeves I've built my own RAG app for it. If you're in the LM Studio discord you'll see my post on it.

  • @aca95aks
    @aca95aks 6 หลายเดือนก่อน +2

    I'm much preferring LM Studio than GPT4All - thanks for the tutorial :)

    • @DiogoNeves
      @DiogoNeves  6 หลายเดือนก่อน

      @@aca95aks thanks 🙏 yes, I really like the simplicity and interface of LM Studio. Have you tried any of the other alternatives like Ollama?

  • @Rozy_333
    @Rozy_333 2 หลายเดือนก่อน +2

    6:36 how did you set up it? I mean I'm using windows so what the path you put it? Sorry I am a beginner I don't know if you catch what I mean 😅

    • @DiogoNeves
      @DiogoNeves  2 หลายเดือนก่อน

      @@Rozy_333 no worries, it’s a good question! I should have been clearer about the requirements or where to get them.
      I don’t use windows myself but I will double check. Do you have Python installed already?
      If not, you will have to download and install it (check www.python.org/downloads/windows/ )
      In the video I:
      1 Created a virtual environment (this isolates what you install in the project, it’s optional but recommended)
      2 Activated the environment (only needed if you do step 1)
      3 Installed the Python OpenAI module
      4 Created the code and ran it

    • @DiogoNeves
      @DiogoNeves  2 หลายเดือนก่อน

      @@Rozy_333 I do have a Discord server that I should adapt to support this channel! I could help you more in a chat and learn more about what you’re doing, whenever I can discord.gg/kyy5ncWsMa

  • @boqoll
    @boqoll 6 หลายเดือนก่อน

    U need a supercomputer for this. The regular m.2 mac, can’t handle this. Way too slow…

    • @DiogoNeves
      @DiogoNeves  6 หลายเดือนก่อน

      It needs a fair bit of memory, I’m running on an M1 Air with 16GB
      Which models have you tried? Start with a smaller one. How much memory do you have?
      Soon I am going to show a lighter approach that although slow, runs on a raspberry pi