Lm Studio Offline Voice Assistant + Applio. 100% Free

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ต.ค. 2024
  • Version 2.0
    • Explaining version 2 o...
    github.com/Mus...
    My second program. Don't mind my weird code :D
    github.com/Mus...
    alphacephei.co...
    voice-models.com/
    lmstudio.ai/
    github.com/IAH...
    Help support me and my bird Sparky
    paypal.me/Mush...
    and grow the community at
    / discord
    Other links
    / mushiekings
    creator.nightc...
    www.udio.com/c...
    suno.com/@mush...

ความคิดเห็น • 18

  • @mushiekings
    @mushiekings  หลายเดือนก่อน +5

    Version 2.0 coming soon!

  • @javo11
    @javo11 26 วันที่ผ่านมา +1

    Great man thanks!

  • @ttguitarstringstt1550
    @ttguitarstringstt1550 2 หลายเดือนก่อน +3

    Very good job!. Lot's of programming and problem solving. Impressive!

  • @mpremium391
    @mpremium391 หลายเดือนก่อน +1

    any way to keep conversation? it sends every prompt as new conversation

    • @mushiekings
      @mushiekings  หลายเดือนก่อน +1

      Ah yes, I did noticed this myself. I think there is a way to keep the conversation. In Lm Studio's "local inference server" tab they provide code on how to interact with it. I used the "chat code" but the "ai assistant" code might be the one that remembers the chat history. It should work if the chat code is swapped with the ai assistant code. I will look into this!

  • @workinprogress9155
    @workinprogress9155 หลายเดือนก่อน +2

    Hey, Great Videos🎉 can i also run an german Text to Voice Module? Also Voice to text😅

  • @vivekkarumudi
    @vivekkarumudi หลายเดือนก่อน +1

    Thank you so much for this amazing great project.😀😀

  • @RoarStaze
    @RoarStaze 3 หลายเดือนก่อน +2

    nice

  • @spaztastic4750
    @spaztastic4750 2 หลายเดือนก่อน +2

    Cool project. Alfred stops listening after my initial question unfortunately. I have to stop the thread and restart thus losing my conversation. Any ideas? I'm using the basic tts.

    • @mushiekings
      @mushiekings  2 หลายเดือนก่อน +1

      hmm you are right. It is doing the same thing to me now too. I will try and figure out what is wrong.

    • @mushiekings
      @mushiekings  2 หลายเดือนก่อน +1

      I think i fixed it. Updated the github repository. The program was getting stuck listening for the stop command while the response had already finished. In the basictts_response function after the else statement I added "stopvar = 1" (line 1055) so the listen for stop loop gets killed.

    • @spaztastic4750
      @spaztastic4750 2 หลายเดือนก่อน

      @@mushiekings Thanks I'll give it a shot.

    • @spaztastic4750
      @spaztastic4750 2 หลายเดือนก่อน

      Its working perfect now. Thanks!

  • @RoarStaze
    @RoarStaze 3 หลายเดือนก่อน +1

    u should try edge-tts and faster-whisper im wondering if u can do it locally or get something of that quality locally with something different. i use the sonia voice for edge-tts it seems the most realistic imo

    • @mushiekings
      @mushiekings  3 หลายเดือนก่อน +2

      Edge-tts looks like it is online only unfortunately. Faster-whisper looks pretty good. Vosk works but if you don't say the words just right it can have a hard time interpreting. I will definitely check out faster-whisper when I make version 2. Might be the way to go for speech detection. I appreciate the feedback man! :D Now if only I knew how to interact with Applio directly

    • @RoarStaze
      @RoarStaze 3 หลายเดือนก่อน +1

      @@mushiekings im going to try applio, but atm im working on a chatbot with a huggingface model directly with python script instead of relying on lm studio or anything. just python libraries, huggingface, whisper, and edge-tts. i wish edge-tts was local but i'll just set the script up to have it fallback to offline tts if im not online if online then edge-tts. once i get all that worked out, hopefully get a vision model and then i have an idea of how to get it to see what im doing on the screen