AI Voice 3D Assistant in Spline - Tutorial

แชร์
ฝัง
  • เผยแพร่เมื่อ 3 ธ.ค. 2024

ความคิดเห็น • 76

  • @bigloong6171
    @bigloong6171 29 วันที่ผ่านมา +7

    Wow, spline is getting stronger and stronger, plus I'm honored to be able to provide case inspiration for the officials!

    • @splinetool
      @splinetool  28 วันที่ผ่านมา

      @@bigloong6171 ❤️❤️❤️

    • @sagarbhat7317
      @sagarbhat7317 28 วันที่ผ่านมา

      Hi I have a question for the integration of AI into spline for my project. Could I get in touch with you on email? or Instagram?

    • @splinetool
      @splinetool  21 วันที่ผ่านมา

      @@sagarbhat7317 Feel free to contact our team! You can reach us at review@spline.design.

  • @madebypico
    @madebypico 29 วันที่ผ่านมา +4

    Man this is awesome. Congrats to the team.

    • @splinetool
      @splinetool  28 วันที่ผ่านมา

      Thank you! 💓

  • @FloNocode
    @FloNocode หลายเดือนก่อน +2

    Hi, thanks for this content ! We need more tutorial like that for upgrade our skill in Spline

    • @splinetool
      @splinetool  หลายเดือนก่อน

      We’re really happy to hear that it’s helpful! We have even more tutorials coming your way to help build those skills! 😊 Let us know what other topics you’d like to see!

  • @dingosmoov
    @dingosmoov หลายเดือนก่อน +5

    Nice tutorial! Yes would love to have a morph target tutorial.

    • @splinetool
      @splinetool  หลายเดือนก่อน +1

      Noted! Thanks

    • @ceez-fr3zv
      @ceez-fr3zv 18 วันที่ผ่านมา

      I would love to see that one too!

  • @darinaskew1682
    @darinaskew1682 3 วันที่ผ่านมา

    A morph target tutorial would be great, thanks.

  • @vahiddaem
    @vahiddaem หลายเดือนก่อน

    wow... perfect... i have been waiting for this so long

  • @RIVETEStore
    @RIVETEStore 17 วันที่ผ่านมา

    I'm pretty new to this but I was blown away. I intend to use or make one for my comm site as a virtual assistant for shopping or my 3d shop in my store. I would love to request if you have a more in-depth tutorial for such avenues, please? I will follow this for now but about instructions, personality feed, and the in-between edits I'd follow this tutorial. Could you add to this if you think it necessary for us common people

  • @ChannelQodequay
    @ChannelQodequay 21 วันที่ผ่านมา +5

    Hey, I've been struggling to get response from AI, after API Key, can u share a tutorial on event set-up. After putting API key, it just dosent respond !!

    • @Feryzal
      @Feryzal 16 วันที่ผ่านมา +1

      I have got the same problem

    • @TashaNicolee
      @TashaNicolee 14 วันที่ผ่านมา +1

      I wasn't able to get it to play either.

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey there, could you check if you have a Credit Balance in your OpenAI developer account and try again.
      You can find more information on the Ai Voice Assistant feature + setup here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U#configuring-an-ai-voice-assistant

    • @lyudmilast2565
      @lyudmilast2565 5 วันที่ผ่านมา +1

      @@splinetool I dont have response also

  • @awin24
    @awin24 หลายเดือนก่อน +3

    Thank you for the tutorials! I did everything as you mentioned and when I press Play there is no response. what am I doing wrong?

    • @vahiddaem
      @vahiddaem หลายเดือนก่อน +2

      same here

    • @splinetool
      @splinetool  หลายเดือนก่อน

      Hi there! Please check that you have an active, paid OpenAI account to enter your API key, verify your microphone settings, and clear your browser cache.
      Let us know if that helps! If you need more assistance, feel free to reach out to us at review@spline.design.

    • @madebypico
      @madebypico 29 วันที่ผ่านมา +2

      Same issue, here is what I tried but the issue persists:
      - 3 different browsers + incognito mode
      - 2 different mic input, tested both mics in OBS
      - Made sure all other audio software was closed
      - Reboot
      - Created 3 different scenes and used suggested template
      - Tried 2 different API keys
      - Waited for the API key to take effect
      The OpenAI key registers a date for when it was used, so it does connect.
      I don't have any ideas left?

    • @madebypico
      @madebypico 29 วันที่ผ่านมา +1

      I got a hunch.
      The voices in Spline are called:
      - Alloy
      - Echo
      - Shimmer
      The voices in openai settings are called:
      - Arbor
      - Ember
      - Spruce
      - Juniper
      - Sol
      - Vale
      - Cove
      - Maple
      - Breeze
      Maybe the voices you have mapped are not available in all countries, I'm based in Europe.

    • @splinetool
      @splinetool  28 วันที่ผ่านมา

      Hello @@madebypico! Check if you have an active OpenAI paid account. You can also try clearing your browser's cache. If you still need assistance, please contact our team at review@spline.design 🙌

  • @erosnolasco4553
    @erosnolasco4553 3 วันที่ผ่านมา

    wow the beginning to robot emotional intelligence

  • @shifatmasud
    @shifatmasud หลายเดือนก่อน +2

    Morph tutorial please 🙏

    • @splinetool
      @splinetool  หลายเดือนก่อน +1

      Noted! 😁

  • @KL-bd1tg
    @KL-bd1tg 25 วันที่ผ่านมา +2

    I followed the video instructions to create an API key on OpenAI, pasted the API key as shown in the video, and enabled microphone permissions, but there’s no response when I speak.

    • @stanislavkrofta7811
      @stanislavkrofta7811 21 วันที่ผ่านมา +1

      Same here.. Did you manage to solve this?

    • @Feryzal
      @Feryzal 15 วันที่ผ่านมา +1

      Ive got the same problem

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey there, you can mention the name of the variable in the instruction parameter in API panel. The Voice Assistant API will understand that it's a variable and work as instructed. Hope this helps! 😊
      You can learn more here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U

    • @TG-Pro.67
      @TG-Pro.67 8 วันที่ผ่านมา

      @@splinetool Same probleme here ! What do you mean by "mention the name of the variable in the instruction parameter in API panel" ? The document does not talks about it... Thank you !

    • @TG-Pro.67
      @TG-Pro.67 8 วันที่ผ่านมา

      Edit : It DOES work. I didn't buy a "developper plan" on chat GPT (different than the current plan)

  • @EV_car2013
    @EV_car2013 ชั่วโมงที่ผ่านมา +1

    How to export to USDZ?

  • @Bonini000
    @Bonini000 18 วันที่ผ่านมา

    Hi, are there options to get text from links in customized ways like a normal “GET” or a customized “POST”?

  • @Noah-bd7bs
    @Noah-bd7bs 20 วันที่ผ่านมา

    is it possible to use elevenlavs voices ? Would be awesome !

  • @designckinet
    @designckinet 25 วันที่ผ่านมา

    Have a problem in the application for the Mac. You need to add the ability to call a voice assistant. It is necessary to allow access to the microphone to the recording, because in the version for the Mac I did not find such an opportunity. And it is desirable to do this automatically, as in Safari. When at the start of Safari asks if it is possible to allow the pop-up window.

  • @sagarbhat7317
    @sagarbhat7317 25 วันที่ผ่านมา +1

    Hi is there a face model available like used in this video? I want the ai assistant to move its mouth when it talks.

    • @splinetool
      @splinetool  15 วันที่ผ่านมา

      Hi there! You can now find the links to the demos ready to duplicate in the video description. We hope you find them useful!

  • @sarcophoguy-x
    @sarcophoguy-x 11 วันที่ผ่านมา +1

    Why does using it cost so much? I ran it in preview for roughly 15 seconds and exchanged less than 20 words, it increased my real-time API by 0.06 - I upgraded to pro for this only to find out it is unusable? Edit: ran it live on my site and it cut itself off three times, had the page up for about 20 seconds, another 6 cents.

  • @chinatyu4778
    @chinatyu4778 11 วันที่ผ่านมา

    Can we have variable support for the AI system prompt?

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey there, you can mention the name of the variable in the instruction parameter in API panel. The Voice Assistant API will understand that it's a variable and work as instructed.
      You can learn more here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U

  • @digitalmarketingroi617
    @digitalmarketingroi617 11 วันที่ผ่านมา

    so cool

  • @rusydamulayyana37
    @rusydamulayyana37 19 วันที่ผ่านมา

    Does voice interaction still can be use after we embed this 3D character on our frame website?

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey, yes, you can embed using Spline Viewer and have the Voice Assistant API working,. The website will prompt to allow microphone access.

  • @jsizzle_
    @jsizzle_ 19 วันที่ผ่านมา

    Is it possible to make the scale variable less dramatic when the assistant is speaking? I tried using "0.25 + AI Voice Spectrum" but that isn't working

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey there, could you share this file with us? We can test it on our end and let you know what we find. You can send it to help@spline.design

  • @stenotest
    @stenotest 20 วันที่ผ่านมา

    would it be possible to get the file used in the tutorial for the first Assistant 3d avatar? I am struggling on creating the floor

    • @splinetool
      @splinetool  15 วันที่ผ่านมา

      Hi! The demo links are now in the video description, ready to duplicate!

  • @designckinet
    @designckinet 25 วันที่ผ่านมา +1

    Awesome idea. But nov it's works like A test Beta. Everything is constantly in bugs. Works badly.

  • @AlexRivera-uj8ie
    @AlexRivera-uj8ie 23 วันที่ผ่านมา

    Is it possible to bring the project to a website with Webflow or WordPress?

    • @splinetool
      @splinetool  21 วันที่ผ่านมา

      Hello! Yes! You can learn more about integrating your Spline projects with WebFlow, WordPress, and other web builders by checking the documentation here: docs.spline.design/

    • @AlexRivera-uj8ie
      @AlexRivera-uj8ie 19 วันที่ผ่านมา

      Thanks!! :D

  • @Web3RealtyLLC
    @Web3RealtyLLC 12 วันที่ผ่านมา

    how come after i exported my agent it wont talk to me??

    • @Web3RealtyLLC
      @Web3RealtyLLC 12 วันที่ผ่านมา

      only in spline it talks to me?

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey there! I would check the microphone permission on your browser. 😊 This could be the issue, hope this helps.

  • @Rensoconese
    @Rensoconese 29 วันที่ผ่านมา

    Can i chat with the character? I want the user to write what they want to ask and the character to respond with voice and text

    • @splinetool
      @splinetool  28 วันที่ผ่านมา +1

      @@Rensoconese currently the voice can only receive voice input. But seems like a possible future improvement.

    • @Rensoconese
      @Rensoconese 27 วันที่ผ่านมา

      @@splinetool Great! If they add the chat feature, they could create an experience like that of a role-playing game. Combined with other Spline features, it could be a game-changer.

  • @robertasumendi
    @robertasumendi 20 วันที่ผ่านมา

    Would love to learn more about moving character's mouth to an audio file rather than AI

  • @designckinet
    @designckinet หลายเดือนก่อน

    How to integrate to iOS app?

    • @splinetool
      @splinetool  หลายเดือนก่อน

      Hi! We have a tutorial focused on how to integrate your Spline designs into iOS.
      You can check it out here 👉 th-cam.com/video/44OPMq7FdD0/w-d-xo.html

    • @designckinet
      @designckinet 29 วันที่ผ่านมา

      @@splinetool I mean if I have AI voice in my iOS app can I integrate that responsive face?

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      @@designckinet Hey again 😊APIs and Webhooks are not supported in IOS or Android Embeds, but noted this is something you would like to see.

  • @creative_one-z6f
    @creative_one-z6f 9 วันที่ผ่านมา

    The bill from openai for realtime API access, is quite steep for this. A few dollars for a new minutes conversation. Ouch.

  • @AngryApple
    @AngryApple 24 วันที่ผ่านมา

    Why the forced OpenAI API? This could have been done with every OpenAI Compatible API with an self hosted LLM or other LLM.

    • @minkeymoo
      @minkeymoo 21 วันที่ผ่านมา

      Mainly because of the real time api limitation, it's taking the text as well as voice, which even tho can be done by a local model, will be really slow, open ai imo has just made it be super fast somehow in their api

  • @BoburMavlonov
    @BoburMavlonov 20 วันที่ผ่านมา +1

    it is not speaking

    • @Feryzal
      @Feryzal 15 วันที่ผ่านมา

      I have the same problem

    • @splinetool
      @splinetool  9 วันที่ผ่านมา

      Hey there, could you check if you have a Credit Balance in your OpenAI developer account and try again.
      You can find more information on the Ai Voice Assistant feature + setup here: docs.spline.design/doc/ai-voice-assistant-api/doczANMXu23U#configuring-an-ai-voice-assistant

  • @Thomsonx
    @Thomsonx 21 วันที่ผ่านมา

    Gross.

  • @davidfitcher2953
    @davidfitcher2953 หลายเดือนก่อน

    7:50 Why is this so childish?

    • @frostimusprime
      @frostimusprime หลายเดือนก่อน +1

      Because they told it to pretend to be Cookie Monster from Sesame Street. A children's tv show.