Sold! I followed your video and was able to get it working in 15 minutes! Crazy. Now ... to save the conversation, pass it to a n8n workflow, process it to generate a custom dataset, upsert to a vector store and bingo ... an AI automated survey monster ... this is nuts :)
@@sitedev glad to see you got it working yea it is expensive indeed. I suspect it will come down in pricing soon. can't imagine stringing a combination of other apis vs a single endpoint competing
Do you thint it would be possible to control the UI of the bubble app using this with function calling maybe changing the UI custom states? Would you be able to do a tutorial on this? I think that could change the way users can interact with an app
@@dalipkashyap2129 the realtime api is definitely quite new So it is slowly being rolled out Do you have credit topped up in your openAI account or not?
Great presentation, congrats! I have a question, I've followed similar tutorials that were demonstrated in version-test, which worked for me, but then I pushed to live and my browsers did not allow me to use the plugins for audio recordings. Have you faced this challenge?
@@diegosandoval7462 On a paid plan and when plugins have been purchased, they work on live fine. Sometimes there are api keys for test vs live side. But we've got lots of apps with plugins on live all functioning ok
Amazing! Is using this plugin the only way? Not concerned about data going through a third party for security or confidentiality?Have you tried with the mobile bubble feature ?
I'm afraid the realtime api uses web sockets Can't do this in bubble directly. Even if we use a custom plugin built purely in bubble, that plugin will leak the api key to the public So 3rd party streaming server is the way to go. Totally understand the concerns for security/confidentiality and don't really have an answer for it atm. I wish it was easy to have a lambda script with steps so I could host my own 3rd party streaming server without worry. but I suspect this stuff is complicated..
@@zubair_nocode that makes sense and the plugin creator seems legit :). Have you tried this plugin and real time voice chat with a mobile app? Thanks again!
@@sunny-g3i4o yes the cost is high I'm sure it will come down in time. And at the moment I only see being able to pass the prompt. But there is function calling. So in due time it will get easier to connect it to a vector store. Atm, using function calling it'll be possible but quite hard
@@TLCMEDIA1 the cost of the tokens while talking for a minute? That is a bit high. I don't have exact numbers otoh If you'd like us to build something for you, sure. Get in touch using the link in the description
Bro, nice work. Helped me a lot while making my project.
This is absolutely insane. I didn't think someone would have a plugin stable enough this quick.
I know! The community is awesome!
This is amazing... was waiting for this... thanks for hearing the request..
No problem. Happy to help :)
Great video my friend! Would love to see you do a video on some cool things we could do through triggering workflows from these conversations!
@@drewarensberg3162 it does support tools so should be able to catch them and call workflows with it
Exciting stuff indeed
Sold! I followed your video and was able to get it working in 15 minutes! Crazy. Now ... to save the conversation, pass it to a n8n workflow, process it to generate a custom dataset, upsert to a vector store and bingo ... an AI automated survey monster ... this is nuts :)
Ooohhh. It’s expensive (tokens).
@@sitedev glad to see you got it working
yea it is expensive indeed. I suspect it will come down in pricing soon.
can't imagine stringing a combination of other apis vs a single endpoint competing
Do you thint it would be possible to control the UI of the bubble app using this with function calling maybe changing the UI custom states? Would you be able to do a tutorial on this? I think that could change the way users can interact with an app
@@guillaume6761 I literally built something like that yesterday. Video is editing at the moment
@zubair_nocode excellent. Looking forward. Thanks for leading this topic!
@@zubair_nocode Will you finally release that video?
Fan hogay apka sir
Awesome! What did you use for the waveform animation at the beginning of the video?
@@backchat-ai I think it was a Lottie file and not linked with actual audio waveform
😮😮😮😮 OMG 😳😳😳 WOWWWW
Indeed. I was surprised to see it turned out to be a 12 minute video.
I initially thought it would take 20 minutes at least
Your organization does not have access to the Realtime API. We're in the process of rolling out to all developers.
Getting this error please help
@@dalipkashyap2129 the realtime api is definitely quite new
So it is slowly being rolled out
Do you have credit topped up in your openAI account or not?
Can I do without the plug in?
Can I integrate this in flutter flow
@@abhishekreignsfitness9814 I don't see why not. This video covers bubble though
Great presentation, congrats! I have a question, I've followed similar tutorials that were demonstrated in version-test, which worked for me, but then I pushed to live and my browsers did not allow me to use the plugins for audio recordings. Have you faced this challenge?
@@diegosandoval7462
On a paid plan and when plugins have been purchased, they work on live fine.
Sometimes there are api keys for test vs live side.
But we've got lots of apps with plugins on live all functioning ok
Amazing! Is using this plugin the only way? Not concerned about data going through a third party for security or confidentiality?Have you tried with the mobile bubble feature ?
I'm afraid the realtime api uses web sockets
Can't do this in bubble directly.
Even if we use a custom plugin built purely in bubble, that plugin will leak the api key to the public
So 3rd party streaming server is the way to go.
Totally understand the concerns for security/confidentiality and don't really have an answer for it atm. I wish it was easy to have a lambda script with steps so I could host my own 3rd party streaming server without worry.
but I suspect this stuff is complicated..
@@zubair_nocode that makes sense and the plugin creator seems legit :). Have you tried this plugin and real time voice chat with a mobile app? Thanks again!
awesome video but cost is too high, its 30 cents per min , is there any way to pass assistant(with prompt) train on custom data in real time api?
@@sunny-g3i4o yes the cost is high
I'm sure it will come down in time.
And at the moment I only see being able to pass the prompt.
But there is function calling. So in due time it will get easier to connect it to a vector store.
Atm, using function calling it'll be possible but quite hard
@@zubair_nocode thanks for reply :)
@@zubair_nocode could you please make advanced version of this video where we can get answer from our custom data?
Amazing, how much did that cost you? I think it’s something that we need to talk about too
@@TLCMEDIA1 the cost of the tokens while talking for a minute?
That is a bit high. I don't have exact numbers otoh
If you'd like us to build something for you, sure.
Get in touch using the link in the description