- 8
- 16 652
Waxolp
เข้าร่วมเมื่อ 20 ต.ค. 2012
Hello! My name is Waxo. I'm a mechanical engineer by day and programmer/gamer by night.
I used to have a ton of videos but I have unlisted them all, sorry fam
I used to have a ton of videos but I have unlisted them all, sorry fam
Unreal Engine 5 Speech Recognition (Sphinx-UE4 Plugin)
You asked for it, so here it is!
Little tutorial on how to use the Sphinx-UE4 Plugin in UE5, for speech recognition! Sorry for the crappy quality, I'm not really equipped for making videos.
Twitter: waxolp
Twitch: www.twitch.tv/waxolp
Links for resources in video:
Instructions: unrealcommunity.wiki/speech-recognition-plugin-yg8mvl5w
Demo Files: nerivec.github.io/old-ue4-wiki/pages/speech-recognition-plugin.html#Demo_Project
Github repo: github.com/ukustra/sphinx-ue4
UE5 doc for how to install plugins: docs.unrealengine.com/5.0/en-US/plugins-in-unreal-engine/
Little tutorial on how to use the Sphinx-UE4 Plugin in UE5, for speech recognition! Sorry for the crappy quality, I'm not really equipped for making videos.
Twitter: waxolp
Twitch: www.twitch.tv/waxolp
Links for resources in video:
Instructions: unrealcommunity.wiki/speech-recognition-plugin-yg8mvl5w
Demo Files: nerivec.github.io/old-ue4-wiki/pages/speech-recognition-plugin.html#Demo_Project
Github repo: github.com/ukustra/sphinx-ue4
UE5 doc for how to install plugins: docs.unrealengine.com/5.0/en-US/plugins-in-unreal-engine/
มุมมอง: 9 718
วีดีโอ
CraveStore Preview AI walking through door to get that yummy banana
มุมมอง 712 ปีที่แล้ว
CraveStore Preview AI walking through door to get that yummy banana
Testing speech recognition with VR and VR mic (Unreal engine 5)
มุมมอง 2.2K2 ปีที่แล้ว
Sorry for the shit quality but my PC is struggling with OBS unreal 4 screens AI speech recognition XD still happy with how the prototype is coming along... sphinx-ue4 / sphinx-ue5 plugin
Speech recognition UE5 test
มุมมอง 4.4K2 ปีที่แล้ว
Testing the sphinx-ue4 / sphinx-ue5 plugin, voice recognition or speech recognition of keywords Ignore the low frame rate, was just debugging and not optimizing :P
It doesn't working for me :/ idk why
this plugin not working after packaging in unreal thnaks
Cyberbullying
Hello, i have a problemI can't get it to work on android, the errors I get are - Source/SpeechRecognition/Public/SpeechRecognition.h(81,16): error: assigning field to itself [-Werror,-Wself-assign-field] Source/SpeechRecognition/Public/SpeechRecognitionWorker.h(3,10): fatal error: 'sphinxbase/err.h' file not found
It did not work for me, is there an example project download for ue5? All examples I found were ue4.
and when we export the game, will it works ? :/ like build the game
I followed every steps but still not work, there is no text come out when I speaked to them😢😢😢
Thanks for the tutorial, I made a new game state and used it with my existing game mode seems to work the same . In the game state I actually didnt configure nothing I changed from the details settings you mentioned the words I want works fine also same as with mannual integration like you did . My issue is I want to use this plug in for words that dont exist in the dictionary . I've added the words to the english en.dic file with the phonetics used by sphinx but it just doesnt recognises it. Any tips how to add new words I could try out for my project ? this is the word I added in the en.dic : lumoss L UW M OW S
I have a bug, I am told: The SpeechRecognition plugin was designed for build 4.9.1 Attempt to load it anyway? i said yes and : The following modules are missing or built with a different engine version I said yes again and : "myproject" could not be compiled try building from souce manually How do I resolve this???
Good to put an AI Assistant inside your game, thats my idea
It's Cool! Also looking forward to you updating your VR game related videos.
Hi! How to set up microphone for speech recognition?
Hi! Can you help me set up?
Hi! How can I check if microphone is connected?
Hi, when changing GameState, the game does not work in the client. Is there any way we can use this plugin without changing GameState? Or can we combine the previous GameState with the SpeechRecognitionState class?
Hi, Waxolp,everything was done according to your process but it didn't work, and I don't know what's wrong. What I would have done if I just wanted to translate what I said.
Always when i press T in UE 5.1.1 Its write me an error.. i put api and all needed.. but its look its cant get my voice or something
hello, does this work on 4.26?
i dont know why it isn't working :(
Really want to try it but i sucks at making stuff in UE😞😞
I have a problem when trying to open a project "could not be compiled try rebuilding from source manually"
hi so when my character is overlaped, when i say go away it does Nothing , what do i do pls?
I'm attempting to add this to my VR game, to help with AI commands, and stuff.
It works when I make a game, but once I build as exe it disappears.
Bump, would like to know this too.
Hey, when I compile, I get an error: Building patch from 1 file(s) for Live coding module C:\Users\iGamer-EPIC\Documents\Unreal Projects\MMORPG\Plugins\SpeechRecognition\Binaries\Win64\UnrealEditor-SpeechRecognition.dll Could not spawn process C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.34.31933\bin\HostX64\x64\link.exe. Error: 267
we cannot build ? Did you figure it out ?
@@Hotberginaa nah
It works in ue 5?
yes!
You just gave us the greatest tool to make an epic Global Game Jam 2023 entry, thank you from the Support Squad <3
Let me know how it goes!
I copied the code exactly as shown in the video, but when I test it I can't get anything to print verifying it understood what I said. I'm also not getting any errors. The only thing I can think of that may have caused an issue is that when I tried extracting the files it gave me an error saying "The same volume can not be used as both the source and destination" so I extracted it into a different drive and dragged the English model over(it was the only on that extracted) and followed the steps from there. Sorry that's alot but if anyone has any idea what I did wrong I'd appreciate it.
finally fixed the issue, it WAS an issue with the model. I had to install the premade version just to copy over the models into my game and it FINALLY worked. Man I thought I was going nuts.
@@christianbellamy8726 haha happy it worked man! Thanks for letting us know in case others have similar issues!
@@Waxolp yeah fs, I didn't want to delete it in case someone else started goin through my troubles lol
To anyone getting the "The same volume can not be used as both the source and destination" error and unable to extract any of the files, try using 7-zip to extract it. I was able to extract everything when once I finally used it.
Hi, I rebooted the UE5 project after placing both the SpeechRecognition folder and the model folder in their places, but with the following error: "Missing myproject Modules The following modules are missing or built with a different engine version: SpeechRecognition Would you like to rebuild them now?" . There are two options: yes and no. After I click yes, error still appears: "myproject could not be compiled. Try rebuilding from source manually." Could you please tell me how to solve it? (I use a Macbook pro M1 pro, UE 5.0.1, and "myproject" is myproject name)🥲🥲🥲
That's because the version of UE5 you are using is lower than the version of the plugin, make sure you have the same version that the plugin supports.
I can't seem to get anything from any "Bind event to" Node, no debug is printing at all. This is also true no matter the word or tolerance. I'm pretty certain my mic is working because I also have proximity voice chat working in the game. Any ideas? I followed this tutorial more or less to the letter in version 5.1.
Do you see all the other nodes? If so, that means at least the plugin is installed. If not, I would redo those steps. If you have the Speech Recognition Subsystem node, did you try pulling off that one to get the "Bind Event To" Node? Make sure you also have the GameState properly set in the project properties!
Plugin is installed, I have the subsystem node and Bind event to on Words Spoken. Project properties is set up same as tutorial. Is there anything else possibly simple I am missing, After creating an actor with Bind word spoken event I am just dropping it into my scene. Is there maybe some box I haven't checked to initialise the code in the scene or something?
Hey! I liked this video! this is something I had been looking for, and you did an awesome job of explaining the whole setup and the various nodes! I appreciate the video, and I'll be checking back in on your YT in case you find any more of these cool niche goodies!
Thanks man! Appreciate the comment! Currently building a new PC so I can develop more with VR, my current PC is really struggling. Hopefully I'll have more cool things to share soon! :)
@@Waxolp I'm tryin to get it to work on the quest 2, but when I'm launching it, I'm getting a plugin error, I did what it said in the documentation, but what all did you have to do to get that to work?
@@SicoSiber Oof, good question. I only tried it with my Vive, so to be honest I don't know how to help. Can you try just running it without a VR pawn, maybe just in 1st or 3rd person?
@@Waxolp I got it working with first and third person, the plugin is just on the struggle bus when I try to export it, but it just might not support android yet 🤷♂ Thanks for the info though, and keep up the good work!
cool stuff
Thank you so much!
Can you use this as well for speech recognition with a metahuman
Sure.. the plugin works as a stand-alone. You can use the events generated from the speech recognition to trigger anything, including interactions with metahumans. You just need to refactor the code to work how you want
Thanks for the upload, would appreciate a higher resolution than 360p tho.
That's weird, you should be able to have 1080p...
@@Waxolp I'm only getting 360p. Tried in two browsers.
@@WolfsdenxD Yeah don't know! I tried in Incognito mode and I still see all the qualities up to 1080 :s
Omg I'm so glad to this video is uploaded😇 thanks for your kindness
Got it working! Thank you so much!
Brilliant stuff! I look forward to trying this out soon, thanks alot!
How accurate is the plugin? Has anyone else here used the sphinx plugin?
This is dope. I'm currently working on my own VR game. And i want to implement somthing similair. Generating weapons based on voice commands. Great stuff👍
Genuinely interested in how to get this set up, something i've been keeping an eye on for a while and would love to try and implement!
Just uploaded a tutorial!
bro how to implement this please make a detailed video
I'll be doing a video tutorial next month, after my wedding! stay tuned
@@Waxolp Waiting for you tutorial, especially about the UE5 engine!
@@zaclyu9644 Just came back from my honeymoon! Will try to work on it asap, lots of people interested :)
@@zaclyu9644 Tutorial is now uploaded!
Just uploaded a tutorial, let me know how it goes!
OMG I need to do this ! this is amazing !!
"Jee fine, no need to yell!"
Hey! I watched your Unreal Voice Recognition videos and tried using the plugin but didn't get it. If you can make a tutorial it would help a lot! Thanks
does this work with andriod or quest? I don't think so I am having some issues with packaging.
Wouldn't be able to tell you honestly, I was only able to test it with the Vive !
@@Waxolp are you able to package the build for vive, ok i believe vive is windows
@@ssshammi hello, did you check? Does the plugin support android - quest?
The package was successful but it did not work on android
teach me how to add the plugin to unreal engine 5 plz
how to add the plug into unreal engine 5
Just uploaded a tutorial!
good stuff