Unreal Engine 5 Speech Recognition (Sphinx-UE4 Plugin)

แชร์
ฝัง
  • เผยแพร่เมื่อ 4 ธ.ค. 2022
  • You asked for it, so here it is!
    Little tutorial on how to use the Sphinx-UE4 Plugin in UE5, for speech recognition! Sorry for the crappy quality, I'm not really equipped for making videos.
    Twitter: / waxolp
    Twitch: / waxolp
    Links for resources in video:
    Instructions: unrealcommunity.wiki/speech-r...
    Demo Files: nerivec.github.io/old-ue4-wik...
    Github repo: github.com/ukustra/sphinx-ue4
    UE5 doc for how to install plugins: docs.unrealengine.com/5.0/en-...
  • เกม

ความคิดเห็น • 52

  • @H1JaX
    @H1JaX ปีที่แล้ว +1

    Brilliant stuff! I look forward to trying this out soon, thanks alot!

  • @LiitonZZ
    @LiitonZZ 9 หลายเดือนก่อน +1

    It's Cool! Also looking forward to you updating your VR game related videos.

  • @H1JaX
    @H1JaX ปีที่แล้ว +1

    Got it working! Thank you so much!

  • @VoicesFromTheDark
    @VoicesFromTheDark ปีที่แล้ว

    You just gave us the greatest tool to make an epic Global Game Jam 2023 entry, thank you from the Support Squad

    • @Waxolp
      @Waxolp  ปีที่แล้ว

      Let me know how it goes!

  • @iwt7099
    @iwt7099 ปีที่แล้ว

    Omg I'm so glad to this video is uploaded😇 thanks for your kindness

  • @Alexei-im6dq
    @Alexei-im6dq ปีที่แล้ว

    Thank you so much!

  • @chinccw4529
    @chinccw4529 ปีที่แล้ว

    cool stuff

  •  10 หลายเดือนก่อน

    Hi, when changing GameState, the game does not work in the client. Is there any way we can use this plugin without changing GameState? Or can we combine the previous GameState with the SpeechRecognitionState class?

  • @wolfsdendogsanctuary731
    @wolfsdendogsanctuary731 ปีที่แล้ว

    Thanks for the upload, would appreciate a higher resolution than 360p tho.

    • @Waxolp
      @Waxolp  ปีที่แล้ว

      That's weird, you should be able to have 1080p...

    • @wolfsdendogsanctuary731
      @wolfsdendogsanctuary731 ปีที่แล้ว

      @@Waxolp I'm only getting 360p. Tried in two browsers.

    • @Waxolp
      @Waxolp  ปีที่แล้ว

      @@wolfsdendogsanctuary731 Yeah don't know! I tried in Incognito mode and I still see all the qualities up to 1080 :s

  • @susannaalan9780
    @susannaalan9780 9 หลายเดือนก่อน

    Hi! How to set up microphone for speech recognition?

  • @user-nn3rk9fx6h
    @user-nn3rk9fx6h ปีที่แล้ว

    Hi, I rebooted the UE5 project after placing both the SpeechRecognition folder and the model folder in their places, but with the following error: "Missing myproject Modules The following modules are missing or built with a different engine version:
    SpeechRecognition
    Would you like to rebuild them now?" . There are two options: yes and no. After I click yes, error still appears: "myproject could not be compiled. Try rebuilding from source manually." Could you please tell me how to solve it? (I use a Macbook pro M1 pro, UE 5.0.1, and "myproject" is myproject name)🥲🥲🥲

  • @susannaalan9780
    @susannaalan9780 9 หลายเดือนก่อน

    Hi! How can I check if microphone is connected?

  • @DemianWeaver
    @DemianWeaver ปีที่แล้ว

    I have a problem when trying to open a project
    "could not be compiled try rebuilding from source manually"

  • @nessieloch5564
    @nessieloch5564 3 หลายเดือนก่อน

    and when we export the game, will it works ? :/ like build the game

  • @Kanermi
    @Kanermi หลายเดือนก่อน +1

    Hello, i have a problemI can't get it to work on android, the errors I get are -
    Source/SpeechRecognition/Public/SpeechRecognition.h(81,16): error: assigning field to itself [-Werror,-Wself-assign-field]
    Source/SpeechRecognition/Public/SpeechRecognitionWorker.h(3,10): fatal error: 'sphinxbase/err.h' file not found

  • @SicoSiber
    @SicoSiber ปีที่แล้ว +2

    Hey! I liked this video! this is something I had been looking for, and you did an awesome job of explaining the whole setup and the various nodes! I appreciate the video, and I'll be checking back in on your YT in case you find any more of these cool niche goodies!

    • @Waxolp
      @Waxolp  ปีที่แล้ว +1

      Thanks man! Appreciate the comment! Currently building a new PC so I can develop more with VR, my current PC is really struggling. Hopefully I'll have more cool things to share soon! :)

    • @SicoSiber
      @SicoSiber ปีที่แล้ว +1

      @@Waxolp I'm tryin to get it to work on the quest 2, but when I'm launching it, I'm getting a plugin error, I did what it said in the documentation, but what all did you have to do to get that to work?

    • @Waxolp
      @Waxolp  ปีที่แล้ว +1

      @@SicoSiber Oof, good question. I only tried it with my Vive, so to be honest I don't know how to help. Can you try just running it without a VR pawn, maybe just in 1st or 3rd person?

    • @SicoSiber
      @SicoSiber ปีที่แล้ว +1

      @@Waxolp I got it working with first and third person, the plugin is just on the struggle bus when I try to export it, but it just might not support android yet 🤷‍♂
      Thanks for the info though, and keep up the good work!

  • @VirtualRealityHub
    @VirtualRealityHub ปีที่แล้ว

    Always when i press T in UE 5.1.1 Its write me an error.. i put api and all needed.. but its look its cant get my voice or something

  • @user-wn9vu6nz4k
    @user-wn9vu6nz4k 3 หลายเดือนก่อน

    It did not work for me, is there an example project download for ue5? All examples I found were ue4.

  • @jessyofficiel9632
    @jessyofficiel9632 8 หลายเดือนก่อน

    I have a bug, I am told: The SpeechRecognition plugin was designed for build 4.9.1 Attempt to load it anyway?
    i said yes and : The following modules are missing or built with a different engine version
    I said yes again and : "myproject" could not be compiled try building from souce manually
    How do I resolve this???

  • @metalbor
    @metalbor ปีที่แล้ว

    hello, does this work on 4.26?

  • @REALVIBESTV
    @REALVIBESTV ปีที่แล้ว

    Can you use this as well for speech recognition with a metahuman

    • @Waxolp
      @Waxolp  ปีที่แล้ว

      Sure.. the plugin works as a stand-alone. You can use the events generated from the speech recognition to trigger anything, including interactions with metahumans. You just need to refactor the code to work how you want

  • @KalistosGaming
    @KalistosGaming 7 หลายเดือนก่อน

    Thanks for the tutorial, I made a new game state and used it with my existing game mode seems to work the same . In the game state I actually didnt configure nothing I changed from the details settings you mentioned the words I want works fine also same as with mannual integration like you did . My issue is I want to use this plug in for words that dont exist in the dictionary . I've added the words to the english en.dic file with the phonetics used by sphinx but it just doesnt recognises it. Any tips how to add new words I could try out for my project ? this is the word I added in the en.dic : lumoss L UW M OW S

  • @Millu30
    @Millu30 ปีที่แล้ว

    Really want to try it but i sucks at making stuff in UE😞😞

  • @finfamous2546
    @finfamous2546 ปีที่แล้ว

    I can't seem to get anything from any "Bind event to" Node, no debug is printing at all. This is also true no matter the word or tolerance. I'm pretty certain my mic is working because I also have proximity voice chat working in the game. Any ideas? I followed this tutorial more or less to the letter in version 5.1.

    • @Waxolp
      @Waxolp  ปีที่แล้ว

      Do you see all the other nodes? If so, that means at least the plugin is installed. If not, I would redo those steps. If you have the Speech Recognition Subsystem node, did you try pulling off that one to get the "Bind Event To" Node? Make sure you also have the GameState properly set in the project properties!

    • @finfamous2546
      @finfamous2546 ปีที่แล้ว

      Plugin is installed, I have the subsystem node and Bind event to on Words Spoken. Project properties is set up same as tutorial. Is there anything else possibly simple I am missing, After creating an actor with Bind word spoken event I am just dropping it into my scene. Is there maybe some box I haven't checked to initialise the code in the scene or something?

  • @rnjt8960
    @rnjt8960 6 หลายเดือนก่อน

    I followed every steps but still not work, there is no text come out when I speaked to them😢😢😢

  • @flysen
    @flysen ปีที่แล้ว

    Hey, when I compile, I get an error: Building patch from 1 file(s) for Live coding module C:\Users\iGamer-EPIC\Documents\Unreal Projects\MMORPG\Plugins\SpeechRecognition\Binaries\Win64\UnrealEditor-SpeechRecognition.dll
    Could not spawn process C:\Program Files\Microsoft Visual Studio\2022\Community\VC\Tools\MSVC\14.34.31933\bin\HostX64\x64\link.exe. Error: 267

    • @nessieloch5564
      @nessieloch5564 15 วันที่ผ่านมา

      we cannot build ? Did you figure it out ?

    • @flysen
      @flysen 15 วันที่ผ่านมา

      @@nessieloch5564 nah

  • @christianbellamy8726
    @christianbellamy8726 ปีที่แล้ว +1

    I copied the code exactly as shown in the video, but when I test it I can't get anything to print verifying it understood what I said. I'm also not getting any errors. The only thing I can think of that may have caused an issue is that when I tried extracting the files it gave me an error saying "The same volume can not be used as both the source and destination" so I extracted it into a different drive and dragged the English model over(it was the only on that extracted) and followed the steps from there. Sorry that's alot but if anyone has any idea what I did wrong I'd appreciate it.

    • @christianbellamy8726
      @christianbellamy8726 ปีที่แล้ว +1

      finally fixed the issue, it WAS an issue with the model. I had to install the premade version just to copy over the models into my game and it FINALLY worked. Man I thought I was going nuts.

    • @Waxolp
      @Waxolp  ปีที่แล้ว +1

      @@christianbellamy8726 haha happy it worked man! Thanks for letting us know in case others have similar issues!

    • @christianbellamy8726
      @christianbellamy8726 ปีที่แล้ว +1

      @@Waxolp yeah fs, I didn't want to delete it in case someone else started goin through my troubles lol

    • @j_mokusei
      @j_mokusei 3 หลายเดือนก่อน

      To anyone getting the "The same volume can not be used as both the source and destination" error and unable to extract any of the files, try using 7-zip to extract it. I was able to extract everything when once I finally used it.

  • @boyce-wei
    @boyce-wei ปีที่แล้ว

    Hi, Waxolp,everything was done according to your process but it didn't work, and I don't know what's wrong.
    What I would have done if I just wanted to translate what I said.

  • @sterlydolce
    @sterlydolce 8 หลายเดือนก่อน

    Good to put an AI Assistant inside your game, thats my idea

  • @Neutromex
    @Neutromex ปีที่แล้ว

    i dont know why it isn't working :(

  • @user-xb1jc7lf8x
    @user-xb1jc7lf8x 6 หลายเดือนก่อน

  • @hata_0
    @hata_0 ปีที่แล้ว

    It works when I make a game, but once I build as exe it disappears.

    • @hypnotiqo
      @hypnotiqo ปีที่แล้ว

      Bump, would like to know this too.

  • @nekit5294
    @nekit5294 ปีที่แล้ว

    It works in ue 5?

    • @Waxolp
      @Waxolp  ปีที่แล้ว

      yes!