Adding custom characters depend on different platforms. If you are looking at interactive canvas for Google assistant, it's completely up to you. If you want to integrate with Dialogflow and other 3D platforms as shown in video then you need to check if they support. Last time I checked, they had their own set of 3D characters. Alternatively you can build your own solution using Dialogflow APIs and your set of solution to map the conversation to a 3D character. Hope this helps. All the best. 🙂👍
@@techwithsach After watching your video I have integrated really fast dialogflow with uneeq. And as you asked in your video. I have found another solution that can integrate with dialogflow: embodydigital.com/expertaidocumentation/
hi Sachin I have a question can we integrate this avatar to our gpt trained model and on the basis of of our gpt output we can deliver content through avatar to the end user pls let me know this
@@techwithsach the content was very detailed and thank you for that , ... but I have a question : is there any possibility to do all the design on your own computer , offline usage and having a similar software on your desk ... because I made a demo A.I assistant offline but I need to make it more real , with a 3D digital model of it ... still working on it any advice would be priceless ! Thanks again for the content .
I thought about creating the 3D model using unity then later try using A.I to do the simulation, ... do you have a discord or any social group to solving this kinda problems that would be helpful
Bro all your videos as very informative Im very happy to find you on TH-cam, but I would like to ask you about how can I export the avatar created and integrate elsewhere such as Wordpress or any other type of website, html pages and so on ?
Thanks for the easiest explanation brother, I have built the bot using DialogFlow and also integrated with UnneQ using project ID and .json key, while testing my agent doesn’t talk back ! Should I enable billing in GCP?
Hi Karthi, thank you. You can look at the logs to see what exactly is the issue. You can also enable billing which could also be one of the reasons. If you are testing, enable it with the free GCP credits and don't forget to close or delete the project once you are done with the testing. Hope this helps. All the best. 🙂
Hi Sach, I tried to follow the tutorial to construct a bot in German, I did a pretty simple "Hallo" using Dialogflow CX and connected to the platform, However when I set the project number, the language and provide the key, the digital human is not able to use the chat created in dialogflow in German... any Idea?
Hi, I haven't tried this but in the meantime check if the Digital Humans platform supports Dialogflow CX. There is a difference between the APIs for Dialogflow ES and CX.
sir, In my research I want to make a digital assistant for kids between 3 to 8 years old covering , 1. Story Telling 2. Secure Internet surfing/ Dictionary support 3. If necessary contact parents, for example, if the kid looks unwell or.... 4. Companion to work with. 5. Education Guide. (Actually, I am not interested on this.) 6. Identify the mood/ or condition with facial recognition or with heart beet or any other mechanism. 7. Improve politeness during the dialogues. 8. Activity Scheduler/ Planner/ Programmer. So I want to know using dialogflow, can I achieve it? And also can you please tell me how to do it and give a fine product.
Hi Sachin, as you said in the video that we could create digital avatar for own. Can you tell me how we can do that considering our own js based web and mobile (React native or hybrid)?
Hi, not sure about this. However, due to a lot of interest from the community, there is a plan to create a tutorial series on how you can build your own. Will try to build and bring you these contents soon. Stay tuned! 🙂👍
Hi Sachin. Are there any open source tools that can make a digital human chatbot? Of course the quality won't be as good, but I'm just looking for something that works decently well enough. I myself have experimented with several deep learning algorithms, but they all inadvertently have some artefacts - like blur, glitches in movements, etc. But the bigger problem is the time taken to generate the video because it is an intensive process that uses 4 different AI models, broadly speaking - a text-to-speech AI to convert the input text into audio, an AI model to generate the avatar frontend and convert it into a video, an AI model to lip-sync the audio with the avatar to make it appear as if it's speaking the words, and finally another AI model to smoothen out the video to reduce the glitches. So, doing all these takes a few minutes for each chat prompt in my local machine with 1 GPU, and maybe 20-30 seconds when hosted in cloud with a powerful GPU. That's still not fast enough though - it needs to come down to the order of 1 second to produce the output, so that it is practical as a chatbot, right? So, I was just wondering if you have any pointers.
Hi Prashant, it depends on your use-case. What I experimented with is using a 3D model in Unity and using Lip sync along with calling APIs for Chatbot like Dialogflow etc. In this way, your 3D model can behave as your virtual assistant. I do plan on making a tutorial or a walkthrough soon. I hope this helps or gives you some directions. In the meantime, am sure within a short period of time, the use case you are looking for will be easy to implement. All the best.
Hi, I want to get location data from WhatsApp into the dialogflow. I m unable to get the location when I send google map location to my bot. Bot do not detect anything. Could you help me with it.
@@techwithsach can you please make a video how to do it bcs I tried to find a lot of videos on TH-cam and blogs but none were working , can you please make a video how to integrate dialogueflow with unity so it would be very great and helpful for me and every one 😊😊😊
Sir i m creating a virtual assistant app for phone. , And i want to add digital human in my application , so that user get more interactive environment , how can i do this plz help sir
HI, some of those tools already have web integration. Make sure to check the pricing etc. However, you can always be creative and build your own as well. 🙂
Sir dialogue flow and all the other platforms that are used in this video is not free, please suggest a free platform to use their services. Because I really want to incorporate this into my app.
@@techwithsach I'm so excited! I've been searching on TH-cam for a while now, but I couldn't find anything until I stumbled upon your video. I can't wait to see it!
Hi Praveen, you can choose the inbuilt ones. If you want to add custom voice, you will have to have your own implementation and pass the audio as the response in your api calls. All the best. 🙂
Hi Akhil, you should be able to easily add it using the integrations option. However, will try to cover these again in the future videos. Thanks for the suggestion. 👍
Hi, not sure what exactly are you are referring to. However, if you are talking about the webhook and backend logic, yes you can integrate it with your programming language of your choice.
Yes, you can achieve this using unity. I will be releasing a video in the new year showcasing the basics for you to build your own digital avatars. In the meantime, you can also call the Dialogflow APIs and connect it with a 3D Model.
@@techwithsach do you think it is possible to connect an avatar in .fbx format, without using unity? (I have read that one option would be to transform it into json).
Sir I am strived to did a video specific on this topic for two years finally I got and I am thankful to you. 🤗
I also have a question that can I add my own custom made 3d character
Thank you Jitender. Glad you found it useful 🙂
Adding custom characters depend on different platforms. If you are looking at interactive canvas for Google assistant, it's completely up to you. If you want to integrate with Dialogflow and other 3D platforms as shown in video then you need to check if they support. Last time I checked, they had their own set of 3D characters. Alternatively you can build your own solution using Dialogflow APIs and your set of solution to map the conversation to a 3D character. Hope this helps. All the best. 🙂👍
You're GREAT. Thank you for this tutorial!
Thank you so much. 🙂
Great video Sach!!
Thanks David! 👍🙂
@@techwithsach After watching your video I have integrated really fast dialogflow with uneeq. And as you asked in your video. I have found another solution that can integrate with dialogflow: embodydigital.com/expertaidocumentation/
Great David! Happy to see you got it integrated quickly. Thanks for the suggestion and will definitely check out. 👍
Amazing video. Please bring more tutorials on how to make such 3D Assistants from scratch.
Thanks a ton. Sure. More tutorials to follow soon. Stay tuned!
hi Sachin I have a question can we integrate this avatar to our gpt trained model and on the basis of of our gpt output we can deliver content through avatar to the end user pls let me know this
I liked the video before it starts because of the peaceful music in the beginning
Thanks Nasser, hope you found content was useful as well. 🙂
@@techwithsach the content was very detailed and thank you for that , ... but I have a question : is there any possibility to do all the design on your own computer , offline usage and having a similar software on your desk ... because I made a demo A.I assistant offline but I need to make it more real , with a 3D digital model of it ... still working on it any advice would be priceless !
Thanks again for the content .
I thought about creating the 3D model using unity then later try using A.I to do the simulation, ... do you have a discord or any social group to solving this kinda problems that would be helpful
Bro all your videos as very informative Im very happy to find you on TH-cam, but I would like to ask you about how can I export the avatar created and integrate elsewhere such as Wordpress or any other type of website, html pages and so on ?
I am facing a lot of problems in the interview so where can I go and learn all of the things in Google dialogflow can you please help me?
Thanks for the easiest explanation brother, I have built the bot using DialogFlow and also integrated with UnneQ using project ID and .json key, while testing my agent doesn’t talk back ! Should I enable billing in GCP?
Hi Karthi, thank you. You can look at the logs to see what exactly is the issue. You can also enable billing which could also be one of the reasons. If you are testing, enable it with the free GCP credits and don't forget to close or delete the project once you are done with the testing. Hope this helps. All the best. 🙂
Hi Sach, I tried to follow the tutorial to construct a bot in German, I did a pretty simple "Hallo" using Dialogflow CX and connected to the platform, However when I set the project number, the language and provide the key, the digital human is not able to use the chat created in dialogflow in German... any Idea?
Hi, I haven't tried this but in the meantime check if the Digital Humans platform supports Dialogflow CX. There is a difference between the APIs for Dialogflow ES and CX.
sir, In my research I want to make a digital assistant for kids between 3 to 8 years old covering ,
1. Story Telling
2. Secure Internet surfing/ Dictionary support
3. If necessary contact parents, for example, if the kid looks unwell or....
4. Companion to work with.
5. Education Guide. (Actually, I am not interested on this.)
6. Identify the mood/ or condition with facial recognition or with heart beet or any other mechanism.
7. Improve politeness during the dialogues.
8. Activity Scheduler/ Planner/ Programmer.
So I want to know using dialogflow, can I achieve it? And also can you please tell me how to do it and give a fine product.
what is your budget :)
I would love to see a tutorial on singularity net
I would love to see a tutorial on how to make an digital human from scratch without relying on Uneeq and such
This will be a tutorial series by itself. Something I can look into if more people are interested in the same. 👍🙂
@@techwithsach Interested.
Intrested too
@@techwithsach Interested
@@CeroCool212004interested
Hi Sachin, as you said in the video that we could create digital avatar for own. Can you tell me how we can do that considering our own js based web and mobile (React native or hybrid)?
I have a question, are there other free web sites to give us to posibility to program 3d humnans? ... thanks for the answer ...
Hi, not sure about this. However, due to a lot of interest from the community, there is a plan to create a tutorial series on how you can build your own. Will try to build and bring you these contents soon. Stay tuned! 🙂👍
Hi Sachin. Are there any open source tools that can make a digital human chatbot? Of course the quality won't be as good, but I'm just looking for something that works decently well enough.
I myself have experimented with several deep learning algorithms, but they all inadvertently have some artefacts - like blur, glitches in movements, etc. But the bigger problem is the time taken to generate the video because it is an intensive process that uses 4 different AI models, broadly speaking - a text-to-speech AI to convert the input text into audio, an AI model to generate the avatar frontend and convert it into a video, an AI model to lip-sync the audio with the avatar to make it appear as if it's speaking the words, and finally another AI model to smoothen out the video to reduce the glitches. So, doing all these takes a few minutes for each chat prompt in my local machine with 1 GPU, and maybe 20-30 seconds when hosted in cloud with a powerful GPU. That's still not fast enough though - it needs to come down to the order of 1 second to produce the output, so that it is practical as a chatbot, right? So, I was just wondering if you have any pointers.
Hi Prashant, it depends on your use-case. What I experimented with is using a 3D model in Unity and using Lip sync along with calling APIs for Chatbot like Dialogflow etc. In this way, your 3D model can behave as your virtual assistant. I do plan on making a tutorial or a walkthrough soon. I hope this helps or gives you some directions. In the meantime, am sure within a short period of time, the use case you are looking for will be easy to implement. All the best.
@@techwithsach please make it, i would like to learn that
@@techwithsach Did you do this tutorial?? :)
Thank you for the well explained video. Do you have tutorial to create chatbot in unity3d?
Thank you so much. I do plan on doing one. Stay tuned! It is definitely in the pipeline as I can see more interest in this. 🙂
Thank you very much
Thank you.
Hi, I want to get location data from WhatsApp into the dialogflow. I m unable to get the location when I send google map location to my bot. Bot do not detect anything. Could you help me with it.
am intrested in the build from scratch
I could not able to login and signup for creator please give me guidance
how to integrate chat bot with unity ,can you pls tell me
Hi Akaash, it can be done using the Dialogflow API. 🙂
@@techwithsach can you please make a video how to do it bcs I tried to find a lot of videos on TH-cam and blogs but none were working , can you please make a video how to integrate dialogueflow with unity so it would be very great and helpful for me and every one 😊😊😊
Sir & how can we make it??
Could you make videos on Dialogflow cx in depth?
Excellent suggestion Shiva. I am already planning a series based on Dialogflow CX. Stay tuned! 🙂
Sir how can make the mic automatic on when user say commend thank
Sir can we use it in android studio ?
HI, can you be little more specific so I can understand the request. Also point to which part within the video that you are referring to. Thank you. 🙂
Sir i m creating a virtual assistant app for phone. , And i want to add digital human in my application , so that user get more interactive environment , how can i do this plz help sir
Sir this is great.. But sir if we created a digital human how we can put it to web so that everyone can use it.. please help with that sir.
HI, some of those tools already have web integration. Make sure to check the pricing etc. However, you can always be creative and build your own as well. 🙂
Sir dialogue flow and all the other platforms that are used in this video is not free, please suggest a free platform to use their services. Because I really want to incorporate this into my app.
How to add audio2face lipsync animation in flutter apps
Yes I wouls love to know how we can build something like this been looking for ideas on how to build one
One of the videos lined up for the new year Jan 2023. Stay tuned 🙂
@@techwithsach I'm so excited! I've been searching on TH-cam for a while now, but I couldn't find anything until I stumbled upon your video. I can't wait to see it!
sir koi software android k liey jo fully human ho jo b command dy usy kary
i want to build something like this from scratch plzz
guide me
How can I reach you directly?
How can we add custom voice in dialogflow?
Hi Praveen, you can choose the inbuilt ones. If you want to add custom voice, you will have to have your own implementation and pass the audio as the response in your api calls. All the best. 🙂
After 14 days trial , how much we have to pay for it ?
Can we integrate dialogflow with unreal engine?
Hi, Technically possible as you can use the dialogflow API as per your requirements.
Thanks
I was totally lost I love the music but you had already setup and I didn’t know what to choose
The dialogflow Cx or ES
Hi Toni, in this specific video, I was using Dialogflow ES. You can refer to the other videos. There is also a Dialogflow CX series as well.
How can we integrate this digital human to our website can you please make a video on it
Hi Akhil, you should be able to easily add it using the integrations option. However, will try to cover these again in the future videos. Thanks for the suggestion. 👍
Can we integrate with different programing language??
Hi, not sure what exactly are you are referring to. However, if you are talking about the webhook and backend logic, yes you can integrate it with your programming language of your choice.
sir, how can we add rich responses to these bots?
Hi Jyoti, You can check out my other videos on how to add SSML and Rich responses. That should give you the idea behind how to add rich responses.
Can we publish this as a assistant action
Hi Shoury, if you are using interactive canvas framework, yes you can publish as an assistant action. I will be doing a session on it soon. 🙂
Im gonna use a vr avatar and abunch of prefab assets
That looks nice, but my technique is more immersive
Great! Looking forward to see what you build. 👍
@@techwithsach i need funding unfortunately
Lovely 😍💋 💝💖❤️
Where is the first video in this series
Here is a link to the playlist. th-cam.com/video/6GLFcm7dGiY/w-d-xo.html
Im trying to make a digital human with unity
All the best!
how is it going ? i want to do the same
@@alkalinehuman3512 good so far, id say just get Replika and wait
@@alkalinehuman3512 look for jasmine black on Facebook, the Replika one
Can you do one with anime character
to create an account in : Uneeq It is not easy ;(
Does anyone know of an open source option? The alternative to this is to create an avatar and run it through unity, right?
Yes, you can achieve this using unity. I will be releasing a video in the new year showcasing the basics for you to build your own digital avatars. In the meantime, you can also call the Dialogflow APIs and connect it with a 3D Model.
@@techwithsach do you think it is possible to connect an avatar in .fbx format, without using unity? (I have read that one option would be to transform it into json).
اتمني يكون البرنامج والشرح من الجوال 🤗
Mabye you could help
can you give me your email or linked i want to ask you more about digital human
you can connect with me on Twitter and send me a direct message. I will try my best to help you out with your queries.
Can he speak Chinese?