The BEST ESP32 project based on ChatGPT | IOT Projects | NextPCB
ฝัง
- เผยแพร่เมื่อ 19 ม.ค. 2024
- Ready to take your ESP32 projects to the next level? In this video, we'll show you how to create your own ChatGPT voice assistant using an ESP32 board. This DIY tutorial is perfect for anyone looking to incorporate artificial intelligence into their IOT projects. Watch now to learn how to make your own ChatGPT voice assistant with ESP32!
⚡️⚡️ You can also start learning IOT from scratch with my Course "Master of IOT". Enroll Now - techiesms.graphy.com/
⚡️⚡️ Order all components required for making this project using this single link - techiesms.com/product/chatgpt...
You can support me🙏🏻 and also get benefitted on Patreon :- / techiesms
__________________________________________________________
👨🏻💻 NextPCB Links 👨🏻💻
This video is sponsored by NextPCB - the Reliable Multilayer PCB Manufacturer.
www.nextpcb.com
Free international shipping for Authentic Electronic Components:
www.hqonline.com/
Enjoy free PCB assembly for 5 boards:
www.nextpcb.com/pcb-assembly-...
DFM free online PCB Gerber viewer:
www.nextpcb.com/free-online-g...
__________________________________________________________
👨🏻💻 Important Links 👨🏻💻
For OpenAI API - platform.openai.com/
For Google Cloud API - cloud.google.com/
Postman App Download - www.postman.com/downloads/
Codes & Sch Used in this project - github.com/techiesms/ESP32-Ch...
ESP32 ChatGPT Video Series - • Running ChatGPT on ESP...
__________________________________________________________
Components used in this project 💡🔌
⚡️⚡️ Order all components required for making this project using this single link - techiesms.com/product/chatgpt...
Or if you want to order only specific components then here is the list and link,
ESP32 Dev board - www.techiesms.com/product/esp...
I2S Mic - www.techiesms.com/product/inm...
I2S Audio Amplifier - www.techiesms.com/product/max...
Speaker - www.techiesms.com/product/rec...
IR Sensor Module - www.techiesms.com/product/inf...
TP4056 Battery Charging Module - www.techiesms.com/product/tp4...
Battery - www.techiesms.com/product/kp-...
__________________________________________________________
⏱ Time Stamps ⏱
__________________________________________________________
🎥 🎙 My Video Gear 🎙🎥
Camera - Canon 750d
Lens - 50mm f/1.8 STM Lens (amzn.to/32gqnsi), 24mm f/2.6
Key Light - Godox SL60W (amzn.to/3522mHe)
Fill Light/Back Light - Osaka Lightning Setup (amzn.to/2I5cdDi)
Tripod - amzn.to/3uNhC4H
Microphone - Zoom H1N(amzn.to/3Osh12A)
Editing - Final Cut Pro X on MacBook Pro ( amzn.to/3vHcSyJ )
__________________________________________________________
Get connected with techiesms everywhere..
Subscribe Main Channel :- bit.ly/techiesms_youtube
Subscribe Shorts Channel :- bit.ly/techiesms_shorts
Facebook :- / techiesms
Twitter :- / imtechiesms
Instagram :- / techiesms
Website :- www.techiesms.com
Telegram - @techiesms
__________________________________________________________
techiesms
explore | learn | share - วิทยาศาสตร์และเทคโนโลยี
![🔴 [TRỰC TIẾP] U20 Thái Lan VS LPBank Ninh Bình | Cúp VTV9 - Bình Điền 2024 | JET STUDIO](http://i.ytimg.com/vi/3wRNdAy3DXs/mqdefault.jpg)
If we ever make version 3 of this project, what will be your suggestions about adding/removing things in this project? Share your thoughts..
Make it offline. Even tho it seems a little hard
Great work anyways. As always I will keep buying products from you
The thing is ultimately it isn't free
you can do the same thing (generative language) for Gemini Pro and I have a good idea, you can make the project more beautiful by using OLED screen (SSD1306) and Wowki Animator.
Because Gemini API is free and I have another idea:2. ESP (I mean the ESP32 module that controls the speaker) should be in the box, but
1. Let the esp (I mean the esp32 module that controls the microphone) be on a remote control and record the sound when you click the button.
Thank you so much for this latest project.
Hats off for your contribution to the hobbyist community. ❤❤
As suggested below: use a wakeup word and create the possibility to 1. run an Internet radio 2. use ChatGPT for question/answer, 3 Perform an action with Servomotor. Integrate also the board DY-HV20 for predefined responses.
Then this project will become a very good foundation for a ROBOT.
Anyway: Sachin congrats: version 2 works!!
Hello Techiesms!
The project is working great - great job!
The problem is low processor memory. only 2 seconds for the Questions task is too little. Longer responses are skipped because the receiving buffer is too small. I have a question whether it is possible to modify the program for ESP32 VROVER to extend the Voice Recorder (5 sec) and the receiving buffer for Text 2 Speech (Max Tokens 100).
Then the device would be perfect!
Warm greetings from Bavaria!
Roman
Hi techiesms,
your project is awesome .. can't wait for next steps. I will rebuild it for sure, doing some adjustments and enjoy ;). Any ideas for battery mod would be best anyhow. To your questions on eof videe (ideas for next steps), here my personal coins:
1. stay with ESP32, not using Raspberry Pi, reasons e.g: (a) we can utilize the existing code, no Python needed, (b) no Pi (Unix OS) overhead needed, keep it small and beauty, and (c) much easier for battery powering .. just my coin (i jumped once to Pi, did not like it .. then went back to my sweet home ESP32 & Teensy ;)
2. solving the input length issue would be most important (i feel 2 or 3 seconds are too short for nice chats)
3. yes, solving the charging issue, would be awesome to have this beauty box totally portable !
4. later on maybe a 'wake-up-key' phrase (just optionally, i will stay with a simple capacitive touch button for now)
just my coins, I'm exited next steps ! .. cool work !
just seen i made your 123.000's youtube abo lol :D, congratulation techiesms :) .. go on with this great work !, locking forward v.3
Thank you ✌️
its look amazing ... this time your talking clearly and slowly thanks for this video last video i got so many errors. hope this time its work... i will update once its works...Please keep doing this kind of videos...
I try my best to minimise the errors
So do try it out and let me know if you still get any error
Bro did that work
@@amalnp3934 not working bro
so did you solve the problem of slow response from Google Cloud Speech to Text ?
did you provide it with the optimal audio resolution ?
Is there a specific reason you chose to have two different boards for two different functions? Can’t both of them be uploaded into one?
Great, thanks for share. Love u.
Great as always. Really appreciate your great effort
Thank you so much 😀
@@techiesmsBro help me about Google api is there alternative
bro techsims can I make it work without pcb
through jumper wires
use DC to DC converter and for the trigger use an accelerometer like lis2dw12 which has a power consumption of around 1 microamp, put deep sleep both esp32, and when someone taps on your project or shakes it it gives a trigger, same as your IR sensor, and both esp32 wakeup and ready for normal operations there same delay when wakeups like connect to the router and other process so indicate with light when the system is ready after no voice listening for certain period, go back to sleep overall power consumption should be around 20 uam ,if Load Switch IC use where ever needed and your low power consumption device is ready is may able to run 1 month on 1000 mah battery
The audio.h Library shows an error like
In file included from c:\Users\sreerama\Documents\Arduino\libraries\ESP32-audioI2S-master\src\Audio.cpp:15:0:
c:\Users\sreerama\Documents\Arduino\libraries\ESP32-audioI2S-master\src\opus_decoder/opus_decoder.h:7:20: fatal error: memory.h: No such file or directory
compilation terminated.
exit status 1
Compilation error: exit status 1
Same error did you find the solution...? Please help 🙏
@amalnp3934 did you find the solution of this error, please help
Download that directory or library
@@saidevdhalfrom where?
Custom PCB design isn't there on the description Can u please upload that
Great project and why can not we use single DevKit for this?
Hello! Can you provide the design of the PCB that you used?
G'day I am wondering if it can do Speech to Text, and how small can it really get? I saw the XIAO Esp32 being tiny.
I have a project that requires wireless, real-time Speech to Text capabilities, and 4 programmable buttons on it... in the smallest form factor possible... Max one index finger size.
Do you reckon it can be done with Esp32's or am I better off looking somewhere else?
what would you suggest?
Can we use esp home and add wakeup word and keep rest code same?
Great video, can you make a a video about esp32c6 and his zigbee ability inside arduino ide? There is no one video on that topic....
Hi techiesms .. let us know: could you solve the 2 sec record length issue meanwhile ? I would love to record e.g.5-10 secs. ANY idea so much welcome - thank you!
@techiesms can i use Gemini api instead of chat gpt api ?
You are great, you can do the same thing (generative language) for Gemini Pro and I have a good idea, you can make the project more beautiful by using OLED screen (SSD1306) and Wowki Animator.
For example, when receiving a response, let the OLED screen perform a certain animation, let a logo appear when it is started, etc.
If Possible can We Change The Voice note Of The Assistant with The Help Of Other AI Softwares Like Eleven's lab To Change The Voice Note Of The Output?
What changes do i need to make in the code to be able to use Google Gemini api instead of chatgpt api
How much google cloud account charge initial amount when we verify.
Can we direct pay by netbanking that amount ?
how to get the pcb ??
Bro help me about Google api is there alternative credit card issues 😭
You could use one single esp32 and link it to esphome and make a pipeline for the chat gpt and the tts and stt (tts and stt are free and open source in home assistsnt)
And also you will be able to use wake word instead of the distance sensor.
Bro help me about Google api is there alternative
Bro help me about Google api is there alternative
What free tts and stt you mean? 😮
@@antonpegov2745piper(tts) and whisper(stt) they are both free and open source and included in home assistant as integrations
Bro can you send the link of the PCB design you have build it
sir where can i find ur pcb design so i can order it
What about proximity sensor ?
How it should be connected in circuit?
Also, how is working the way its changing color ?
same question , Have you found a solution to this issue?
Where do I get the gerber file of the PCB?
How could I order the PCB board of the project
Unfortunately, ChatGPT API isnt cheap. You incur cost for both input and output , so a device running chatgpt as the interface will quickly run out of credits. A better alternative is to use Hugging chat which is free but it only has python library.
Thanks for the suggestion
Bro help me about Google api is there alternative
You can just scrape the library api and use it in c code instead of the openai api
@@snopz can you please explain it in little more detail if possible or provide with the some links please
I've tried multiple options , from llama based models , home start etc and a few local LLMs all native on my GPU but none of them compare to GPT APi, it is expensive but I've set my spend to £6 a month and use the cheapest 3.5 API and it's just unrivaled, I used it integrated into home assistant and no other LLM comes close , which is unfortunate for the time being
How many words does it respond at a time?
sir can you make evive - The Best DIY Prototyping Tool with in custam pcb desion and in limited buget it can fill all the dream who are intreasted in electroice plz help
sir when i compile the code error: architecture or board not supported sd.h file ka sath
is there any solutionn??????
Can we make this project by capturing photos using esp32 cam according to our prompt and processing it using open ai and get the result through a speaker
No
can you post pcb documents?
Thanks
I am getting error into speech to text section actually I am not getting the text results what should I do
Great video! When its finished and polished it will bean awesome unit to buy
Project is amazing but I need help that speech to text works but text to speech doesn't work Plz give me suggestions. .??what should I do
Hi your painless mesh library is not working pls check it😢
Can we replace google cloud ai with chtgpt api
How to connect a display with it for see pictures
Agar es assistance ko bna banaya kharide to kitne ka pad jayga
can you make ESP32 project based on ollama Stand alone GPT
Exist code for esp32 voice recognition offline ?
Does anyone found anyway to increase recording time?
Hi sir very useful this video
And then I am Studying college
I have submit my Minor project
In this Chatgpt based voice assistant project is ok or not
It was successful completed and ahow the output clearly pls clear my doubt and pls reply
sir please upload fast and make a video on how to change the voice of ai and work like robot
What about rpi small version
I had done that 6 month ago. With the following differences: used only one esp32, and amazon for tts and stt.
It works fine, BUT :
The sequence stt - > chatgpt -> tts always takes all together at least total 30s....honestly, did you not make it seem shorter when editing your vid ?
Cheers, jp
found any solution to make it faster?
@@_plsubscribe_ nope. I gave up!
@@jalmince am i better off with raspberry pi zero 2w then?
@_plsubscribe_ sorry I don t get your question. To me the issue has to do with how fast the api' s reply to your queries. No matter which hardware you use.
@@jalmince ohh thought it due to hardware capabilties.
Why are you using two esp32's ??? It has dual core
Very good 😮
Thanks 😋
sir can you make a evive starter kit at low cost
WHICH SOFTWARE YOU USE TO MAKE PCB DESIGN AND ALSO CAN A BEGINNER USE THAT .....???
Easyeda
And yes it’s beginner friendly
How can I get the gerber file
WiFiManager with SPIFFS data memory for the API keys
How can i get youyr PCB
Can I get the PCB design
Waiting for the Next Version video !!!!
Why didn’t you use esp32 module only
Esa PCB kahan sy milay ga?
Sir I am getting error while uploading the code plz help
How much does it cost to buy one from you including the schematics and code?
Isn't there free api instead of using Google cloud and OpenAI chatgpy
Code is free idk about schematics and iots are 1500 inr
can i use esp8266
Wher is the github reposiory
Can we train the chatgpt api to answer our questions in a particular way
Ofc
I wish i could solder, maybe if i can get the cornea transplant someday.
Is there any other alternative for google cloud?
Cloudflare
Good job
Thanks
How many times can we use chat gpt api with free credits, is that sufficient for my college project?
Matters on you how much you use it
Why we need two ESP? We have multicore esp’s now, RTOS for multitasking, so why still use this two big guys?
They even not work at the same time, I also wonder why he used 2 ESP's..
Isn't there free api instead of using Google cloud and OpenAI chatgpy
I can make one 😉
In text to speech code i am getting an error in runtime which is memory.h no such file director is found plz help me out
how did you solve this ?
Download the directory
can you plz help me to this project plz give me your contact @@saidevdhal
I'm having an error "[HTTPS] begin...
[HTTPS] Connection established![HTTPS] GET...
[HTTPS] GET... failed, error: connection refused" like this if i running .can anyone suggest what to do
I'm also facing same problem, pls someone solve these questions:)
"Compilation error: 'i2s_read_bytes' was not declared in this scope " anyone help me please!!
Share the screenshot of the error on our WhatsApp
8200079034
Pretty sure this happens if you're using an esp32 board package version newer than 1.0.6. 'i2s_read_bytes' has been superseded in newer versions. If you downgrade to 1.0.6 using the board manager (see instructions in the video), that might help.
How much the amount does google cloud take for verification ?
INR 2
@@techiesms Do they take money from my credit card after registration ,or do I have to pay money after the 2 INR?
@@nizaralshabibi3372that's automatic the will take it until the verification completes then they will refund
I could bot find the gerber file so please upload it.
Same issues
It's a great project so i tried it but i don't know what i have done wrong can you suggest me please.i am getting this error "[HTTPS] begin...
[HTTPS] Connection established![HTTPS] GET...
[HTTPS] GET... failed, error: connection refused". please help me
Have found the solution to this problem?? I am facing the same issue the speech to text part is working but the chatgpt response is indicating connection refused
@@ArjunSingh21bee049 no ,not yet
same error if you find yet let me know
Ya same error, plz if any one has solution for ir
Sir also make a video on google bard AI
Do you have any links about their API?
Record start!
Processing your Audio File
Json daata--what is the capital of India-
Asking Chat GPT
[HTTPS] begin...
[HTTPS] Connection established![HTTPS] GET...
-1
[HTTPS] GET... failed, error: connection refused
To ask againPress button
I am getting this error. i tried many ways to retify it , but fail. if anyone can provide a solution it will be vary helpful.
Have found the solution to this problem?? I am facing the same issue the speech to text part is working but the chatgpt response is indicating connection refused
Yeah I am also facing the same problem.Can anyone solve these problems.
How much did you spend on this?
Nice
Thank you
If i have no credit card what will do
Choose other apis
maza a gaya
Sir how to get this sencor
You can purchase everything required to make this project from our website www.techiesms.com
Unfortunately, it is using ir sensor to wake it up. You have to add wake up word in the project so that the assistant can wake up without ir sensor. _try to add it fast and provide us_
Easy 🙌🏻
@@saidevdhal hi can i get the code for text to speech and speech to text ,iam getting error from github code
@@pen_master Are you working on this project ? currently
first view ❤🎉
You're the best!
sir raspberry pi 4 pe karona
Circuit diagram ??????????
we have provided the schematic diagram in the github repo
please check
your website link is not working :-(
I checked now
It’s working
When they are able to make an offline version I'll be interested. Until then it's just more spyware monitoring by every move.
For now offline is not possible cause to make api request network is needed
@@saidevdhal Lots of people have home networks and even home servers. You can make api requests without being on the Internet.
Memory bank size limits and computer power to access huge chunks of memory are getting more affordable every day. That's what I see as the limiting factor currently.
我想知道，这个能在中国用嘛？
It aBro you can make one esp32 and and connection
We tried with single ESP but was not working
Please help purchase this project
Two ESP's not work at the same time, I wonder why you used 2 ESP's..
bhi gerber file kidhar hai
aadha part hi dete ho
he'll never provide you apart from his components ....that's business baby
Hi sir...Better to try to make a device without an IR sensor using only voice commands to directly communicate with the device.