Auto Focus with OV5640 on ESP32 AI-Thinker Board
ฝัง
- เผยแพร่เมื่อ 22 พ.ค. 2024
- Full support for OV5640 on ESP32. However, in order to use the autofocus function of the OV5640, you will need the ESP32 board which supports it.
In this video, we cover the software (library) as well as the hardware so that you can use the autofocus function of the OV5640 by utilizing the existing ESP32 AI-THINKER board.
*Please Note*
Each manufacturer of OV5640 has slightly different specifications. Please check with your product first. The product I used is Waveshare's OV5640. www.waveshare.com/wiki/OV5640...)
[OV5640AF for ESP32 Camera Library]
github.com/0015/ESP32-OV5640-AF
[ESP32 CAM with Arduino IDE | Tutorial - [Part.1] Streaming into the local network]
• ESP32 CAM with Arduino...
[Waveshare OV5640AF Camera Module]
bit.ly/30StEAY
[ESP32-CAM Development Board]
amzn.to/3NMukO0
#OV5640 #AF #AITHINKER #ESP32CAM #ThatProject - วิทยาศาสตร์และเทคโนโลยี
That Project's Channel - th-cam.com/users/ThatProject
FB Group - facebook.com/groups/138965931539175
Hello, is there anyother way than soldering wires to the board?please help
@@hasithaeranga5589 Power must be supplied to the voice coil motor to adjust the focus of the OV5640. Since this uses the ESP32CAM AI THINKER board as it is, a jumper wire is connected. I don't know any other way.
@@ThatProject Thank you, im trying to design a adapter for that, can i take 3v supply from DVDD pin, that also suppy 3v right?
@@hasithaeranga5589 When OV5640 is used with back-end chip supporting MIPI interface, DOVDD of OV5650 should be 1.8V. DVDD is generated by internal regulator of OV5640. So 2 regulators should be used to supply powers to OV5640.
@@ThatProject Hi! If I have another ov5640 af, where vcc on the 23 contact, and gnd on the 24. I need pin 3.3v to 23?
Or info in datasheet doesn’t right?
Your videos have been incredibly valuable to me. Excellent work!
Great work!
you are the best. With your help. i have a working Esp32cam with ov5640 with streaming to websocket. thanks for help (with hardwaremod)
Impressive!!
Gracias.
It is more correct to connect the autofocus module power to 2.8V. There is an appropriate regulator on the ESP32CAM board.
hi, could you please tell me which regulator it is on the ESP32-CAM from where I can get the 2.8V? Thank you.
Is there a way to acquire Image Focus(Auto or Manual) using the OV2640 Camera? Or should I just apply filters to the image produced after sharpening them?
To adjust the focus, it needs a module(VCM) that moves the lens back and forth. The OV2640 doesn't have this, so it's not possible.
Mh I guess the camera module is a bit pricey but it does an amazing job. I always wondered how the AF works in smart phones so thanks for explaining that :). In my spare time I like to do some 3d printing and perhaps this module could be a good fit for timelapses of my print.
EDIT: Did you manage to get the maximum resolution of 2592x1944 to work on the esp32-cam? In your video you "only" set the resolution to VGA (=640x480) so I am curious if the whole setup also supports a much higher pixel amount (preferebaly with the maximum achievable framerate).
Looking at my previous video, I get only 5 image frames per second purely at UXGA resolution(1600x1200) with the OV5640 in the ESP32 environment. th-cam.com/video/BCvOBMQSliY/w-d-xo.html
The higher the resolution, the longer it takes to acquire the image buffer. Also, as the size of the image file increases and the transfer time increases, the FPS drops dramatically. So, this was why I choose VGA res for the testing.
@@ThatProject Thank you very much for this thorough explanation :) I will make sure to check out that other video you mentioned!
Great Tutorial.
What academic or other path have you taken to have such skills? I am also self-taught but I think that is not enough. Or am I mistaken?
It's a very hard question.
I majored in CS and studied ECE separately. I found a lot of things I was interested in and learned on my own. I don't know how to answer your question but I think you're on the right track because you're finding the answers.
The OV5640 datasheet lists the frame rate at 90fps for 640x480.
Do you know why it is slower in this video? Is the esp32 capable of faster frame rates?
FPS in the datasheet only refers to the acquisition of the image buffer. In order for us to actually see the image with our eyes, we need to output it to the screen or transfer it to another device via WiFi. These make it difficult to reach such FPS.
Hi Eric!
Thank you very much for all your tutorials and especially for this video! 😊
I apologize in advance because I think you have already answered this question:
I have tried two different ESP32CAM boards, one from the AI company (AI thinker) and one from Espressif. Unfortunately, only the AI thinker board is working properly.
Do you have any advice on how to resolve this issue?
Another easier question:
I am currently successfully powering the ESP32 using an Arduino Uno. However, when I try to power the ESP32 using an external power supply, it does not work.
Any idea? Does the ESP32 need a power-up reset?
Thank you very much again!
Aren't both products AI-THINKER? What kind of ESP32-CAM made by Espressif is used?
It seems like you can't run two devices with an external battery because the current is insufficient.
@@ThatProject Thank you for your answer, Eric!
No, they are different problems.
1) I have tried two different ESP32CAM boards, one from the AI company and one from Espressif (I understand it is not an AI thinker, but it is an ESP32CAM with the same looking).
Unfortunately, only the AI thinker board from the AI company is working properly with the autofocus.
2) When I power up the working AI-THINKER with an Arduino Uno works great. However, with a power supply with enough current doesn’t work (it doesn’t connect).
Perhaps it is using a different IP (of course, I can’t debug it).
Thanks again!
We are taking photos in snow storms and need to set the focal length manually. Is there an ESP32 that supports manual focus??
In fact, the OV5640 supports manual focus, but there is no library that supports it yet. I tried to make it, but not many people want it, so I gave up. As far as I know, this is the only one available on the ESP32.
is this cam module able to be incorporated into the existing webcam server for video streaming ??
What is the existing webcam server you're saying? Would you elaborate on it?
Good job, I wonder how close can the camera focus. I'm planning a project where I have to take pictures within 4cm. What do you recommend for this job?
It seems to work well when the distance from the lens to the subject is at least 4 cm.
@@ThatProject I tried my ov2640 and if I unscrew the lens to it's maximum height then it works in 2cm. I need something like that because I want to put it into a mailbox to read what letter I've got. Do you know a camera which would work for this type of project?
@@ASDosjani The types of cameras that operate based on ESP32 are as follows.
github.com/espressif/esp32-camera
If the distance to the target is a fixed distance, the way you did for OV2640 seems to work best.
Hello there. Is there a way to manual focus the autofocus coils with a variable resistor or something similar? I'm working on a project that needs to preset the focus distance. Great work by the way, I've been following your work for the past 2 years.
According to the datasheet, we can manually specify a specific point for focus. I tried to implement this part, but it was not easy. Also, I don't know how to manually adjust the VCM you want.
@@ThatProject do you still want to implement this? It would be very useful for my project.
@@ASDosjani I’ll try to complete it if possible.😂
Hello, I tried leaving a question about this but not sure it was saved, apologies if repeating myself. Have you had any luck in manual focus or found that there are certain limitations that can not be overcome?@@ThatProject
@@leoshmu As a follow-up to this project, an attempt was made to develop firmware for manual focus, but it failed. So I don't know anything beyond this. Sorry about that.
Your work is very impressive. Can you tell me the screenshot of 3 minutes and 37 seconds in the video?
It is the focusing status code of OV5640.
With this, you can know the current focusing operation status.
i am using 5640af and uploading these pictures on cloud but these size is small. and i need minimum Hd or above. so is there any way to change that.
Thanks in advance
Why don't you change the resolution of the image? You can get the HD resolution from your OV5640AF.
I have instaled ov5640af on to esp32 cam and wired the coil motor succsesfully but i can only inicialize camera but af doesnt move but some how its says its focused and shoting a foto fails. I used 3.0v on input did i burn it? I checked datasheet and i saw that io voltage is 2.8v and if low drop regulator is droped it like 0.1v it wouldnt be 2.8v. what voltage did you used? And does it get hot ?
I connected 3.3v for the VCC power supply. According to the manual of the OV5640 Camera board (C), its operating voltage is 3.3V. I couldn't find any other mention of AF-VCC's power, so I connected it like this. Anyway, focusing works normally. www.waveshare.com/w/upload/5/52/OV5640_Camera_Board_%28C%29_User_Manual_EN.pdf
Tell me friend why such a low-speed flow for VGA 10-11fps? From manual OV5640 - VGA (640x480): 90 fps, is this really achievable? And one more question, is it possible to adjust the focus manually, for example, through some register in OV5640?
That's the FPS you get from the sensor module itself, not what you get over WiFi. Actually, there is a bottleneck when it is transmitted to ESP32, and there is also a bottleneck when it is transmitted from ESP32 to WiFi.
Can you set a specific focus distance with this camera?
You can focus on a specific point with the manual focus function, but I haven't tried it yet.
Hi i am looking forward to make a cheap surveillance camera whats the best sensor you will recommend?
The ESP32CAM is great for simple tasks but doesn't seem like a very good solution for 24/7 operation. It is recommended to make a surveillance camera based on Raspberry Pi.
can we use the full resolution of the camera?
Please share your thoughts.
Have you watched the previous video comparing OV5640 to OV2640? th-cam.com/video/BCvOBMQSliY/w-d-xo.html
The full resolution of the image from OV5640 is super wonderful. Instead, it's super slow, of course. If you need a snapshot, I think you can use it. But for streaming, almost impossible.
Okay so if i buy the ESP32-CAM with ov2640 i can switch the camera to ov5640 right? Any special steps there?
As mentioned in the video, 3 volts must be supplied to the voice coil motor (VCM). This part is slightly different for each OV5640 manufacturer, so please check it.
I missed that part, thank you!
Hay, I am newbie in this, I am able to get feed of OV5640 on local server, How can I get this auto focus feature exactly same as you sown in video, Can you advice me on this or can you share the example code. Thank You.
I reused one of my previous projects.
If you have OV5640 with ESP32-AI-Thinker board, you can set up with this project. [ESP32 CAM with Arduino IDE | Tutorial - [Part.1] Streaming into the local network]
th-cam.com/video/kE0idrJYPII/w-d-xo.html
I am getting a status from the camera of 0x00 (Focusing), but I never get a status of 0x01 (Focused). Instead, I mostly get an undocumented status of 0x20. Can you provide any insight into what is happening? Thanks.
I'm not sure about 0x20. Never got this status while focusing on the subject. This is all the statuses I know.
#define FW_STATUS_S_FIRMWARE 0x7F
#define FW_STATUS_S_STARTUP 0x7E
#define FW_STATUS_S_IDLE 0x70
#define FW_STATUS_S_FOCUSED 0x10
#define FW_STATUS_S_ZONE_CONFIG 0x16
#define FW_STATUS_S_FOCUSING 0x00
What specific model of OV5640 did you use and where did you get it from? I have tried this with two different types of OV5640, one type just gave me "couldn't capture packet on time" and the other type wouldnt turn and just made the esp cam board hot.
Sorry to hear that. I only tested with OV5640 which is from WaveShare. www.waveshare.com/product/modules/ov5640-camera-board-c.htm
Unfortunately, I have no idea what difference with OV5640 the other company made.
@@ThatProject is there a model number printed on the ribbon cable of your cameras?
@@lance249 Sorry, I couldn't find the ribbon cable information. Why don't you ask them directly?
@@ThatProject just found the datasheet for my camera modules. For my 5640 cameras AF-VCC is pin 23 and AF-GND is 24 and a few other differences. I'm going to make an adapter board with FPC connectors and will report back in a few weeks.
@@lance249 The products sold on aliExpress are very different. Anyway, I hope it works out.
Hi , I want to do text recognition with my esp32 cam but video quality with OV2640 is very bad and very slow . So I am thinking of purchasing of OV5640 AF by seeing this video . Will it increase the performance. Kindly guide.
If you are doing a text recognition project, it would be better to use a camera + MCU with better performance. Please refer to this project. th-cam.com/video/TGqOUVhQQY8/w-d-xo.html
Thanks , but I am using my phone as a server for performing ocr . I just want esp32 to capture a clear image with at least 15 FPS and send the capture image to the phone .
@@ChandanKumar-zw7zg It appears that at least a WiFi connection is required for streaming at 15FPS. th-cam.com/video/kE0idrJYPII/w-d-xo.htmlsi=WXgdynuYWOC-vb-S
Can you test this camera in you’re quad nod version ????
What's the quad nod version???
so how hard is that to connect one cctv autofocus lens to a logitech autofocus webcam?
This is not possible as they have different interfaces.
th-cam.com/video/ckZHOEV2Oac/w-d-xo.html@@ThatProject only the autofocus part only 2 pin
ae01.alicdn.com/kf/S61e4ca64f9244e4b82b9c45057047230j/AHD-5MP-4MP-Motorized-Zoom-2-7-12mm-auto-Focus-Lens-1-2-8-STARVIS-IMX335.jpg
Hi, Congrats! Is it possible to change the resolution? Regards
Sure you can get the resolution up to 2560x1920. Please check the previous video. th-cam.com/video/BCvOBMQSliY/w-d-xo.html
And any chance of works without the bypass you made? Many thanks again. Regards
@@thalesbatista2715 Well, I think you need the library I made to make it work. Let me know if you run into trouble. Thanks.
Estas cámaras se pueden conectar directamente a un monitor lcd o tv con entrada usb o hdmi?
The ESP32 does not have a graphics output chip, so it cannot be directly connected.
@@ThatProject ok, gracias..
Great Video 👍 Is it also possible to zoom in/out?
There is no optical zoom in/out function supported by the camera. It seems that digital zoom in/out can be implemented at the code level.
@@ThatProject Do you have any source or tutorial from which I can learn how to solve something like this programmatically? I'm assuming you meant the normal digital zoom. I would be very grateful for that. I'm pretty much at the beginning of the ESP32 journey right now. The issue of powering the ESP32 using a battery also seems to be a problem due to the 3.3V voltage. At least I can't find any solutions like the RPi Zero, for which there is a UPS Lite V1.2 power supply board, for example. I would really be very grateful to you for this information.
@@marco_di ESP32 usually uses a 3.7v Lipo battery. And the output ranges from 4.2V when completely charged to 3.7V.
@@ThatProject Thank you very much 🙏😁 Does this also apply to the ESP32 OV5640 camera module? Can you recommend a battery board for me?
@@marco_di Looking at this, you can see how I configured the system using a Lipo battery. I hope that helps. th-cam.com/video/hteut2R8eQ0/w-d-xo.htmlsi=gnwD5bhgtfkmln9M&t=93
I'm a beginner. I'm using ov2640. It's extremely when streaming video. The sketch that I upload is ESP32's CameraWebServer.
Please help.
While streaming, the temperature of the OV2640 never exceeded a maximum of 65 degrees in my environment. Stable video streaming was possible at this temperature. Have you checked the temperature? th-cam.com/video/yzWiicnv-f8/w-d-xo.htmlsi=IfOBGry_bLxo0QMb&t=92
@@ThatProject This happen at the boot of the camera. So I think the temperature is not the cause of lagging.
Is there anything else might be the reason?
@@jumbo999614 Perhaps I'm misunderstanding. In your previous comment, you said "It's extremely when streaming video." What does "extremely" point to?
@@ThatProject Sorry, I mean extremely slow.
and the video quality is so bad even in HD setting.
Should I also add heatsink to it?
@@jumbo999614 ESP32-CAM may not work well with your Wireless Networking Devices. If possible, try changing the router.
How i can integrate this library to camera webserver code, i want auto focus running at existing espcam webserver
I've never tried but seems it'll be possible.
After you confirm AF works fine with my library first, Add this part to the end of Setup() of the camera web server source code.
sensor_t* sensor = esp_camera_sensor_get();
ov5640.start(sensor);
if (ov5640.focusInit() == 0) {
Serial.println("OV5640_Focus_Init Successful!");
}
if (ov5640.autoFocusMode() == 0) {
Serial.println("OV5640_Auto_Focus Successful!");
}
@@ThatProject hey dear thanks for reply, i have tested my setup with your library and it's working well but when I m integrating with camera webserver code as you have instructed it's not working, can you do me a favor to test it and suggest the modifications.
One more help i will be needing from you, can you help in implementing digital zoom function using the existing window function and also do u have any idea of mannual focus.
Thanks in advance.
@@satyamsrivastava6988 Actually, I tried a few things for manual focus, but all failed. I will update the library when I find a workaround. If there is a chance, I will try to run it on the camera web server. Thanks for your understanding.
@@ThatProject What about digital zoom
@@satyamsrivastava6988 I have no idea about the digital zoom.
I'm new to programming, can you give me the code to streaming?
This is from one of my projects. Check this out. th-cam.com/video/kE0idrJYPII/w-d-xo.html
Hey...For my project i need to scan the QR code ...but using the default cam module ov 2640 I can't find the correct position and angle for scanning...could u please suggest me with solutions on this ...what if i change my cam module to ov 5640 ....I hope u do reply me ..😊
I have a same project do you have any suggestion for me ?
@@necatitas7375 I didn't change anything ..not even the default cam module .. it recognises things a bit slow ... So i left it as it is
@@Ari-uj2sy Did u scan the QR code from video streaming or image which is taken with cam module
@@necatitas7375 image
@@Ari-uj2sy Which language u used for programming ?
Please do a vedio how to detect objects using ESP 32 cam module
haha. I'd love to try it too.
please soonly do it friend
Hello
I run the code but I can't stream the video on the web page
Can you please give the code?
thank you
What I used here is my ESP32-CAM project that uses WebSockets. please refer to this. th-cam.com/video/kE0idrJYPII/w-d-xo.htmlsi=1dGODnAQbWso3PqZ
Do you dare to start rewriting the auto-focus microcode inside the camera, as some have tried ... or thought of trying and got sidetracked? 😀 arducam downloads/modules/OV5640/OV5640_Software_app_note_parallel.pdf
I took a look at the OV5640 from Arducam. It seems like it has its own way so the operating way is totally different. The OV5640 I have is from WaveShare and I had to follow the way they did from the datasheet they support.
@@jameszahary You can use the OV5640 on the ESP32 AI-Thinker board without any additional wiring work. However, in this case, the focus cannot be adjusted. (since there is no power to move the VCM)
I'm working on manual focusing for the next version, but it's not easy. If successful I will update my library.
Curious if you made progress or perhaps found a way to implement manual focus. I am wondering what the 0x3600,0x08 registers may provide @@ThatProject