I Hacked a Mouse into a Camera!
ฝัง
- เผยแพร่เมื่อ 10 มิ.ย. 2024
- An optical computer mouse is actually a camera! In this video I show how I modified an old optical mouse by hacking its sensor and replacing some parts. Can you recognize what it films?
Thank you to PCBWay for supplying the 3D prints: www.pcbway.com/?from=Doctor%2...
Consider supporting this channel on Patreon and get updates about ongoing projects and ad-free preview videos!
/ docvolt
Items used in this video:
Please use these links for your order to support the channel. It's the same price for you, but I'll get a small commission.
Oscilloscope: amzn.to/3tRxM2k
Desoldering station: amzn.to/3RQbmGW
ESP32 S3 Dev board: amzn.to/48JoCDW
Code on Github: github.com/michalin/mousecam
#electronic
#electronicscreators
#arduino
00:00 - Dissecting a mouse
01:03 - Examining the ADNS2610 optical mouse sensor
02:47 - Controlling the ADNS 2610
04:05 - Modding the electronics with an ESP32-S3
04:46 - Reading images from ADNS2610
06:28 - Making the camera
08:48 - Taking pictures
09:32 - Thank you - วิทยาศาสตร์และเทคโนโลยี
Now take a full frame sensor and make the most powerful mouse on earth !
Not as powerful as an NYC mouse. They growl and hiss at you and they have knives, guns and gangs.
@@InsideOfMyOwnMind Lame comment
@@BurkenProductionsLame reply
@@stoobidthing lame thread
@@TheTanadur/brokethechain
I may be wrong, but I believe this is how most UFO and hauntings videos are filmed
would be really interesting to see what a modern high dpi mouse could do. 🤔
231 likes and no replies? Lemme fix that
It would still be better than the bank's security camera
I was actually thinking of this! I started making plans for a modern 16000DPI mouse sensor, and then connect 9 of them to create a full frame sensor
Cool video! This is literally the camera that they use as security cameras
lol
Security mouse
I don't blame how it was back in the day since technology would've costed a lot more. But yeah, there's no excuse for potato quality today. Heck, any ordinary people can have quality CCTV at their own home and connect to it anywhere from their phone. Places that truly need it the most shouldn't be cutting costs getting the cheap old stuff. Like police dashcam footage from decades ago was trash, but now everyone can drive around with quality cameras.
this is how UFOs are captured :D
Next episode: "Bad apple but it's through a mouse sensor"
touhou reference⁉
Incredible! Now have a RGB led quick cycle some flashes to read each color channel brightness and blend the three values overlayed to get a rough color photo
I feel like you should be able to get higher frame rate out of that sensor... I think the ESP mini board was a limiting factor there
No, the limiting factor was the sensor. Reading the images without error takes that long.
maybe with a newer gaming sensor you would be able to do that
@@cle4tle yeah aint no way a mouse is that slow, how would it manage to be precise
EDIT: I looked at the datasheet of the ADNS-2610 chip. Basically it has different registers for either X and Y movement and a pixel data one. (there's others as well)
So apparently it can compute internally the X and Y movement, as it only needs to send that, as opposed to sending the whole image, which makes sense why it's slow in this case.
@@CreepyMemes the sensor also has delta_X and delta_Y registers and does tracking internally, I assume in normal operation the raw image data isn't read through SPI
@@CreepyMemeseverything happens inside the same chip, in normal operation only the movement vectors are communicated, not the image.
7:23 Well, I did such a project back in 2005... but I used the good old DB25 (LPT) as an interface and even wrote a simple webcam driver for it... and somehow get like 12fps of a resolution 16x16pix... and it worked perfectly through my 33.6kbit/s dial-up connection =))
You still were using modem in 2005?
@@imperia777I had to cope with dial up in rural south of Milan until 2007, so it's possibile
@@fabiosemino2214my uncle had a dial up until 2009-10. He said he didn't need anything better. Atlast he did get fiber optic.
@@imperia777 Yes we used dial up to 2008.
I know people in rural Arkansas who were using dialup in 2011.
i am astonished by the fact that simple interpolations can build a fairly good video from a bunch of pixels
What an extremely underrated channel
POV: You're a bank security camera
Oh, yeah? Well, I hacked a cat into a meowcrophone!
Are u by any chance from the 1960s CIA?
I think your cat is bugged :0
meoooow
@@captainretro373rip meowcrophone, make sure to keep yours away from cars
@@dysphoricpeachcars
7:24 local man reinvents the bank security camera
For those who are interested in the mouse model shown in the video. It's a Logitech M-SBF96 Optical Mouse PS/2. You can also find it with Hewlett-Packard branding, but it is essentially the same mouse.
Here are some other mouse models that might also work for this tutorial:
M-SBQ133
M-SBR-ACR2
I noticed "those tiny little stars" are in the EURion Constillation. A specific pattern of 5 dots that, if recognized by photocopiers, color printers, and the like, will stop printing. It's to make counterfeiting just that little bit harder.
I have to try this, update soon 😂
Beat you to it by about 20 years? We've done such a camera back then, trying to make it into a slightly smarter motion sensor, with a quick response low resolution image stream. Probably because the sensor is not as good as today, we found that the sensor has a too low dynamic range and can only be used indoor and in a dim environment. Glad to know it works now!
Man IDK what they injected into the algorithm over there at YT HQ but I'm getting the feshest content for a while. Another great channel to sub. Keep on with the jokes, even tho the cricket chirps was cute, I actually laughed at that silly joke so totally no need for the crickets. Keep the good content coming (and this is good content) and you will grow and succeed I'm sure of it. Also great video.
Brilliant. This is something I have wanted to try for years, thanks for providing the details
Man i was confused for a second and thought you somehow connected a camera to a real mouse's brain or something.
Big thumbs Up for your hardwork and for a new invention you created.
Thank you for the captions! What an incredible video, you are amazing! 🖤
Amasing!
It can be used to make precious end of range sensor for CNC or 3D printing
Thank you for your hard work making this, I have been enlightened.
Great Dr. volt, you're the best. Greetings from an old technician.
Excellent work!
I came for the tech, but stayed for the dry humor! Great channel!
Very cool!! You've got mad tech skills
its been done 20 years ago, some even made a "mouse scanner" that makes an image by stiching the camera image using the mouse X-Y movement.
those had 2 separate sensors
Absolutely grey. I'm glad you added all these Meme sounds it makes it fun to watch.
I thought that optical mice sensors captured images very rapidly so that they can still measure very high speeds of mouse movement. I was expecting you to be able to read at 1000s of frames per second. What would be required to make that happen? A high-fps camera would be cool even at 17x17 resolution!
It looked like an old mouse he used. Definitly no gaming mouse.
Thx for the great video Doctor 👍🏼
All is designed for slow speed. You would not expect a mouse with usb3 cable, do you? For a high speed camera, a high speed controller needs to buffer into much RAM. Nothing of it is in the cheap mouse.
@@suki4410 optical mice do not transfer the images to the host computer - all of the processing happens on the mouse controller.
Not worth the hazzle. Many new mobile phones can capture high speed movies with lower resolutions.@@AlanTwoRings
I thought so too, at least 60fps and likely higher should be possible to prevent lag. Maybe the sensor needs much more light, the illuminating led is usually quite bright and concentrated on a small area. Ambient indoor light is much much lower.
7:15 *POV: you’re the detective trying to solve the bank heist*
我曾经也想过既然鼠标原理和相机类似，但是没有能力验证，看了作者的视频，终于了却疑虑。
感谢作者。
That is what I call, thinking out of the mouse! sorry I mean the Box!
Amazing ! Looks like 1900 year videos😁
Unfortunately, most types of cheap mouse i saw were implemented with one chip, just chip and 3 connected buttons and wheel and sends data right to USB
Sir, I think your mouse hack is really cool, I really liked it, congratulations on the work, I'm going to do something for myself too with this mouse camera, and thanks for the idea
Amazing Work! Greetings from Argentina!
6:22 - when video speaks with your inner voice (okay) 😂😂
A cat captured by a mouse... oh the irony...
I may have to recreate this as a game design artist. I think this would be an amazing way to natively scan in drawing with a pixelate filter over them
Still has better vision than me without my glasses 😅
Best camera ever! :-D Really nice work. Bitbanging a single-wire protocol is hard, wow. I think the capture performance is limited by your bitbanging, right? Should be possible to increase the pixel speed by some factor x, 'cause otherwise it would not be able to achieve the original task of tracking that fast mouse movements. But hey, as I said: Brilliant. Awesome work!
It is so slow because it takes quite a long time to read out the images. The sensor needs at least 100 microseconds for each pixel. You also have to wait a few hundred microseconds between the read accesses to the individual pixels. So it adds up to about 1 millisecond per pixel, which at 324 pixels is about 300 ms per image. So we get about 3 images per second.
Great project!
You should have scanned the bank note, by slowly going over it with the mouse, line by line, capturing the data and later stitching it together. Would have probably been a lot of work. But would have also been amazing. Missed opportunity. :D
I've wanted to do this ever since I saw a video explaining how "New" laser mice worked and they showed how it was tracking dust and stuff on the table and it had a view like this to show what the mouse was seeing.
Great work buddy.
Amazing job!
I think your "mouse camera" is much better than many CCTV cameras these days 😂😂
I liked the aesthetic, looks like the first videos ever made, but even more crispy...
Instant sub!
Amazing!
I wonder if a better mouse would generate a higher quality image?
Like one of those logitech G pros, razer viper whatever
Or if those have more custom parts that are harder to modify.
I'd love to see a part 2 exploring that!
Better mice don't have more pixels. They are only closer together so the resolution per inch is better. Furthermore, not all mouse sensors feature reading the raw images.
@@DoctorVolt Of course there are mice with more pixels, 3360 sensor raw image dump is 1296 pixels large, that's 36x36 pixels. Reading is quite tricky though, the sensor requires different volatile firmware uploads for each of its operating modes including test mode.
I’m impressed, you earned a sub
This is what I've been looking for for a long time, according to my mind
Cool project!
Loved it. Turn a camera into a mouse next 😀
Next one up: take a WebCam and make a super-mouse from it 😺
Looks like your pictures come from Mars
Wow! Well done! I gave you a big thumbs up.
Next week make it in colour, and I mean not by scanning the black and white sensor for fractions of microseconds (every colour has its own frequency, by turning on and off the sensor, the colour can by interpreted by the length of the phase) Although, I think you need quicker processors for that. Colour detection can be done with optical filters but that needs fine mechanics. Luckily colour can also be detected by changing the frequency of the light, add a number of different LEDs and let that light shine on the object, red light is not reflected by blue objects etc. After a rainbow of colours the real colour of the image can be calculated. Than you finally can see your cat in colour.
The cat itself is black and white, though.
That is not an accurate understanding of how visible-wavelength sensors work. Visible light image sensors of even very high end cameras are not electromagnetic devices, they are photoelectric devices, i.e. not sensitive to phase. You cannot get visible-band color information from a black and white sensor through any kind of sampling or gating scheme even if you're able to sample or gate at daylight frequencies.
@@AJMansfield1 I am sorry, you can but at this moment not a single optical sensor is fast enough to do so. Not so long ago in electronics magnificent things were done by looking at the phase, the same thing can be done with light as soon as there is some development. The fact that it is not jet possible right now does not place a barrier for thinking further then what is achieved at this moment.
@@vanhetgoor Believe me, I know exactly what you're talking about as applied to radio and microwave frequencies - quadrature sampling is a fairly ubiquitous technique used in all kinds of radio devices to extract phase information from a signal. At visible wavelengths though, the feature size you need in order to construct filter elements that are reactive to those frequencies starts to reach the point where the only construction method possible is "stacking thin films into a filter", and it's not really possible to include active elements in the effective "circuit" formed this way.
The way that ccd or cmos camera sensors operate involves an entirely different physical principle - they do not measure the electromagnetic fields directly using an antenna, but rather count the rate of discrete photon events, based on the current across a suitably-tuned semiconductor junction. It's not a matter of "good enough", it's actually a totally fundamentally different way of measuring light. And without some novel breakthrough in the design of the sensor cell, phase information will always be lost by that photon bandgap process.
For higher resolution I think a gaming mouse might be better as they have higher DPI .
Thanks for the great video ! Keep it up
This has been on my shower thoughts for a long time. Thank you...
nice lovely project! what happens if you have a high DPI sensor? is your resolution better?
I think John Logie Baird must have used an optical mouse for his experiments in early television, as the pictures look very similar! 🤣
Now you have the perfect camera for filming Big Foot and UFOs!
I already filmed an alien and his cat on Melmac :)
How I imagine someone with severe cataracts to see.
Perfect camera to record UFOs
your videos are very inspirational and make me think i can rebuild an entire computer with software, because i don't feel like i get enough stability, protection and encryption (lets not talk about the performance since every electronic on this earth is now designated to go to the bin after some years) so wish me luck and hopefully i will make affordable electronics better because cheaper electronics=a better world , also i will try to make a camera sensor out of a mouse sensor but a more powerful one since it has more pins, better dpi and more even probably i will get the same result atleast i did something because i feel like it
Sehr interessantes Video! Ich will mehr! :)
This is the type of camera sensor that pictures UFO
I swear there was software I had in Win98 days that would let me scan with my mouse. No mods, just a particular chip in the mouse. (which I was fortunate to have) I'm pretty sure it was a PS2 mouse as I was also doing poll rate overclocking on it.
Yeah, definitely. This is old school. I first saw someone take a picture of themselves about 20 years ago.
Bro What? This is so Cool!
❤incredible content , it needs to be shown in electronics and programming schools . I understood a lot more than if I had read it all somewhere. Practice solves everything
The best sensors to use have a 32x32 or 31x31 pixel array.
I'm not sure if this is the most useless camera or the most useless mouse, but it looks great for taking UFO and bigfoot videos.
The Waaw at 2:46 is Eddy Wally, deceased Belgian singer.
How many people thought he did brain surgery on an actual mouse to make the camera see through the mouses eyeballs? I certainly did.
This mouse video quality is still better than bank security camera footage
makes me think a lot of a device we use for vtubing called a 'leap motion' which is an IR sensor type of camera, mainly used for tracking hands.
nice! such cheap (easy to find as recycled...) sensors could be used as image-detection for home automation presence detection: I did make some tests with USB webcam connected to a MCU and it's okay, only need a good pattern recognition layer
very brilliant thought concept & having correct infrastructure to realize it, what about mice who have invisible light source i tried closely to look with a digital camera couldn't see anything if it was IR would have shown white, i managed to see the dim red laser dot of a laser mouse.
Awesome! Liked and Subbed!
Now it’s clear what camera was used to film the alien ships, the Yeti, and the Loch Ness monster
Cool stuff 😊
Better quality than most security cams
Insane , you are genius
"And this thing here is a dust particle." - only way this could've been funnier would've been if he had added "for scale" to that sentence 🤣
Nice video, thanks for sharing it. The one data line SPI is the I2C (it is open drain, not push-pull like SPI but it has to be). It is supported with the Wire.h library. 3 fps is pretty wierd a mouse must respond much faster.
If it is I2C then the master is probably the one determining the clock. 18x18 pixels with (guess) 8 bit resolution and wanting something like at least 60Hz refresh rate (again a very rough guess, some mice claim >1000Hz) would require around 150kbit/s. Many I2C devices can operate at 400kHz, so that should be feasible. I hence think the 3Hz will be a limitation by the implementation on the ESP32.
Just as a reminder, in the 2000s, there was some program around to use your optical mouse as a scanner.
Why not use the ESP32’s dedicated SPI hardware with a diode and resistor to merge the two data pins into one? I assume the image sensor runs I/O at 3.3V.
I am better at programming than at developing circuits. Besides, additional circuits would have taken up too much space.
You should look at the self-flushing toilet cameras. They have a much higher resolution.
Now take a thousand of those sensors and make a lens array to capture HD video.
This is insane! I ❤ it!!
Very impressive
The next project could be a microphone from a mini HDD, so you have a complete webcam😁.
i'd love to see this done with a more modern mouse, and even if the resolution isn't much higher, you can use the data from multiple captures to increase the resolution by also using the original motion tracking of the mouse to put more pixels between the ones you have
Modern mice don't have debug pins on their sensors for ouputting raw iamges. Only the old ones.
I want to know, if the mouse is newer will the resolution be better? I’d love to see street photography on a newer mouse 😊
This feature is kind of rare in the first place, many mouse uses chinese clone chips without this feature
Did a great job
I was looking for this video for a month now I found it😊
I will write again, this is an incredible video thank you author ❤
I wonder if newer mouses have chips that could eventually make better cameras... or at least be faster (or overclocked) so you can get more fps out of them
I think the 8 bit guy did something similar to this a few years ago
Turn a finger print scanner into a camera next
Good job.