2:00 door sensor is kinda nice, even new dumb fridges have it and start beeping if they are open too long. And even if fridge is at an angle, some drawers might block closing them
Give everyone NFID bracelets, add a reader on the fridge door, and computer vision can be used to see who eats what, and detect who left the door open the last time.
So I work in controls engineering and we often have to monitor valves for open and close states, without having any sort of exact position feedback, sometimes we need to alarm points, like for example this valve that's critical to operation needs to be proven open before anything else, so that is the state we want to see it in so we alarm if it's not. Basically though it seemed like from the demo with the reed switches that you are looking for the magnet to prove fully open, but it would probably make more sense to have them show proven closed so that if it's not proven closed for some period of time, you can alarm on that. You don't really care if it's fully open, but you definitely care if it's not fully closed!
It looks in the end that it detects when the door opens just a little bit (I noticed too, that in the ha-demo it seemed to be backwards). I would skip the magnets in that case and use copper tape on the door sealing strip as a contact. But, for the photo, it would be nice to know when it's fully open, so you could see the same fov every time.
Neat version one! For version two, I would look into having weight scales for dedicated areas (milk, juice, butter) so the smart fridge can tell when you need to buy more. And some kind of mild/rotten smell detector for the vegetable drawer would also be good. Let's not go into why I know that...
Not sure if you used it or not but the esp32-cam module also has a separate wifi antenna you can buy that will help the stream quality. In my experience this with a good clean 5V power supply and bright even lighting does wonders for the cheap OV2640 camera.
@@Mellow_labs my thought process was I may need Node Red to control a few of the things like switching off the compressor depending on whether the door is open (can most likely do that through HA) or not as well as delaying compressor start incase there's a power failure because where I live the power frequently switches on and off so basically delay start. But I may be able to accomplish all of that in HA with ESPhome, but I'd need to research more as I don't have much experience with either but I've got a bit of knowledge on node red
Fair enough, I’ve started moving away from node red. I would probably prefer to do it inside of ESP home because I wouldn’t have to wait for all of Home Assistant to boot up before my fridge can turn on again. It would be faster if that logic was on the microcontroller.
@@Mellow_labs slow boot times in my case would be a benefit due to the power issues, I was originally going to do everything in node red ...The only reason for adding Home Assistant into the mix was I like what I'd be able to do with it in terms of a dashboard...thank you btw for the replies it helps the thought process
Awesome and Subscribed. I'm looking at doing something like adjusting the temp in the fridge to be consistent. i.e. if opening the door a lot then put the temp down more but say if gone on holiday and not opening at all then no need to have it so cold or something along those lines. I'm loving the ESPHome stuff though. I've currently got 7 of them and created a smart desktop fan following another channel which cost me all of about £50 including the fan, I can control the fan either by HA or buttons on the actual fan but I'd like to make it adjust the speed depending on how much hotter the temp is compared to the ideal temp I can set via a few controls. With more and more companies closing their APIs and such these projects are very promising plus all local and no relying on a cloud provider or absolute minimum cloud reliance.
Great video but I would have hoped for a little more smartness than only taking a picture of the fridge contents. Maybe detect, classify and count objects (maybe even identify how much those are filled up) so that one could automatically put them on the shopping list if nearly empty?
@@Mellow_labs sorry I was just thinking those sensors where magnetic based, I've been planning on building something similar so I'm probably going to be watching your development if you post about it again. It was quite interesting
Alarm when the temperature rises slowly. Our fridge recently didn't fully close over night because something inside blocked the door slightly. Everything warmed up and got humid. You wouldn't have noticed from looking at it. And I imagine a door sensor would have still indicated it as being closed. Also can you take the picture when you are about to _close_ the fridge?
I think you could probably position the door sensor in such a way to catch when it’s just slightly open they can be pretty sensitive if positioned correctly. I could take the photo right before closing, but that slightly complicates things because it’s not a very fast camera and you kind of motion is just gonna bloody entire image. And I would probably need some kind of Excelerator on the door to detect when it’s being closed.
I have thought about that, but it doesn’t look good. Unless you’re doing some weird AI combination of the camera feeds, it’s just kind of a mess. Also no Wi-Fi in the fridge. Everything has to be external anyway.
@@Mellow_labs There's no need to use AI shenanigans. You could use OpenCV's panorama/image stitching functions. It's a pity that everything has to be external, though :(
What is even "smart"? Is a fridge really smart before it realises you are about to run out of milk and order you some more to be delivered to your door, so you don't have to? Then it could also find discount codes and evaluate those towards the expiry date of the product and your rate of consumption and evaluate whether to order now or not 😅
@@Mellow_labs I unfortunately remember when a "smart" fridge was one that simply could maintain a constant temperature and automatically turn the inside light on and off, unlike their predecesors that were big dumb boxes with no light and a large block of ice that you were constantly replacing!
The first thing I did for my fridge is put a power metering socket. Then I wasted ~40 Euros on the wifi cable for my Bosch fridge. Totally useless, can't even tell which door is open. Has no temp sensors, only reports the temp setting.
Putting the refrigerator on a slope......... Yawn. You can make the door close on its own without sacrificing level. Also, neither one will fix a kid leaving something in the way that prevents the door from closing all the way.
It definitely needs a light sensor to check the light goes out when you close the door.
Can't do that, a fridge light is like Schrödinger's box, you can't be sure if it is on or off,
If you observe it the whole fridge breaks down.🤣
You need three. That way you have redundancy and control functionality (triple modular redundancy) 😅
@Mellow_labs, is your fridge still functioning after you were inside it at the beginning of this video?
@@Redfire05GT Mr. Mellow is a cool customer, so I have no doubt it still works 😄
Sorry for the late reply, got stuck in the fridge.
Can confirm still works😂
2:00 door sensor is kinda nice, even new dumb fridges have it and start beeping if they are open too long. And even if fridge is at an angle, some drawers might block closing them
Give everyone NFID bracelets, add a reader on the fridge door, and computer vision can be used to see who eats what, and detect who left the door open the last time.
So I work in controls engineering and we often have to monitor valves for open and close states, without having any sort of exact position feedback, sometimes we need to alarm points, like for example this valve that's critical to operation needs to be proven open before anything else, so that is the state we want to see it in so we alarm if it's not. Basically though it seemed like from the demo with the reed switches that you are looking for the magnet to prove fully open, but it would probably make more sense to have them show proven closed so that if it's not proven closed for some period of time, you can alarm on that. You don't really care if it's fully open, but you definitely care if it's not fully closed!
It looks in the end that it detects when the door opens just a little bit (I noticed too, that in the ha-demo it seemed to be backwards). I would skip the magnets in that case and use copper tape on the door sealing strip as a contact.
But, for the photo, it would be nice to know when it's fully open, so you could see the same fov every time.
@@villehietala9677 good point. Maybe a linear potentiometer at the hinge on the right side to get analog feedback?
Neat version one!
For version two, I would look into having weight scales for dedicated areas (milk, juice, butter) so the smart fridge can tell when you need to buy more. And some kind of mild/rotten smell detector for the vegetable drawer would also be good. Let's not go into why I know that...
Not sure if you used it or not but the esp32-cam module also has a separate wifi antenna you can buy that will help the stream quality. In my experience this with a good clean 5V power supply and bright even lighting does wonders for the cheap OV2640 camera.
A barcode scanner to scan the food 😄
Definitely have to add nearfield tags to all of your perishables! Great vid as always
I have a diffract project in mind for nearfield tags
1 second in and I am sold
I love your humor!
My fridge's control board gave up, home assistant, Node-red, DS18B20 temp sensors and some relays 🤔 should be possible to fix
If you’re using ESP home, I don’t actually think you need node red.
@@Mellow_labs my thought process was I may need Node Red to control a few of the things like switching off the compressor depending on whether the door is open (can most likely do that through HA) or not as well as delaying compressor start incase there's a power failure because where I live the power frequently switches on and off so basically delay start. But I may be able to accomplish all of that in HA with ESPhome, but I'd need to research more as I don't have much experience with either but I've got a bit of knowledge on node red
Fair enough, I’ve started moving away from node red. I would probably prefer to do it inside of ESP home because I wouldn’t have to wait for all of Home Assistant to boot up before my fridge can turn on again. It would be faster if that logic was on the microcontroller.
@@Mellow_labs slow boot times in my case would be a benefit due to the power issues, I was originally going to do everything in node red ...The only reason for adding Home Assistant into the mix was I like what I'd be able to do with it in terms of a dashboard...thank you btw for the replies it helps the thought process
Awesome and Subscribed. I'm looking at doing something like adjusting the temp in the fridge to be consistent. i.e. if opening the door a lot then put the temp down more but say if gone on holiday and not opening at all then no need to have it so cold or something along those lines. I'm loving the ESPHome stuff though. I've currently got 7 of them and created a smart desktop fan following another channel which cost me all of about £50 including the fan, I can control the fan either by HA or buttons on the actual fan but I'd like to make it adjust the speed depending on how much hotter the temp is compared to the ideal temp I can set via a few controls. With more and more companies closing their APIs and such these projects are very promising plus all local and no relying on a cloud provider or absolute minimum cloud reliance.
Great video but I would have hoped for a little more smartness than only taking a picture of the fridge contents. Maybe detect, classify and count objects (maybe even identify how much those are filled up) so that one could automatically put them on the shopping list if nearly empty?
Sure if you write the code for that, I only had a few days for the project.
@@Mellow_labs it was meant as an idea for the next project 😊😎
I’ll try my best it will be while until version 2
Why not have magnetic sensors for door open and have it just on the edge of the seal? Since it uses a magnet
Because it’s an inbuilt fridge there really not a lot of space between the door and the cabinet.
@@Mellow_labs sorry I was just thinking those sensors where magnetic based, I've been planning on building something similar so I'm probably going to be watching your development if you post about it again. It was quite interesting
Alarm when the temperature rises slowly. Our fridge recently didn't fully close over night because something inside blocked the door slightly. Everything warmed up and got humid. You wouldn't have noticed from looking at it. And I imagine a door sensor would have still indicated it as being closed.
Also can you take the picture when you are about to _close_ the fridge?
I think you could probably position the door sensor in such a way to catch when it’s just slightly open they can be pretty sensitive if positioned correctly. I could take the photo right before closing, but that slightly complicates things because it’s not a very fast camera and you kind of motion is just gonna bloody entire image. And I would probably need some kind of Excelerator on the door to detect when it’s being closed.
Another interesting video. One suggestion would be to have multiple cameras at a few levels. Then the camera could be contained inside the fridge.
I have thought about that, but it doesn’t look good. Unless you’re doing some weird AI combination of the camera feeds, it’s just kind of a mess. Also no Wi-Fi in the fridge. Everything has to be external anyway.
@@Mellow_labs There's no need to use AI shenanigans. You could use OpenCV's panorama/image stitching functions. It's a pity that everything has to be external, though :(
A funny and interesting video, once again!
Glad you enjoyed it!
You could have the camera potentially above the door looking down
I didn’t make the perspective
@Mellow_labs like camera sideways above the door? Does the darn thing not even see properly like that?
An idea : a 1 year timelapse of the fridge content 😅
Definitely 😂
You might not want to see the state of your apples and lettuce after a year in the fridge!!
* wifi because it probably requires a subscription....?
What is even "smart"?
Is a fridge really smart before it realises you are about to run out of milk and order you some more to be delivered to your door, so you don't have to?
Then it could also find discount codes and evaluate those towards the expiry date of the product and your rate of consumption and evaluate whether to order now or not 😅
These days the bar is pretty low, some are considered smart just because they have a display that tells you the temperature.
@@Mellow_labs I unfortunately remember when a "smart" fridge was one that simply could maintain a constant temperature and automatically turn the inside light on and off, unlike their predecesors that were big dumb boxes with no light and a large block of ice that you were constantly replacing!
if it works, why fix it
for fun i guess idk im not mellow labs
Mind your business
The first thing I did for my fridge is put a power metering socket. Then I wasted ~40 Euros on the wifi cable for my Bosch fridge. Totally useless, can't even tell which door is open. Has no temp sensors, only reports the temp setting.
Putting the refrigerator on a slope......... Yawn. You can make the door close on its own without sacrificing level. Also, neither one will fix a kid leaving something in the way that prevents the door from closing all the way.
Make the kid smart too, problem solved.😂😂