AutoBill - An AI Powered Instant Checkout System | Edge Impulse | Raspberry Pi | Coders Cafe
ฝัง
- เผยแพร่เมื่อ 9 ม.ค. 2022
- AutoBill is an AI-powered autonomous checkout system for retail stores, that combines the power of computer vision and machine learning to provide an amazing shopping experience. AutoBill provides a faster checkout shopping experience to minimize human interactions in the store to keep shoppers and employees safer during the pandemic, inspired by Caper Counter.
AutoBill uses computer vision and deep learning to visually detect and instantly identify the items placed and the weight sensor measure the weights of the things placed on the counter-top (applicable for items that are charged according to their weights). Once the items are identified, things are automatically added to the cart and the bill is generated instantaneously. QR code for payment is generated and users can pay the bill by scanning the QR code.
𝐑𝐞𝐚𝐝 𝐃𝐞𝐭𝐚𝐢𝐥𝐞𝐝 𝐃𝐨𝐜𝐮𝐦𝐞𝐧𝐭𝐚𝐭𝐢𝐨𝐧
Hackster : www.hackster.io/coderscafe/au...
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
𝐒𝐮𝐩𝐩𝐨𝐫𝐭 𝐔𝐬 𝐎𝐧
Patreon : / coderscafetech
BuyMeACoffee : www.buymeacoffee.com/codersca...
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
𝐁𝐮𝐲 𝐂𝐨𝐦𝐩𝐨𝐧𝐞𝐧𝐭𝐬 𝐎𝐧𝐥𝐢𝐧𝐞
Raspberry Pi 3b+ : www.thingbits.in/products/ras...
Weight Sensor : www.seeedstudio.com/Weight-Se...
Amplifier Module : www.thingbits.in/products/spa...
Camera Module : www.amazon.in/Megapixel-Wide-...
LED Strip : www.amazon.in/Generic-WS2812B...
Power Supply : www.amazon.in/Easy-Electronic...
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
𝐌𝐞𝐞𝐭 𝐓𝐡𝐞 𝐂𝐫𝐞𝐚𝐭𝐨𝐫𝐬
Nekhil Ravi (Hardware Developer, Narration)
Shebin Jose Jacob (Software Developer)
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
𝐖𝐞'𝐫𝐞 𝐅𝐚𝐢𝐫𝐥𝐲 𝐒𝐨𝐜𝐢𝐚𝐥 𝐏𝐞𝐨𝐩𝐥𝐞
Facebook : / coderscafetech
Instagram : / coderscafetech
Twitter : / coderscafetech
TH-cam : / @coderscafetech
Official Email : mail.coderscafe@gmail.com
- - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - - -
𝐆𝐞𝐚𝐫𝐬 𝐔𝐬𝐞𝐝
Shot On : Lumix G7
Microphone : RODE Video Micro
Tripod : Digitek DTR 520 BH
Software : Adobe Premiere | Adobe Photoshop | Adobe Audition | Adobe After Effects
- - - - -
Music by: INOSSI
Listen: spoti.fi/2EzvEA6
Watch: • INOSSI - Moments (Offi...
- - - - - - วิทยาศาสตร์และเทคโนโลยี
AND THE MOST IMPORTANT POINT TO BE NOTED.....
THIS AI CHECKOUT SYSTEM NEEDS A WEB ONLY WITH WHICH THE WHOLE PROJECT IS FUNCTIONABLE.... AND THIS WEB IS ONLY AND ONLY FUNCTIONABLE IF UR OWN CREDIT CARD DETAILS R PROVIDED...HE DIDN'T EVEN MENTION THIS POINT IN HERE.... THE PROBLEM WILL ARISE FOR THE ONE WHO DON'T HAVE ANY CREDIT CARDS LIKE THE UNDERAGED STUDENTS
(WE DID THIS PROJECT BUT BECAUSE OF THIS DUMB VIDEO CREATOR DIDN'T EVEN MENTION THE STEPS PROPERLY THAT CREDIT CARD PART FULLY PUSHED OUR 1 MONTH OF HARDWORK INTO VAIN... ALL OUR MONEY WASTED..... )
DUMB!!!! DUMB!!!! DUMB!!!!!
It's okay to dump your frustration here, we understand your concern. As you don't have noticed this video was posted 2 years back and a lot of things have changed since then. At the time of posting video 'Heroku' was not paid or didn't required credit card. But as time progressed 'Heroku' changed there policies and we're not responsible for that. But if you search google you can find other free services like 'render.com' which is more than enough for this project.
And for you info, a DIY project doesn't mean following instructions blindly it involves a learning curve, where you learn new things on you own. Before posting you frustration you should try to contact the creators and check whether they're willing to provide any help. In our case almost 40+ people (especially students across the globe) has contacted us and we have provided help for each and every one who contacted.
But I agree with you this project is not for a beginner who don't want to learn anything but just simply make a copy.
Great work 🔥
This project is amazing
If anyone has successfully created the project, please reply because I am facing so many errors in the website creation part.
amazing project do you have a button for remove items?
what is the differentiating factor of this project to other similar ones?
Weight calibration is not working. I downloaded your code weight after calibration is showing 210g ie hard coded
Nice 🤗
Great work guys..One small query .
For apples ,2 nos were placed on tray , but in system 3 is being shown in video.
Is it system/code/calibration error or just got miss-mapped during video editing.
Please check once.
As you mentioned, the system doesn't count the items placed on the countertop, rather it just identifies the item placed on the countertop and measures the weight. The '3' shown in the video is the price of the item per unit (ie, price of apple per kg = $3).
Hello, so beautiful work, I have two questions. The prices could change depending the weight (especially just for produces ). And how difficult Is to copy the Amazon go technology for a small store with around 100 products.
We are using a weight sensor to measure the weight of the things placed on the countertop and we are calculating the prices according to that weight. The prices of produces may change daily and that needs to be updated on a daily basis in the database.
For copying Amazon Go technology to a local store you should depend on some intense deep learning and I think it will be somewhat difficult.
This is an amazing project! This is an innovative and novel work. Can you please demonstrate the writing of the following part of the program? Thank you very much
We won't be able to do that, but you can find the assets along with detailed documentation here: www.hackster.io/coderscafe/autobill-042d29
hi sir , need your help i was try run it but we can able to add the product using the add.html
Is it any possible to implement any other AMD hardware instead of raspberry pi?
At line 140, use map or something else instead of the entire if statement to check label . Use that label to check in database if present return price otherwise null. This is useful because we have several items in the shop and do not want to go to code and add an if condition. Also you can add manage database add or edit products price. Finally Nice product, try to sale these once you make all Loose coupling.
Kindly give your contact details...and help me running this please
hello, i guess barcode scanners are much more accurate and cheaper , don't understand the need of ml in this project .Its just a solution looking for a problem. Can u explain?
We appreciate your perspective, but if we may respectfully disagree, it seems that based on your argument, one might expect products such as Caper Counter and Mashgin to be less useful.
As far as we are concerned, we're just making some DIY projects where people can be easily inducted to TinyML, IoT, Robotics and more. Many people have shown interest in this project and replicated this project, so we're quite satisfied with the project.
Thank you. Could you suggest differentiating factor that we can add to this project to make it more useful than that of Mashgin?
@@CodersCafeTech your number please
Quick question regarding the weight sensor if we can't find the one you used in the video can your provide any alternative?
It is one of the popular weight sensors available. If it's not accessible, you have the option to choose any other reliable weight sensor, making minor adjustments to the code.
Did u go through the IEEE papers
Sir respberry pi 3 module B is not available, so can this be done with respberry pi 3 A.
Are there any changes we should make in project procedure if we use 3A ?
Raspberry Pi 4 only have official EdgeImpulse support now. But please give it a try on your Raspberry Pi 3A and see what happens, it might work.
Can I implement this project using raspberry pi model B now?
Model 3B or 4B?
Model 3B
@@Abin_Devasia Yes, you can.
Can i use zero?
@@CodersCafeTechcan i use zero?
How did you added thewr code
Respberry pi is connected to computer wirelessly right ?
Where are the commands(Git commands) typed in, respberry pi ?
Can you please explain the software part bit briefly.
To access the GUI wirelessly we used VNC viewer.
@@CodersCafeTech so the checkout coding you executed in respberry pi ?
@@Mrajayreddy If you are talking about the website, it is hosted in a website hosting service. Rest of the codes are running in Raspberry Pi.
Sir, Can we use USB camera instead of the pi-cam ? If yes, will that cause change in code or any other setup?
Yes, you can use a USB cam, but you should make sure that the code identifies the camera with proper drivers installed.
@Coders Cafe how and what type of software are you using to run raspberry and also are u downloading from the raspberry os itself??
Everything mentioned here: www.hackster.io/coderscafe/autobill-042d29
Can we do this project using Arduino board ?
If yes, what are the extra requirements?
Yes, you can do this project with Arduino boards. You can use boards like Nicla Vision, and Portenta H7 which supports EdgeImpulse. If you are using Portenta H7 you will need an extra vision shield, but if you are using Nicla Vision no extra requirements are needed.
If the User Interface is accessed by opening the index.html how will we access the website on a tablet when the html file is on the computer not cloud…how do we access the one on…I uploaded on Heroku but I’m not sure on how to access the user interface once it’s deployed
You should have your index.html on your tablet or you can deploy it on some cloud services
Can we do this using phone camera? (Without weight and super fast)Or can we integrate it with existing weighing scales?
Yes you can do both
and i get the full video ????
How to do it with arduino
can we use arduino instead of raspberry pi and alternative camera sensor (budget friendly) ??
You can use anything that supports Edge Impulse and it should have internet connectivity.
@@CodersCafeTech ok thanks ❤️
🤩
super bro, also make a variant without edgeimpulse bro, and with esp32 eye.
What should we use instead of Edge Impulse? What do you expect?
may be tflite micro or esp-nn
@@CodersCafeTech
@@akashsivasubramanian4067 We'll definitely try that.
i have only one week to do the project help me with that project plz????
How can I generate QR for payment ? (in Indian rupees) . I checked scanova. But there is no option for googlepay
It is the money reception link you get can generate in the format (upi://pay?pa=YourUPIID&pn=TransactionNumber&tn=A&am=Amount&cu=INR&url=RedirectionLink). Use that text to generate your QR code using scanova. But I should warn you this might not work. Because, for authorizing payment from a site it might require a properly established payment environment.
@@CodersCafeTech Failed to initialize linux tool Error: Cannot find any webcams, run this command with --disable-camera to skip selection
Edge impulse Linux not detecting Pi camera. Is there any solution?
Also, help function is working when billing.py is executed
@@abdulanzil5224hyy did you complete the project?
can i use arduino insead of raspberry pi will it work the same?
No, with this code it won't work.
Did you manage to turn this into a finished product to commercialise ? What are the major challenges if one decides make it a real product?
We haven't tried to commercialise it. The major challenge would be reliability of the model.
Thanks for quick reply. Does feature matching algo like SIFT , ORB can do this job and Why is going with AI classfication is better than the mentioned algo ?
@@akashsahu9787 AI can automatically learn from large data sets, providing more flexibility and robustness in handling complex data. Local features in images or videos can be detected and described more precisely using feature-based techniques like SIFT and ORB. The decision is based on the particular task and the data being studied. As we are handling complex and noisy data, AI will do the job better.
instead of rapspberry pi can we use Arduino board
Yes, you can use Arduino Nicla Vision or something similar.
Good work man, im interested in this project, i understood the part of edge impulse, but the part of server and ui i didn't understand, how and where to run server and ui code, please explain it to me
Read the documentation here : www.hackster.io/coderscafe/autobill-042d29
@@CodersCafeTech thanks for replay,i have read your documentaion, as i know python code for biling and balance and model will run on rasbery, front end ui will run on tablet as a web page , but i didnt understand the part of server and how to deploy it on cloud, another question, how many product i can detec with edge impulse , can i detect 1000 product?
@@nidalidais9999 The server is deployed on heroku. There is no limit for the number of products that you can train using Edge Impulse, but there is a limit of 4GB of data upload if you are using a free account.
@@nidalidais9999 have you tried the project? is ti working entirely?
Is normal 5mp pi Camera be enough for this project?
That would be enough, but not good enough.
@@CodersCafeTech when opened the link for camera from description, it's not available. It's out of stock. 😭
it is shown in the display what is the connection behind that ????????
Everything mentioned here: www.hackster.io/coderscafe/autobill-042d29
hi we deployed the proj in heroku and we followed all the steps but how exactly can we see the checkout UI system on our laptop because everytime we run "node server.js" or click on the api link it just shows "a blank webpage with API deployment successful"
There's a client folder within the CheckoutUI folder. You'll find a script.js inside client folder. Replace the url in script.js with your api and open the index.html in the client folder in browser. Now you should see the checkout UI.
hi, i ran that file but its just a normal html static file, how can i integrate this proj real time such that the objects getting detected on pi camera are reflected on the website too, i am struggling with that part, pls help
@@CodersCafeTech
@@atharvatadge5663Having the same problem…have you found the solution
@@CodersCafeTechHaving the same issue…if the User Interface is accessed by opening the index.html how will we access the website on a tablet when the html file is on the computer not cloud…how do we access the one on heroku
I have the same issue. If solve your issue please help me
but bro what about the application you have used in your tab to display the data??
It's just a website.
@@CodersCafeTechCan you name that website?.........actually I am making an computer project on your topic! so it is urgent
@@G_G12313 It's a custom built website. You can find additional details here: www.hackster.io/coderscafe/autobill-042d29
how are u using samsung tablet as display ?
You can use anything that has a browser because the checkout interface is just a webpage.
@@CodersCafeTech is it possible to connect display to an esp32 board through its usb? The question might seem stupid .. just want to know
What is an amplifier module how can i use that?
HX711. You can find more details here: www.hackster.io/coderscafe/autobill-042d29
how do you connect the display
It's not simply a display, it's a fully functional tablet.
what is the os for write into sd card for rpi 3b+?
Latest possible OS
Bro how was the interface created ? And also How to callibrate
If you're mentioning checkout interface it's a webpage with a NodeJS server running behind. And if you're mentioning about the weight calibration, it can be done with the python code.
How to connect the server with the model?
@@nawfallona4239 The python code will post the data detected by model to the server
Sir I want to replicate this project, i have lots of doubts can I share all those queries in mail ?
Sure.
cant really base this off of weight. two diff items you put at the same time could have the same exact weight. better to use the EAN code or plug UHF alien tag stickers on each item and just scan them with long distance rfid
Thanks for the feedback. The thing is not designed to identify multiple categories at the same time. You can place multiple items belonging to the same category at a time, then remove all of them from the base and place another set of things again. And this is a project based on object detection using images, entirely tag free.
Tags would add excessive cost and make it economically non viable. We sell tens of thousands of SKU's, so applying any inlays or stickers would add labor hours and the 6 cents you could get tags for do matter in a low margin industry.
Why do we need 5V adapter?
To power up the entire system we use the 5V adapter
@@CodersCafeTech But it is missing in the circuit diagram
Can i do this in raspberry Pi 3 A
Yes, it should be possible.
Bro how to use the python code in raspberry and also how to connect the interface to raspberry
You can run the python code from the terminal. And the interface is a website which is hosted, there is no need to connect it directly to raspberry pi, the connection takes place within the code. Just open the hosted website from the tablet (which is the interface we used) and you're done.
@aloneps3531 Please send a message on Instagram.
can we run this project on proteous 8
No, that won't be possible, we suppose.
Hello sir I was trying to run this code
I was using RaspberryPi 3B + after running edge-impulse-loinux this showing me this following error
"To which project do you want to connect this device? ICEM / Autobilling
GST] checking for /etc/os-release ?
Select a microphone or run this command with --disable-microphone to skip sel ection) bcm2835_hdmi - bcm2835 HDMI 1
[SER] Using microphone hw: 0, 0
Failed to initialize linux tool Error: Cannot find any webcams, run this command with --disable-camera to skip selection
at /us/lib/node_modules/edge-impulse- linux/build/cli/linux/linux. js:442:23"
My camera is working properly but still this error is showing please solve this problem....
Bro im also facing same issue.
where did you connect the cam wire and amplifier module in raspberry pi
The camera is connected to Raspberry Pi using the Flux Cable to the builtin camera port itself, and the amplifier module is connected to the GPIOs
Is there anyway to make it work with paypal?
Try to integrate paypal payment api within the python code. We haven't tested it yet.
How to connect the tablet with raspberry Pi?
There's no direct connection between the Raspberry Pi and the tablet. Data from the RPI is sent to an API, and the webpage on the tablet fetches the data from there.
@@CodersCafeTech is it all explained in the document? (The link that you have provided)?
@@guru7744 Yes, everything for replication is provided in the documentation.
@@CodersCafeTech thank you so much. 😀
how to connect mobile device
It is just a web interface. Open the URL in browser and you are good to go.
how to connect tablet to this system
You don't need to connect laptop to the system. Just open the index.html on your tablet.
Could you please help us in doing the project
You can follow this guide: www.hackster.io/coderscafe/autobill-042d29
can you provide the source code
Here it is: github.com/CodersCafeTech/AutoBill
Please tell me how to download modelfile.eim.
Assuming that you have successfully trained your model and set up EdgeImpulse CLI for Raspberry, now run this command to download the model file.
*edge-impulse-linux-runner --download modelfile.eim*
@@CodersCafeTechHow to set up EdgeImpulse CLI for Raspberry, Please
@@setthasakboonprasert5500 Here is everything you need : docs.edgeimpulse.com/docs/edge-impulse-for-linux/linux-python-sdk
@@CodersCafeTech Thank you, bro.
This works in 2024 ?
Yes.
What is the display you used and circuit diagram please...
@@digitronix532Everything mentioned here: www.hackster.io/coderscafe/autobill-042d29
@@CodersCafeTech I need help on the display you kept..is that a tab or raspberry pi display
@@digitronix532It's a tab.
how to download the model?
Everything available here : github.com/CodersCafeTech/AutoBill
In general for other projects developed using edge impulse sir
@@jnaneshshetty8583 You can develop your own models using Edge Impulse ( studio.edgeimpulse.com )
eda uvve nee malayali aarno
Athello
@@CodersCafeTech swabhavikam 😂
*** PAID HELP ***
Anyone can help me build this ?❤️🔥
Send an email at mail.coderscafe@gmail.com
INSTRUCTIONS INCOMPLETE!!!!!
Dumbest video ever to exist!!.... I agree this project was a nice idea but the owner didn't even show every details...
Specially to mention....
• He didn't even mention about the costing and all (specially cuz it is not for underaged ones)
• HE didn't showed the proper way for connection and all....
• HE provided all the codes I agree BUT HE DIDN'T MENTION THAT PYTHON NEEDS SOME DIRECTORY AND ALL TO BE DOWNLOADED FOR IMPORTING THOSE CODES PROVIDED.....
• HE didn't even showed us the steps for web development and all... am mentioning this one specially for the ones who don't have any idea about web development...
awesome work - share your contact - need this solution.
How i can contact you
Please send a mail at mail.coderscafe@gmail.com
Hello man , im interested in your project , i tried to make it , but i failed, can you help me, can i contact you
Drop a mail at mail.coderscafe@gmail.com
were u able to do it compeltely? please let me know, im also facing lot of errors
@@aseelahmed9677hy did u complete??