Pixy2 Camera - Image Recognition for Arduino & Raspberry Pi
ฝัง
- เผยแพร่เมื่อ 31 พ.ค. 2024
- Check out the Pixy2, a smart camera with image recognition capabilities!
Pixy2 from DFRobot - www.dfrobot.com/product-1752....
Full article with code at dronebotworkshop.com/pixy2-ca...
More articles and tutorials: dronebotworkshop.com
Join the conversation on the forum: forum.dronebotworkshop.com
Subscribe to the newsletter and stay in touch: dronebotworkshop.com/subscribe/
The Pixy2 is a low cost yet powerful camera that is capable of object recognition, line tracking, and simple barcode reading. The device is the latest iteration of the Pixy Cam, a project built by Charmed Labs in conjunction with the Robotics Institute at Carnegie Mellon University.
With a variety of interfaces and lots of code libraries and samples, the Pixy2 can be used with an Arduino, Raspberry Pi, Beaglebone Black, or just about any computer, microcomputer, or microcontroller.
In this video, I will show you how the Pixy2 works, how to hook it up, and how to train it using software called PixyMon which runs on Windows, Linux, and Mac OS X. I’ll then show you how to easily hook up your Pixy2 to an Arduino and run code to detect an object, lines, intersections, and simple barcodes.
Thanks to its onboard processor the coding for Pixy2 is very simple. It provides a very easy method of adding vision to your next Arduino or Raspberry Pi project.
Here is the table of contents for this video:
00:00 - Introduction
02:18 - Pixy2 Introduction
05:53 - Pixy2 Unboxing
08:02 - Using PixyMon
14:01 - Color Signature Training
20:32 - Arduino Hookup
21:48 - CCC Hello World Demo
27:44 - Line Tracking Intro
29:24 - Line Hello World Demo
As always there is a detailed article on the DroneBot Workshop website.
And while you are there please consider joining my newsletter, it’s my way of keeping in touch - dbot.ws/dbnews. - แนวปฏิบัติและการใช้ชีวิต
Great video! We’ll explained!! Also, I love the fight that you’re having with keeping your hands from moving around. Please keep the videos coming.
I love the way you explain each introduction it makes me more confident in learning arduino.
This is a great device for robotics! Thanks for making a video on it. I'll definitely be getting some of these for my robots. I especially like the barcode feature as those can be used to make certain the robot knows which room it's in for certain, etc. Thanks Bill.
Thank you for taking the time to put together really clear and easy to understand content!
This tutorial is awesome. Your tutorials just keep getting better and better, & I'm learning a lot.
You are one huge treasure trove on the TH-cam planet! Thanks a lot for providing invaluable learning tools!
Was hoping you'd be back in the workshop soon! Always a pleasant show!
Awesome content! Please do a video on your workshop! It looks super organized and well stocked.
I am Korean.
I can't speak English.
But I am still listening and listening hard.
Thank you very much.
Aaaaaaaaaaaaaaaaaaaaaaaaaa yeah you welcome
I am Moroccan
I can speak English
so i'm learning a lot
thank u very much
@@technoking6636 These days, translation is easy so you can study as much as you like.
I'd like some good information.
언어를 떠나서 이분 말씀은 귀에 잘 들어오지 않나요?
진행이나 표정도 편하고 설명도 상당한 준비로 꼼꼼하게 해 주시고,
정말 멋진 분이라 생각 합니다.
Welcome my friend
you are a high school teacher that I've never had. Thank you!
Wouldn’t one be lucky to have this gentleman teaching tech in the local high school.
As always well presented material and just at the right pace. Thank you for your work, you will soon reach 100k subscribers.
I just tore apart my Blade 350QX which has no6 been able to bind since I crashed it. I have decided to build another, which led me to you, which led me to Arduino. My first kits should be in mailbox tomorrow and you will be in my daily routine. Thankyou for your concise content.!
Could you please make a video of your workshop...the kinds of storage options you use and how your workbench and equipment is arranged. It looks super neat.
SWEET ! Thank you !
I just ordered one for my Omnibot 2000 upgrade project !
You, Sir, are AWESOME !
Where did you order pixy 2 cam?
Pls do reply..thanks in advance
Another brilliant vid. I think you are an amazing teacher. Wish i had teachers like you when I was at school and college 60 years ago.
Agreed. Wish I had this tech 50 years ago. And now days its for under $20 for most things, and some of those sensors less than a few bucks! I am very excited about this now and have SUBSCRIBED with a passion to this YODA in his field. There is NO TRY, Just Do It! ;)
Its also good to have come in late, as it were, as I am not hanging out for the next video. For the main ones I want for now are already done and ready to view. Timing is a lot of everything, and keep the ball rolling with the momentum. Hope you are enjoying yourself and expanding your ideas. With a good android phone with USB OTG, I think the software for an AI robot would all be able to fit nicely. Recognition like this Pixy2, and self learning.
Very well presented. Looks like a very cool device. Gotta get one. By the way, I'm envious of your workshop. Very nice setup.
Great video! Would like to see the Pixy2 in an actual line following robot. Could be a multi-episode project. Anyway, awesome video, keep them coming.
Thank you for yet another amazing video. You deserve more subscribers!
Your workshop is so much organised 😍
This man is a legend, I would like him to be my teacher. plz never stop your videos!!
I love all your videos, keep em coming! Thanks.
This was such a fantastically informative video. The Pixy looks perfect for a project I have in mind.
Wow, this is soo beautifully explained!!
As always, amazing tutorial !!!
Thanks for this tutorial. Your workshop is neat.
All the information are presented with ease thanks and keep to teach us.
very informative about the subject.
Moreover, I love the workshop, so systematically arranged with all sorts of components there.
Perfect instructional video! Congratulations!
At the start of the video, I thought...what good is this to me and at the end I was thinking...this has some interesting possibilities. Thanks for an informative video.
great great channel. thank you for sharing videos of your workshop
After watching this, I decided that the Pixy2 is mature enough now for my needs.
I love your channel and your teaching ❤️
Awesome, I love your channel, very useful content ++ .
I always support you . very good detail guide and impressive all presentation and essential info share . I had follow you more than 7 years..if I not wrong
I was thinking about buying this camera, so, i decided watch some videos about, after watching this video i ordered in Amazon. Thanks for this video.
Gotta get one of these, thank you!
That is one awesome piece of hardware. Thanks.
that's cool~ i love this tutorial so much~ thank you so much!
this channel is very underrated
Man, you're amazing! I love your videos. Very educational.
thank you so much i really needed the help!!
Great clip. Thank you!
A lot to learn really. So amazing of course.
Nice job. Very helpful!
I'm getting into this stuff because I recently went to Disney World and "made" a BB "robot" at the Galaxy's Edge Droid Depot. This thing has zero autonomy and the interactive features are explored in a matter of minutes. Hopefully, I can use what I'm learning here to come up with some worthwhile mods. I'd love to see you rip one apart and experiment with it!
Great video, perfectly understandable even at 1.75x playback speed. This is amazing tech, probably military grade from 10 years ago. In other words, bleeding edge to Amazon commodity in a decade. Just amazing.
FYI... you could set your font in Arduino a good bit larger and add ample margin because it is off the edge of my screen.
Excellent video. Thank you!
Your channel is fantastic
LOVE YOUR CALM. TNK S FOR YOUR VIDEOS.
와우 픽시2캠 사용해서 색인식이랑 학습을 하던 도중에 궁금한게 생겨서 검색했따가 해결하고가네요 ...구조에 대해서 제가 잘못알고 있었네요 ... 비록 영어 설명이지만 잘 이해하고 갑니다 꽤좋은 모듈기계같습니다 픽시2캠은 ! 좋은영상감사합니다.!
Very interesting products.
I wish have one in my work shop
Ok, so the part in the code that says 'pixy.ccc.blocks[i].print();' prints out the xy position, size etc. Is it possible to extract that specific data for use in other functions? For example, if block 1 moves below a certain y distance, then return a signal.
gee, i have one of these in the box somewhere, got off on RPi-opencv... so much to do... need to use this wonderful info and get busy with the Pixy2 width measurement Low-OK-High_IO thanks :)
mind blowing for a little over $50 bucks! Great video.
Thank you very much for the videos you make. I have a question: Is there any function in the pixy library to capture a snapshot of the detected object? Thank you very much.
Please make a tutorial about how to have a nice and clean workshop!!!
Sir u R doing great work ...thanks alot
Hello! May i ask if is it possible to modify the code for the Pixy to move towards the object? As i am doing a project on development of an accurate landing solution and had built a landing pad. I was thinking if isit possible to teach the pixy to read the pattern of the landing pad and write a code on arduino to execute the landing?
Very nice presentation, clear and understandable speech. Excellent work. Thank you.
You are very welcome Oguz.
@@Dronebotworkshop Thank you kindly for your videos I follow you 💯 from #YSW respect back to you please keep making videos and help out as many people as you can with there projects excellent work you do Top Quality workmanship
Can the pixy2 be trained to follow living things? For example recognize certain insects like cockroaches and detect their movements? This is very important for creating and keeping clean environments. If not what would would be another route?
Is arduino leonardo works well just like arduino UNO ??
connecting pixy2 with arduino leonardo same side? (connect pixy2 outwards of arduino leonardo board??)
love this channel!
Very cool vid!
can we use it to recognize hand signs for example peace sign and others signs with our hands and if we can dose it possible to use what the pixy2 recognizes to make the Arduino give commands?
thank you for ur videos it is very helpful.
Great explanation.
Excellent video and content
Its very professional video ... Big thumbs up
very good explanation sir
I guess for non spherical objects (they look the same no matter how oriented), like the flashlight you would train using multiple orientations, then accept all of those different blocks as the same object ..
I have a project to detect the house driveway, and external walls lines, and already cutted areas lines, do you think I can use Pixy2 to accomplish my project? Thank you!
Suppose I want to track a hand, but I only want the object to be recognized when I see the palm. And, if I see the side of the hand, or the back, the object is not being tracked. Do I train the Pixy2 to track JUST the palm, or can I show the entire front of the hand?
Is it entirely by colour or does it look at shape and proportion as well? If you put a blue golf ball in the image would it say it is a golf ball, a flashlight or not detect it? What are the 16 types of barcode it reads (UPC, EAN, Code 11, etc)? is QR one?
thank you , very helpful
What an awesome tutorial!!! Please make more videos! Can you make a video showing how to use the readings from the camera with the Arduino to turn on an LED for example when the camera finds a golf ball?
th-cam.com/video/GnnFy0uFe3E/w-d-xo.html
Hello, I'm wondering if you can get RGB values back from the Pixy. Now it's detecting block, but can it we just give a average color of an area. The idea is, to measure the color average temperate in a room, and the arduino could copy the given average color to an RGB LED ?
is the pixy2 cam able to identify white objects ? it does not have white as one of the RGB led modes. The colour balls i wanted to train are 1. white 2. yellow, 3. light blue, 4. orange.
Fantastic video. Very clear and well presented. Thank you. 🇬🇧
Great video! Is it possible to combine the line following with shape identification?
you are the best!!! thanks a lot!!!
You think that i could use the 7 signatures plus with the color codes to track more objects?
Could i use this for obstacle avoidance or make it work together with a ultra sonic sensor for the same result?
What about using the Pixy2 for building a sentry? A fixed point sentry using airsoft or paint balls ?
i was waiting for a video on esp8266. but this one is also excellent. i hope next time the video will be on esp8266
Good video sir but i would like to know what is the max range for objects recognition with this camera ? And do you know if it recognyze well shiny object like a LED ?
Hi.Thanks for full explanation. Does pixy camera can recognize black color (like a black ball)?
In youtube, Some people uses rasbery-pie and open-cv (open-software ) to detect something. So Pixy2 joining into rasbery-pie with open-cv will produce more interesting project.
amazing ,, thank you so much
Can I use this camera to count how many objects have passed through its vision? Thank you for answering!
Hi, Thanks a lot for the video!
I would like to know how I can display the signature name for an object through the Arduino serial monitor.
I would also like to know how I can make the Arduino do a specific action after detecting a specific object.
Thanks again!
Thank you so much :)
love your videos
Thanks so much
...can an arduino decode pre-defined color on a pic file in SD card without extra color decoding module...? Decoded GPS points to a location on map with color that points to its timezone
The tx led on my arduino is open when i conect it on my laptop(the arduino is not running the scetch and when i upload a new scetch, the arduino is not reading it. )
But if i only power the arduino the tx led is closed.
Can you help me with that?
Great video! How can we connect multiple pixy2 with the mega? Suggestions will be really appretiated.Thanks
very nice video, thank you
So we always need connect the pixy 2 to the computer to run the detection?
I there any way this module with Arduino can give me x and y position in plane 2d paper from top view.. can it tell distance between two objects in 2d plane.. and clear straight path from a object to other object ..and also can it tell angle using Arduino... Are these things possible using Arduino? Or I have to use raspberry 3?
Is there a way to add a oled that shows what the camera sees for the arduino