This AI Face Knows Your Halloween Costume

I used the amazing Luxonis OAK-D camera for the edge AI processing to control motors for face following, and used OpenAI's CLIP model (related to DALL-E) to do costume identification. Both were basically off-the-shelf components, requiring no custom training for either task! Let me know in the comments if you have any ideas for using or improving Mr. Creeper before the next Halloween!
===LINKS===
You can support me with the following affiliate links. Thank you so much!
* Luxonis OAK-D Camera: shop.luxonis.com/products/oak...
* Luxonis + OpenCV Robotics Kickstarter: www.kickstarter.com/projects/...
* Dragosaur Costume: amzn.to/3gfZr6k
* Polymaker ASA Filament (used for almost everything in this project): amzn.to/3AsOHIV
* UV Reactive PLA Filament: amzn.to/3TJbvuA
* Micro-Servo Pan-Tilt Mount: www.adafruit.com/product/1967
* Standard Servos (SG-5010): www.adafruit.com/product/155
* Raspberry Pi 4B: [yeah right]
All code for this project is maintained in the following Github repo:
* github.com/etotheipi/creepy_f...
===TIMELINE===
00:00 Intro & Demo
01:06 Background
03:23 Electronic Design
04:53 3D Modeling and Printing
07:22 Electronics Problems
09:10 OAK-D Camera Intro
12:51 Closer
===3D Models===
* Low-Poly Mask (Original): www.printables.com/model/1923...
* Low-Poly Mask (My mods): TBD
* Vase-mode Rose: www.printables.com/model/1314...
* Pan-Tilt Mount: TBD
* Eyeballs: TBD
* Bust of Reaper/Death: www.printables.com/model/2831...
* Skulls (solid for relic, voronoi for large one): www.thingiverse.com/thing:554...
#ai #artificialintelligence #3dprinting #luxonis #oakd #halloween

[@TechieSewing]

Finally watched the video! Really interesting but something has to be done with the title, it reads as an yandere ASMR and I wish I'd never known what it was, had to do some research as work ;) Maybe turn it into a statement, like "This AI can guess your costume!", or into a question.

[@ObsessiveEngineering]

I'm not sure I understand which title and thumbnail you're referring to. I've changed it so many times, haha. But I do like your proposed angle for the title. I'll try it. Glad you enjoyed the video!

[@TechieSewing]

@@ObsessiveEngineering Yeah, there were a few ;) I think "follows you" was the main culprit.

[@coradteofil7692]

Wow, this is amazing. Is there any way that you could make the code for the OAK-D and the servo turning public?

[@ObsessiveEngineering]

Yes! Normally I would've prepared a Github repo for it, but I ended up developing all this code directly on the Pi for quicker iteration. I will pull it off and get it into a Github repo and will add a link to the description. Thanks for watching!

[@coradteofil7692]

@@ObsessiveEngineering Thank you so much I will be waiting for updates

[@ObsessiveEngineering]

Here it is! I threw it together pretty quickly, so it might be missing something. Let me know if there's any issues with it! github.com/etotheipi/creepy_face_oakd_clip

[@coradteofil7692]

@@ObsessiveEngineering Hey I know it's a lot to ask and I will understand if cannot do it, but would it be possible for you to upload the code today? because I need it for a university project and I am unable to find any support for it, not even in the discord group

[@coradteofil7692]

@@ObsessiveEngineering Hello, I will bother you with one last question: I have implemented the code in the project and I noticed that the camera would over turn my face and jitter back and forth trying to center my face, I wanted to ask if you have any advise on how ti solve this issue

[@anon_y_mousse]

Did you have some music in the first version that was copyrighted? I kind of just ignore background music, so it doesn't get filed in my memory. Shame our copyright system doesn't work the same way. These days even just 1 second screws you over, it's ridiculous.

[@shamooo]

an image i think

[@ObsessiveEngineering]

Yes, there was an image that I used for testing the AI that I forgot I didn't get through my stock source. I guess I'm now officially a content creator, so I sympathize with the whole thing. I would hope if someone uses something I created that I sell that they do it through the proper channels. At the end, it was a good excuse to to do some extra editing I wish I had done the first time around, anyway. 🤷‍♂