Which Chat AI Writes the Best Arduino Code?

Not all Chat AIs are created equal, and the code that they produce for an Arduino has subtle difference that may or may not make them suitable for your next project.
Here I compare Chat GPT, Phind, Claude, Pi, and Perplexity by setting them all the same simple coding challenge, and seeing how they perform in creating the Arduino application.
🔗Chat AI Links
ChatGPT - chatgpt.com/
Phind - www.phind.com/
Claude - claude.ai/
Pi - pi.ai/
Perplexity - www.perplexity.ai/
💡 Component List (Amazon Affiliate Links)
- Arduino Nano - amzn.to/3xOGgJd
- Prototyping Board - amzn.to/4dkZ6rC
- IP65 Addressable LEDs (100p/m) - amzn.to/4bjJsej
📹 Previous Video
Can You Program an Arduino using AI? - Arduino in Your Car Series, pt3 - • Can You Code an Arduin...
🩵 Follow Valentine Autos Socials
Instagram: / valentineautos
Facebook: / valentineautos
TikTok: / valentineautos
00:00:00 Intro
00:01:13 Circuit setup
00:02:40 The Task
00:10:58 ChatGPT
00:19:00 Phind
00:28:07 Claude
00:34:42 Pi
00:43:30 Perplexity
00:51:40 Roundup

[@mbunds]

ChatGPT writes and evaluates Arduino code the best for me, for the ESP32 variants and Mega 2560 so far, but there are many others to test. It used to present terrible examples, conflicting library versions and confused coding advice, but one day it produced some bullet-proof code that actually worked the first time, and has ever since.
It is important to prompt it with the fact that you are working within the Arduino IDE, (or VS Code, or Atmel Studio, etc.) along with the specific model and vendor of your board, but after that ChatGPT 4o will be the best code assistant among any of the others, unless somebody has trained an LLM specifically on microcontroller code.
Gemini is fairly good too, but still has problems though so you had better be advanced enough to know when it is hallucinating or it will have you frustrated in short order.

[@flytws6240]

Any reason to use gpt3.5 with gpt 4o existing?

[@ValentineAutos]

Simply the fact it's free and most readily available. A lot of the other solutions have better paid versions too, so keeping to the free versions across the board made it a fairer comparison

[@user-bg6mh6tv4n]

Isn't there a bouncing problem with the buttons?

[@ValentineAutos]

Yeah. Most of them didn't put in debounces straight away. Obviously it's easy to tell it to add them and it seems to do that fine for the most part, but ChatGPT royally screwed it up.