It's just a language model which also figured out some relations between words (hashes) in coding, math etc... it actually doesn't compute anything. I think it is impressive considering that. I am quite sure there will be some math / coding specific model available in future, which will be way more capable for such tasks. But at the same time it also proves that despite how intelligent ChatGPT looks like, it is still just an "narrow AI" (and so we are nowhere near any AGI).
Great video, I've tried asking it a bunch of math questions. Things like combinatorial proofs, graph theory proofs, etc. It writes pretty well, often structuring mathematical language/plausible sounding proofs better than students, but ultimately it gets a lot of justification wrong, even when you correct it. It's still pretty cool.
Very cool video. Just curious as an instructor for the same course. How much time do your students have to attempt this exam? Does it happen in a usual class slot or some additional time?
Chat GPT gets even 4th-grade math questions wrong, I'm surprised it answers these things correctly. I am also surprised I can answer them despite being a high school student.
I knew the outcome before I clicked on the video, I asked it to create sample questions e.g giving me languages to create a CFG / CSG for, and the stuff it gave back to me was complete balderdash
Thank you for breaking this down. Hope to hear more analysis from you in the future. Even though I have no idea what your talking about. For some reason I’m just happy someone like you exists. Cuz I ain’t no help 🙈🫣🤣🤣
![เปิดบ้าน นาราเครปกระเทย 1 ไร่ ขายขาดทุนหลัก10ล้าน เอามาใช้หนี้!!! l [Nickynachat]](http://i.ytimg.com/vi/0jz84VFWVP4/mqdefault.jpg)
It's just a language model which also figured out some relations between words (hashes) in coding, math etc... it actually doesn't compute anything. I think it is impressive considering that.
I am quite sure there will be some math / coding specific model available in future, which will be way more capable for such tasks.
But at the same time it also proves that despite how intelligent ChatGPT looks like, it is still just an "narrow AI" (and so we are nowhere near any AGI).
Great video, I've tried asking it a bunch of math questions. Things like combinatorial proofs, graph theory proofs, etc. It writes pretty well, often structuring mathematical language/plausible sounding proofs better than students, but ultimately it gets a lot of justification wrong, even when you correct it. It's still pretty cool.
btw, chat gpt cant help you with complex questions unless you help it specify each thing in particular.
Very cool video. Just curious as an instructor for the same course. How much time do your students have to attempt this exam? Does it happen in a usual class slot or some additional time?
14:38 You're saying the number is f1*n2+f2*n1-f1*f2, yet the question asked about f1*n1+f2*n2-f1*f2, so isn't the answer False rather than True?
So for true/false questions the result was 7/15 -- about 50%, as expected for random guesser. For other questions the result was 0/9.
LITERALLY my university be like right now using chatGPT :))))
Nice
Chat GPT gets even 4th-grade math questions wrong, I'm surprised it answers these things correctly. I am also surprised I can answer them despite being a high school student.
I knew the outcome before I clicked on the video, I asked it to create sample questions e.g giving me languages to create a CFG / CSG for, and the stuff it gave back to me was complete balderdash
Worth pointing out it really only got the T/F right...realistically, if you guess T/F you're just as likely to get these same answers haha
It cant do math. Shocker.
Thank you for breaking this down. Hope to hear more analysis from you in the future. Even though I have no idea what your talking about. For some reason I’m just happy someone like you exists. Cuz I ain’t no help 🙈🫣🤣🤣