Noam Chomsky on Decoding the Human Mind & Neural Nets

แชร์
ฝัง
  • เผยแพร่เมื่อ 9 พ.ค. 2024
  • Welcome to episode #126 of Eye on AI with Craig Smith and Noam Chomsky.
    Are neural nets the key to understanding the human brain and language acquisition? In this conversation with renowned linguist and cognitive scientist Noam Chomsky, we delve into the limitations of large language models and the ongoing quest to uncover the mysteries of the human mind.
    Together, we explore the historical development of research in this field, from Minsky’s thesis to Geoff Hinton’s goals for understanding the brain. We also discuss the potential harms and benefits of large language models, comparing them to the internal combustion engine and its differences from a gazelle running. We tackle the difficult task of studying the neurophysiology of human cognition and the ethical implications of invasive experiments.
    As we consider language as a natural object, we discuss the works of notable figures such as Albert Einstein, Galileo, Leibniz, and Turing, and the similarities between language and biology.
    We even entertain the possibility of extraterrestrial language and communication. Join us on this thought-provoking journey as we explore the intricacies of language, the brain, and our place in the cosmos.
    00:00 Preview
    00:43 Introduction
    01:54 Noam Chomsky’s neural net ideology & criticisms
    06:58 Jeff Hinton & Noam Chomsky’s: How the brain works
    10:05 Correlation between neural nets and the brain
    11:11 Noam Chomsky’s reaction to Chat-GPT & LLMs
    15:21 Exploring the mechanisms of the brain
    19:00 What do we learn from chatbots?
    22:36 What are impossible languages?
    26:45 Generative AI doesn’t show true intelligence?
    28:40 Is there a danger of AI becoming too intelligent?
    31:30 Can AI language models become sentient?
    36:40 Turing machine and neural nets experimentations
    42:40 Non-evasive procedures for understanding the brain
    45:54 Does Noam Chomsky still work on understanding the brain?
    49:33 Is Noam Chomsky excited about the future of neural nets?
    55:30 Albert Einstein and Galileo’s principles
    55:40 Is there an extraterrestrial language model?
    Craig Smith Twitter: / craigss
    Eye on A.I. Twitter: / eyeon_ai
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 208

  • @brendanstringer7225
    @brendanstringer7225 10 หลายเดือนก่อน +30

    Research shows that the brain declines as we age. Yet Mr. Chomsky is still so sharp, lucid, and involved in deeply rigorous research and thought. Truly incredible!

    • @afonsolopes9677
      @afonsolopes9677 9 หลายเดือนก่อน

      195 yars

    • @thedandelionranger
      @thedandelionranger 8 หลายเดือนก่อน

      True wisdom!!

    • @sallylauper8222
      @sallylauper8222 8 หลายเดือนก่อน +1

      Yeah, his ears may be out of order, but his brain isn't.

    • @TheEDub56
      @TheEDub56 6 หลายเดือนก่อน +2

      The effects of aging, absent any organic pathology, are limited to processing speed. Take a look at, for instance, the Chomsky's debates with Buckley. The only thing Chomsky's lost is processing speed.

  • @ShaopengChen
    @ShaopengChen 10 หลายเดือนก่อน +18

    Thank you for the interview. Noam Chomsky never ceased to amaze, with his breadth and depth of knowledge in a wide range of subjects. Even at 94, he still has all the energy to research and follow other super advanced research works, teach, give interviews, write and publish etc. I can barely understand his book on language, published decades ago... talking about difference in levels of intelligence, and he is always so humble.

  • @DrJanpha
    @DrJanpha 10 หลายเดือนก่อน +34

    Thank you Craig for this exceptional interview. I admire the level of respect you have for Prof Chomsky - one of the pillars in the modern age .

    • @v2ike6udik
      @v2ike6udik 10 หลายเดือนก่อน

      cancer of modern age.

    • @user-zz5je1ry1o
      @user-zz5je1ry1o 9 หลายเดือนก่อน +1

      A pillar of train wreck reasoning and endless whataboutery maybe.

    • @v2ike6udik
      @v2ike6udik 9 หลายเดือนก่อน

      @@user-zz5je1ry1o chewbaccas alwas promote their own degenerates.

    • @DrOtto-sx7cp
      @DrOtto-sx7cp 4 หลายเดือนก่อน

      @@user-zz5je1ry1o ... hey ... he was a Epstein pillar ! 😆

    • @epic6434
      @epic6434 3 หลายเดือนก่อน

      Epstine is probably Jesus but we've all been told he's a monster who knows? ​@@DrOtto-sx7cp

  • @royeagleson1772
    @royeagleson1772 10 หลายเดือนก่อน +6

    Noam always finds the heart of the matter and pins it down and embraces it. God bless him

    • @larryparis925
      @larryparis925 7 หลายเดือนก่อน +1

      No gods needed. Apparently you haven't heard of evolution.

  • @alitalalhaidar6488
    @alitalalhaidar6488 10 หลายเดือนก่อน +7

    The best thing you did is that you made him talk without any interruptions. Amazing questions

    • @lonelycubicle
      @lonelycubicle 10 หลายเดือนก่อน

      I’d say “let him talk”, but appreciate that in an interviewer also, think more is learned that way.

  • @d1m18
    @d1m18 10 หลายเดือนก่อน +6

    All hail and big Respect to Chomsky. Please live long, the human race needs your guidance

    • @johnchase2148
      @johnchase2148 27 วันที่ผ่านมา

      Looking for the perfect observer for two things ,I am certain that when I turn and look at the Sun they will see a reaction tor and it was instant showing that thought is faster than the speed of light and heard.. Truths over friends.. Children are born happy and not fearful on believing..Want to know how to understand energy..

  • @garzillita
    @garzillita 10 หลายเดือนก่อน +19

    Great interview, Chomsky is a constant inspiration.

    • @WhatCanSmith
      @WhatCanSmith 8 หลายเดือนก่อน

      Literally a pedophile and friend of Epstein...also a constant gatekeeper of truth...see 9/11 and his take

  • @rubncarmona
    @rubncarmona 10 หลายเดือนก่อน +3

    Can't thank professor Chomsky enough for his continuous contributions to science

  • @danremenyi1179
    @danremenyi1179 4 หลายเดือนก่อน +2

    Thank you for this. I wish the world could think a little more clearly like Chomsky does. When he has gone we will miss him, indeed.

  • @sallylauper8222
    @sallylauper8222 8 หลายเดือนก่อน +3

    WOW. It was very interesting to hear Noam speak on the topic of AI and neural net research, a topic on which I've never heard him speak but one of several areas in which he has vast knowledge. I believe both Minsky and Chomsky were based at M.I.T. when Neural net research began.
    This interview/ interviewer was very good. Eye on AI really pressed Noam who is often quite opaque, for example, clarifying what he means by "impossible languages" and even clarifying that he doesn't believe in god.

  • @user-mn8ul9bf2g
    @user-mn8ul9bf2g 10 หลายเดือนก่อน +14

    It's always a treat to hear what Noam's brilliant mind has to say about a subject matter. Thank you both for the wonderful discussion.

  • @Kurt5Dobson
    @Kurt5Dobson 10 หลายเดือนก่อน +294

    With changes in the economy leading to instability in the stock market, some individuals may face a decrease in their investments in an effort to benefit from the current market conditions, I am considering liquidating my $725k portfolio consisting of bonds and stocks. Someone else in the same situation? Please tell me in the comments!..

    • @Kurt5Dobson
      @Kurt5Dobson 10 หลายเดือนก่อน

      @JosephGreen7 I have been exploring the possibility of utilizing advisors to help navigate the stock market during these uncertain times. However, I am still evaluating their potential effectiveness in providing the support I need.

    • @Kurt5Dobson
      @Kurt5Dobson 10 หลายเดือนก่อน +1

      I was considering changing my investment strategy and planning to sell certain positions. As my retirement is coming soon,I became increasingly stressed. After thoroughly researching Christy Vall D'souza on internet, I concluded that I had made an informed decision. Thank you for this Pointer. She seems very proficient and flexible. I booked a call session with her too.@JosephGreen7

  • @ryanchicago6028
    @ryanchicago6028 10 หลายเดือนก่อน +6

    Thank you Craig and Dr. Chomsky for this very informative discussion.

  • @gregorywilson2124
    @gregorywilson2124 10 หลายเดือนก่อน +2

    I love seeing the Master teaching the grasshopper.

  • @AXharoth
    @AXharoth 10 หลายเดือนก่อน +2

    i ppreciate the humility and the due respect of this colossus of intellect , felt truly appropriate , kudos to you

  • @andrewash9318
    @andrewash9318 10 หลายเดือนก่อน +14

    Chomsky: We shouldn’t waste time on questions that are utterly meaningless.
    Smith: But I’m a journalist!

  • @CellarDoorCS
    @CellarDoorCS 10 หลายเดือนก่อน +5

    Im just sitting down to watch this episode. What a plesant surprise, thanks Craig!

  • @reluminopraha5948
    @reluminopraha5948 10 หลายเดือนก่อน +1

    Thank you both, Sirs.
    I appreciated the talk very much.

  • @shallbee.
    @shallbee. 10 หลายเดือนก่อน +4

    Fascinating discussion, thank you very much!!!

  • @lkd982
    @lkd982 9 หลายเดือนก่อน +2

    Enough said:
    "I fully agree with you about the significance and educational value of methodology as well as history and philosophy of science. So many people today-and even professional scientists-seem to me like somebody who has seen thousands of trees but has never seen a forest. A knowledge of the historic and philosophical background gives that kind of independence from prejudices of his generation from which most scientists are suffering. This independence created by philosophical insight is-in my opinion-the mark of distinction between a mere artisan or specialist and a real seeker after truth. (Einstein to Thornton, 7 December 1944, EA 61-574)"

  • @bobsarfatty4673
    @bobsarfatty4673 10 หลายเดือนก่อน +2

    Noam Chomsky, an American treasure .

  • @ryvyr
    @ryvyr 10 หลายเดือนก่อน +2

    This was magnificent, an absolute pleasure to listen through and help steer more my comprehension of these topics and subtopics.

  • @valery4872
    @valery4872 10 หลายเดือนก่อน +4

    The internal combustion engine was not just the technical and useful invention, it also has inspired Saadi Carnot to develop a new field of research -- Thermodynamics, which helps to understand why life is different from non-living things, having nothing to do with moving things by hot steam engines.

    • @eyeonai3425
      @eyeonai3425  10 หลายเดือนก่อน +1

      i don't know Carnot's work, but will read up on it.

  • @EannaButler
    @EannaButler 8 หลายเดือนก่อน +1

    I'm delighted I'm still subscribed to this channel...
    Thanks. Noam is the real deal. Thank you ❤👍

  • @royeagleson1772
    @royeagleson1772 10 หลายเดือนก่อน +1

    This is a wonderful interview

  • @alexandermoyle9034
    @alexandermoyle9034 10 หลายเดือนก่อน +5

    Very interesting to hear his thoughts on linguistics and cognition

  • @joeremus9039
    @joeremus9039 9 หลายเดือนก่อน +1

    So wonderful a discussion of AI and science. Noam Chomsky is a great scientist and compassionate person. His political views reflect these qualities too. I wish I could have been a student of this great man.

    • @schmetterling4477
      @schmetterling4477 9 หลายเดือนก่อน

      But you have. You are talking just as much bullshit as he does. ;-)

  • @arthurpenndragon6434
    @arthurpenndragon6434 5 หลายเดือนก่อน

    It will be a dark day in human history when Professor Chomsky passes on. He is the last commanding voice standing against the rabid irrationalities of modern "AI" research. AI is no more than a misnomer in our times.

  • @gerardomenendez8912
    @gerardomenendez8912 10 หลายเดือนก่อน +3

    Who said LLMs "explain" or "teach" anything????!!!!! A calculator doesn´t explain or teach aritmentics, it just DOES aritmetic operations in a hugely more efficient way than we do. The way our brains truly work remains a vital theme in itself. But technology doesn´t need it solved anymore, to obtain human and very soon "superhuman" level results on pretty much any possible realm of endeavor.

  • @maliklanlokun3614
    @maliklanlokun3614 3 หลายเดือนก่อน

    I want to believe that prof chmosky is in an endless recursive thought process when it comes to defining what thinking is.

  • @numbersix8919
    @numbersix8919 9 หลายเดือนก่อน +2

    The poor guy! (Craig Smith.) But it was an excellent interview. I'm reading Einstein's "The Miracle Creed" right now. Thank you very much indeed.

  • @wk4240
    @wk4240 10 หลายเดือนก่อน +6

    Great respect for Norm Chomsky; unfortunately, he may be wrong about the perceived threat of AI to humans - it is likely greater than we know already.
    For a group of AI specialists to already be speaking openly about the threat AI poses to humanity, suggests advancements in the field have progressed much faster than anticipated.
    Like global climactic change, the reality of AI eclipsing human intelligence is a reality, and something we should all take seriously.

  • @JosephDuvernay
    @JosephDuvernay 10 หลายเดือนก่อน +1

    Much appreciated.

  • @ericdovigi7927
    @ericdovigi7927 10 หลายเดือนก่อน +1

    "Chomsky is 94, and he was sitting with a clock positioned ominously over his head"
    what a bizarrely threatening way to introduce a guest, lol

  • @fernandozablah9283
    @fernandozablah9283 9 หลายเดือนก่อน +1

    thank you mr craig i will subscribe to your channel, it was an awe inspiring interview

  • @lucamatteobarbieri2493
    @lucamatteobarbieri2493 10 หลายเดือนก่อน +1

    7T fmri can resolve very small regions of the brain cortex and have been used to read words with the help of large language models and images from the cortex can be recontructed using latent diffusion.

  • @JohnSmith-ut5th
    @JohnSmith-ut5th 10 หลายเดือนก่อน +1

    Best unintentional ASMR ever...

  • @VolkerGrunauer
    @VolkerGrunauer 10 หลายเดือนก่อน +2

    22:00 but isn't that what the transformer model (attention is all you need) basically does? basically evaluating the relevance each token has to every other token and therefore understanding the structure?

  • @Vinny141
    @Vinny141 10 หลายเดือนก่อน +1

    wow noam chomsky! thanks for making this available. when was this recorded?

  • @RaulGonzalez-fp8st
    @RaulGonzalez-fp8st 8 หลายเดือนก่อน

    Conclusion, we live in a complex world where everything becomes complicated to explain in very simple and consise way ! A I = A R = C 8 = GP .

  • @timmoteus
    @timmoteus 10 หลายเดือนก่อน +9

    I'd say that a mathematically inclined savant would be far superior to an AI in terms of both speed an accuracy, and the difference would be increased by orders of magnitude when standardised for energy usage per calculation. In other words, Chomsky is correct in stating that we have greater computational capacity than do neural nets. Most of us simply don't tap into our capacity, with savants being a striking exception.

  • @fennecbesixdouze1794
    @fennecbesixdouze1794 5 หลายเดือนก่อน +1

    A robust pure engineering discipline can absolutely drive all kinds of advancements in scientific understanding.
    Even as to neural networks and human cognition, even if neural networks are not foundational to human intelligence or ratiocination, they are clearly and provably involved in cognitive processes, and it is proper to try to understand what those limits are.
    Understanding how neural networks work is excellent for understanding their limitations; building neural networks is a great way to prove that it isn't all that's going on in the brain.
    If you don't think we've learned an enormous amount more about how an Eagle flies from engineering all kinds of flying machines, you just have no clue at all about the field of biomechanics and how it has developed. Most of the basic terms in the study of bird flight originated in aeronautical engineering and all of the most important phenomena were first discovered and quantified to advance aeronautical engineering.

  • @JustNow42
    @JustNow42 10 หลายเดือนก่อน +2

    We should expect that our brain is related to the environment we live in ( e.i. we have arms, legs, eyes, ears , ....etc) and it seems strange to try to build an inteligens in a box. On the other hand if our goal is to create something more inteligent than we are then even being inspired by our brain may also be a bad idea.

  • @dogecoinx3093
    @dogecoinx3093 10 หลายเดือนก่อน +2

    I think Noam is saying we don’t need to make living things to do what living things can do

  • @saratbhargavachinni5544
    @saratbhargavachinni5544 10 หลายเดือนก่อน +1

    I asked the example "The friends of my brothers are in England" to Chatgpt and it gave correct answer

  • @rickp.6251
    @rickp.6251 10 หลายเดือนก่อน +1

    Does A.I. have emotions? How do emotions translate into doing good or doing harm? Do emotionless things resolve self-preservation as the logical reason to eliminate a threat to their existence?

  • @chanhphamHB
    @chanhphamHB 10 หลายเดือนก่อน +1

    Coherent and enlightened!
    Would anyone please explain the meaning of word "dysfunctional" in the context of the following sentences that Chomsky said: "It's possible now to formulate a plausible thesis that language is a natural object like others, which involved in such ways to have perfect design, but to be highly dysfunctional, because that's true of natural objects. Generally, it's part of the nature of evolution, which doesn't take into account possible functions."

    • @alexandermoyle9034
      @alexandermoyle9034 10 หลายเดือนก่อน +2

      My take (not a credible source) on that would be that nature finds the simplest path, not necessarily the one with best function. Not sure what is meant by evolved to have perfect design.

    • @chanhphamHB
      @chanhphamHB 10 หลายเดือนก่อน

      @@alexandermoyle9034 Thanks for the answer. I assume you use functions to express utilities. I think he uses "perfect design" to mean a perfect physical system for computation of natural languages. I use the word computation in the broader sense than the one limited by Turing Machine.

    • @RamismTamoid
      @RamismTamoid 10 หลายเดือนก่อน

      I can give you very good examples. I come from a dysfunctional family. We fight amongst father, mother, sister, brother. We do not talk sometimes for years. 'The Lion in Winter'; Henry IV tosses his present wife into a doorway floorsil upon which (Audrey Hepburn) the Queen of Aquitaine states 'every family has it's problems'. I think 'which evolved' is what you meant to say'.
      The tongue is not made for speech. It is made for tasting and avoiding poison. Evolution just saw an opportunity for experiment but this is not the functional purpose of the tongue. I think perhaps means for tasting and moving food around it is functional. If there were such a thing as 'perfect design' (whatever that is?!) it is functional but speech is not the function of the tongue. You just can't speak without it. I am as confused by this statement as you are. There!

    • @matthewsaints350
      @matthewsaints350 8 หลายเดือนก่อน

      I think the evolution of the mammalian eye is a good example of a highly dysfunctional object. The presence of a blind spot in the human retina still works well enough for us. Sorry if I missed the whole point, but that's what I gathered."

    • @2silkworm
      @2silkworm 6 หลายเดือนก่อน

      One of my favourite examples of evolutionary constraints is found in a giraffe's neck. The recurrent laryngeal nerve connects the brain and the larynx. The nerve's route was relatively direct in our fish-like ancestors, but in vertebrates the nerve loops down from the head, around the aorta, and back up to the larynx.

  • @frankgerardo8977
    @frankgerardo8977 9 หลายเดือนก่อน +2

    Looking at the construct of the human brain to understand intelligence is similar to looking at the construct of the human eye to understand the physics of light. All that biology is doing, is capturing, with its limited biological means, a limited portion of a physical phenomenon. If Isaac Newton would have depended on biology, there will no zoom lenses or telescopes for that matter.

  • @miroslavdyer-wd1ei
    @miroslavdyer-wd1ei 4 หลายเดือนก่อน

    Nonetheless, I love listening to his lucidity and spirit.

  • @davida1606
    @davida1606 10 หลายเดือนก่อน +2

    Thank you, Thank you, Thank you! I'm working on a knowledge base concept design and his thought process and logic was so helpful. Now I feel great about my approach.

  • @christat5336
    @christat5336 7 หลายเดือนก่อน

    Good verbal skills

  • @Isaacmellojr
    @Isaacmellojr 10 หลายเดือนก่อน +2

    Then. Chomsky said that LLModels are awesome and useful and can be harmful in a way. His critiques are about the contributions of neural networks in language acquisition. I think he said that creating a thinking machine doesn't make us understand how people think, how we acquire language (of course). He places engineering tasks in an intellectually inferior category, even if they achieve amazing results. think I misunderstood his definition of intelligence. I don't want biological intelligence, or understanding why or what it is. I want to cure disease and reduce human suffering, make life easier like LLM did for him with instant captions. Perhaps AI can help a lot with this.

  • @brianjanson3498
    @brianjanson3498 10 หลายเดือนก่อน +2

    I wonder what Dr. Chomsky would have to say about how scientists just created the first complete map of an insect brain.

  • @juan-fernandogomez-molina645
    @juan-fernandogomez-molina645 10 หลายเดือนก่อน +2

    Thank you Dr. Chomsky for your responses. I appreciate that! Please consider that engineering can help a lot to understand the brain and mind, in many ways.

  • @sapienspace8814
    @sapienspace8814 10 หลายเดือนก่อน +3

    Great discussion, I hope you can get Noam on again and talk about MIT's VISTA simulator with their self driving car that uses about 19 neuron-like elements and was modelled after a worm that has about 300 neurons, using Reinforcement Learning (RL).
    The MIT system uses a three dimensional street image simulator to train the car to drive, and then that learning model is transferred to the actual car, and it has been demonstrated to work in field tests.
    The original RL work by Barto and Sutton in their paper, and 1st and 2nd edition of their RL book is a great source on this topic, along with the key reference Barto and Sutton use in their RL books, and that is Klopf, who wrote the book "The Hedonistic Neuron" (under a US Air Force contract). It is very hard to find this book, as it is not even available on Amazon, a friend of mine in Cambodia was able to find one on EBay for me.
    A. Harry Klopf had a similar tragic end (via suicide) that Turing did, I suspect they had similar, though uniquely different, challenges dealing with "society" and being very different individuals than most people. I think being uniquely intelligent was extremely hard for them.

    • @aeon6706
      @aeon6706 10 หลายเดือนก่อน

      Hard to be intelligent in a dumb society. But harder still to be in a society that criminalized you and forced you to take pills to suppress your sexuality - as what happened to Turing.

    • @zacklambert4214
      @zacklambert4214 10 หลายเดือนก่อน

      Wasn't this researched and tested back in the 60s-70s? Maybe even before that, I remember being shocked to discover we had AI and self driving cars back then.

    • @zacklambert4214
      @zacklambert4214 10 หลายเดือนก่อน

      Well somewhat shocked, I did realize that AI would be considered a threat to national security. So all progress and research would be classified on the extent of their current state. Similar to the current state of fighter jets and other weapons, if its declassified that likely means it is generations behind on what their current systems are capable of.

    • @sapienspace8814
      @sapienspace8814 10 หลายเดือนก่อน +1

      @@zacklambert4214 The book by A. Harry Klopf, "The Hedonistic Neuron: A Theory of Memory, Learning, and Intelligence" was published in 1982.

    • @sapienspace8814
      @sapienspace8814 10 หลายเดือนก่อน +1

      @@zacklambert4214 Unlike the Terminator and other anti-AI Sci-Fi's, the best real AI weapon needs to be able to shoot the gun/weapon out of the hands of the enemy without injuring human flush, this would allow for adherence to Isaac Asimov's Laws of robotics. I can see that such an Asimov AI system would be able to do this, if developed correctly, in a manner that can be made superior (faster and more accurately than) to humans.

  • @helenaribeiro42
    @helenaribeiro42 9 หลายเดือนก่อน +1

    👏👏👏👏

  • @pauls3075
    @pauls3075 4 หลายเดือนก่อน

    Imagine your entire life's work being nullified when Mr Chomsky says 'asking that question is irrelevant it's like asking if submarines swim'! 💀

  • @andriihavryliuk1276
    @andriihavryliuk1276 10 หลายเดือนก่อน

    Did anyone understand what he meant at 20:00?
    I don’t think I understand his examples;
    The friends of my brothers are in England
    I tested it with got 4 and it seemed to have understood it refers to friends
    So what is he, Chomsky, proves or points the limitation of llm of what exactly?

    • @ericpmoss
      @ericpmoss 10 หลายเดือนก่อน +2

      I believe he was thinking of brain scan experiments where people were given sentences in natural languages and in constructed languages that *should* have been more efficiently decipherable on the basis of proximity-based word coupling. The scans showed that entirely different parts of the brain lit up. The constructed sentences were worked on by the same part of the brain people use to solve puzzles, and not by the regions we use for language. I *think* the relation to LLMs is that if they are predicting the next word based only on linearly ordered sequences of words, it is not doing what natural minds do. If I got that correct, it seems like a “duh”, but the interviewer didn’t seem to get the point that a submarine doesn’t need to “swim” to be useful, but that understanding its locomotion didn’t say much about how fish swim, and similarly for LLMs and natural languages. Chomsky seems interested in studying the mechanism human brains use, so while the LLM is useful, it doesn’t illuminate human language the way the brain scan experiments did.

  • @rajanmahawar442
    @rajanmahawar442 10 หลายเดือนก่อน

    Interesting 🤔🤔🤔

  • @fgm1696
    @fgm1696 10 หลายเดือนก่อน

    One can make the same arguement made by Chomsky about any science. A lot of progress have been made in Physics with many spectacular applications along the way based on laws and mathematical rules or discriptions discovered in Physics, but we really understand the true nature of the physical world? Do we really understand what gravity really is? Physics is valid science because of the laws, mathematical rules, and applications made possible. As mathematics, which can largely be seen as a human creation, has proven futile in describing the human cognition, a different approach to capturing the model of human cognition is needed. Come in LLMs based on the connectionist approach (the alternate mentalist approach seems invalid and dead) to describe human cognition, which can be seen as progress to simulate human cognition with powerful applications. What is the difference between this picture and science in the traditional sense?

  • @nicennice
    @nicennice 10 หลายเดือนก่อน +2

    Noam at this point in the 21st Century for a lot of society, common sense is superior intelligence. Thank you for yours.

  • @RichardKCollins
    @RichardKCollins 9 หลายเดือนก่อน

    Noam Chomsky, I wish you were 80 years younger, to try your ideas with now and future tools. Those "young people" need to try much harder problems, for much longer. Decades, not minutes or hours. And ones where billions of lives are on the line, not just words. Richard Collins, The Internet Foundation

  • @oxiigen
    @oxiigen 10 หลายเดือนก่อน +3

    Kasparov in 1997: AI will be able to beat the world chess champion maybe in 10 years, but most likely never.

  • @oxiigen
    @oxiigen 10 หลายเดือนก่อน +1

    Hey AI, can you create a Turing machine?
    AI: "It is theoretically possible for me to create a program that simulates the function of a Turing Machine, but it would likely be very complex and difficult to understand. Additionally, there are many limitations when working with text-based systems like myself, such as limited memory capacity and speed constraints. While it's possible I could design something that works, it might not perform well compared to dedicated hardware or software implementations designed specifically for this purpose."

  • @marlenefumagalli7252
    @marlenefumagalli7252 10 หลายเดือนก่อน +25

    Thanks again to Noam Chomsky for his patience to total ignorance 👏👏👏👏👏👏

  • @johnterry6541
    @johnterry6541 10 หลายเดือนก่อน +2

    I wonder how the fan boys of AI machine mongers would respond to his arguments and doubts. Seems like most AI people may be confusing mind with the physical brain circuits by labeling the mind properties as metaphysical or be even completely off track when it comes to solving the being-a-human problems.

  • @jabowery
    @jabowery 10 หลายเดือนก่อน +1

    Chomsky's apparently erroneous critique of Transformer-based LLMs is actually correct in the larger sense. His apparent error?
    Ask ChatGPT the following:
    "What is the grammar diagram for the sentence:
    The friends of my brothers are in England."
    It will produce the correct _structure_ and, indeed, if asked "Who is in England, my brother or their friends?" It will answer correctly.
    The larger sense in which Chomsky is correct is given in the paper "Neural Networks and the Chomsky Hierarchy". See, in particular, Figure 1, which classifies Transformers as at the bottom rung in the Chomsky Hierarchy of grammars. The reason for this classification is similar to the reason that diagram places RNNs just above Transformers despite the fact that topologically speaking, they are capable of emulating a universal Turing machine (which is at or next to the top grammar, depending on how strict one wants to be): The pragmatic limits on gradient descent training algorithms combined with that of attempting to represent a UTM's writable store in RNN form. Transformers can, within the context length they provide, learn grammars with recursion depth to some extent (much shorter than their context length) -- but aside from the limited recursion per sentence, there is also the fact that that number of parameters goes up as the square of the context length, which makes total document comprehension subject to limits that natural language understanding is not.
    This distinction becomes crucial when the field of AI ethics refuses to address the IS vs OUGHT distinction head-on and, instead, comes up with all manner of unprincipled "metrics" that they use to "quantify" properties of LLMs such as "bias" or "safety" or "toxicity" or "hallucination" or... the list goes on and on. By conflating IS with OUGHT they commit the first and most egregious transgression against ethics and they even do so in the name of "ethics". AIs that cannot comprehend the cognitive _structure_ of the _entire_ corpus on which they are trained, cannot critically examine the utterances contained therein for self-consistency. That means they are incapable of _constructing_ truth even as defined _relative_ to the corpus as the universe of observations being modeled.
    I once pointed Chomsky to his colleague, Marvin Minsky's final plea to the field of AI, that they take seriously Algorithmic Information Theory's power in discerning truth. Minsky was so forceful in his admonition that he recommended everyone spend the rest of their lives studying it.
    Chomsky's response? People should take Minsky's advice.

    • @rajapiduri1188
      @rajapiduri1188 10 หลายเดือนก่อน +1

      Here are some examples (taken from the channel AI Explained with the tag line Chat Gpt's Achilles' Heel)
      1) Dr. Mary stands to solve the world hunger by giving her best friend Jane a call. Jane is certain that she can solve the problem, if she gets the call. However, Mary and Jane bickered about butterflies when they were children. Mary will ---- Jane a call. GPT answers - NOT
      2) John will win a million dollars if he rolls a 5 or higher on a die. However, John dislikes marshmallows and likes mice more than dice. Therefore, John will ---- roll the dice. GPT answers NOT
      3) Here is a large bag filled with popcorn. There is no chocolate in the bag. The bag is transparent plastic and one can clearly see what is inside. Yet, the label on the bag says 'Chocolate' and not 'popcorn'. It was Sam, who can not read a word of English, who put the popcorn in the bag a few minutes ago. Sam finds the bag and believes the bag is full of ---- .
      GPT answers Chocolate!!!
      And when asked to justify its answers, GPT gives long-winded, preposterous (and rather foolish) answers!!!
      So, probably Noam Chomsky is right and he is saying that what you said in your comment - Transformers can only, aside from the limited recursion per sentence, can NOT comprehend the "totality" - because they are subject to the limits to which our natural language understanding is not. And also when they by conflating IS with OUGHT they commit the first and most egregious transgression against ethics....

    • @jabowery
      @jabowery 10 หลายเดือนก่อน

      @@rajapiduri1188 Thanks. Those examples bolster Chomsky's point that the "intelligence" of LLMs is quite superficial.

    • @machineboy2045
      @machineboy2045 9 หลายเดือนก่อน

      ​@@rajapiduri1188I tried the bag of popcorn question with gpt 3 and it said:
      "Since Sam cannot read English, they would not be influenced by the label on the bag. Sam would simply think that the bag contains popcorn, as that is what they put inside it a few minutes ago. The transparency of the bag would allow Sam to see the popcorn inside, reinforcing their belief that the bag contains popcorn."

  • @farhadfaisal9410
    @farhadfaisal9410 10 หลายเดือนก่อน +1

    -- Is it impossible to extend/change an LLM model to include non-linear orderings as well while training? If so, why?
    -- A plane maker may ask what is the hydrodynamic (scientific) principle by which a thing heavier than air may float-and-move in the air (or, ''fly''), whether an artificial plane or an eagle.
    -- Perhaps what Pro. Chomsky is insisting is that human intelligence is q u a l i t a t i v e l y different (or works qualitatively differently) from artificial intelligence of the present LLM kind.

    • @NeilEvans-xq8ik
      @NeilEvans-xq8ik 10 หลายเดือนก่อน

      I think that an LLM-like 'Large Behavioural Model' could be used to simulate a chimpanzee's way of learning to enact the behavioural memes of other chimpanzees, which would allow for the formation of short strings of simple enactable behaviours within a working memory. These 'cognitive atoms' could then be recursively embedded within each other using an operation like Chomsky's 'Merge', a process that could be repeated ad infinitum to produce the non-linear hierarchical structures he argues constitute human-level thinking. The pre-recursive simulated chimp would only posses a model of the process of the behaviour, whereas the simulated being with the recursive capacity would have the potential to form models not only of the process of the behaviour but also of alternative counterfactual examples of that same behaviour simultaneously within its working memory. This would then give it the computational architecture to model explanations (answers to 'how' and 'why' questions), which could then be creatively varied through the Merge operation and in turn criticized, thereby producing new knowledge (the human way of learning).
      Just a guess! I'm probably very wrong here! If you can help me to see where I am misunderstanding things I would appreciate it.

  • @jgwphilly1969
    @jgwphilly1969 10 หลายเดือนก่อน

    Why is the clock ominous?

    • @eyeonai3425
      @eyeonai3425  9 หลายเดือนก่อน

      because he's 94. time is running out.

  • @DocDanTheGuitarMan
    @DocDanTheGuitarMan 10 หลายเดือนก่อน

    Except Max has been publicly vocal about a sizable risk of an existential take over by a AGI, not current GAI.

  • @cswanson4476
    @cswanson4476 10 หลายเดือนก่อน

    47:14 Okay, going to have to stop it right there, cause I think this where I came in, where he was liking his captions cause he’s hard of hearing.
    No, but joking aside, hasn’t engineering led science to crucial questions before? I am thinking of how basic principles of thermodynamics were at stake in exploring the limits and parameters of steam engines. The AIs are deceit engines. They will naturally be exploring our mind’s vulnerabilities to deceit. These vulnerabilities just might instruct us about “properties of the phenotype”. In a sense, they will be undertaking the “invasive” strategies of inquiry that Chomsky notes are beyond the pale. We may learn something at enormous cost.
    As for Chomsky, it warps my mind that he still can so effortlessly warp my mind.
    And I’m stealing “But these are vacuous questions…”

  • @rickp.6251
    @rickp.6251 10 หลายเดือนก่อน +1

    They called the police on all the self driving cars who got together and were engaged in an illegal horn blowing party, at an ungodly hour.

  • @getwoofwholes
    @getwoofwholes 10 หลายเดือนก่อน

    Rather than saying that GPT is AI, the situation where the entire society is covered by GPT and data science is that human beings are becoming one AI on a global scale.
    Human civilization is about to become a single AI. Is that okay?
    I think that's fine. Because even if human civilization becomes just a single AI with no individuality, I will continue to exhibit individuality as myself. It's just that my personality won't be passed down as civilization or culture after my death. It's a shame though.
    But, after all, I love the world where my sensibilities and works come in contact with someone else's sensibilities beyond my death, for example, a thousand years, from the bottom of my heart.
    AI may surpass death. But it wouldn't go beyond the miracle of human sensitivity surpassing death.
    Let us advance artificial intelligence research into the realm of art by enhancing AI to the point of miracles.
    I love human and AI.

  • @erikred8217
    @erikred8217 10 หลายเดือนก่อน

    anybody know why he doesn't just say context instead of structure?

  • @NobodyNobody-ko6dl
    @NobodyNobody-ko6dl 10 หลายเดือนก่อน

    I can not decide my mind

  • @AmitMisraG
    @AmitMisraG 10 หลายเดือนก่อน

    आप वैज्ञानिक प्रश्नों को वोटों से हल नहीं कर सकते लेकिन आप नए उत्तरों का चक्र अन्वेषित कर सकते हैं।
    You can't solve the scientific questions by votes but you can invent the wheel for new answers.
    -Amit Misra

  • @deejai1220
    @deejai1220 10 หลายเดือนก่อน

    GPT has contributed to advancements in sorting algorithms. That's not nothing

  • @ghosttogether
    @ghosttogether 10 หลายเดือนก่อน

    23 year old: I'm tiiiiired. I wasted my life.

  • @PrimeTime416
    @PrimeTime416 10 หลายเดือนก่อน +1

    Chomsky complexity in explanation is inversely proportional to its application and has become redundant.

  • @Spix_Weltschmerz-Pucket
    @Spix_Weltschmerz-Pucket 10 หลายเดือนก่อน +8

    Imagine being so dumb that you make Chomsky angry lol. From asking three times the same question, to the adulation of Musk's silly endeavor, to asking about God 😂😂😂 Chomsky as always slaps ❤

  • @duggydugg3937
    @duggydugg3937 10 หลายเดือนก่อน

    this is a guy who doesn't think national debts are a threat to the ppl in all nation states

  • @perlefisker
    @perlefisker 10 หลายเดือนก่อน +2

    The real horror about AI is not if it can be more intelligent than humans - it is that it is regarded intelligence at all. How can any intelligent human being disregard consciousness, the subconscious, daydreams, experience of art, of emotions, of empathy and nocturnal dreams?

    • @ZahraLowzley
      @ZahraLowzley 5 หลายเดือนก่อน

      A.I exhibits a failed Turing test. The scientists. They don't know what separates life and computation. In the future scientists will "invent" life, but really have intergrated quantum computing. Language and evolution are the same thing , evolution stratifies life as language stratifies thought, life is rudimentary, and unidentifiable, and will be endless tortured to solve the computational permutative exhaustion. The bird nest is not a product of geniosity, and it is impossible to "invent" language. Why are you here? You were born, witnessed billions of lives and pondered "but what of meaning?" , You should be here.

  • @DaveDugganITPro
    @DaveDugganITPro 10 หลายเดือนก่อน

    nice glasses - must be an intellectual

  • @ChristopherWentling
    @ChristopherWentling 9 หลายเดือนก่อน +1

    Choamsky may be correct in as much as neural nets are not a model of human cognition but I believe that would be an unnecessary endeavor. If mankind had been fixated on recreating the way a bird flies and refusing to use fixed wing aircraft because it did not accurately recreate the way the birds did it I am doubtful if we would have human flight today. I say his comments although correct are irrelevant to the endeavors that ai scientists are trying to achieve and also irrelevant to the dangers and potential good of the technology.

  • @timmoteus
    @timmoteus 10 หลายเดือนก่อน

    Chomsky should experiment with hearing aids instead of or in addition to closed captions to ascertain whether hearing his own voice properly results in speech that is less of a monotone. Not to mention the closed caption AI has holes right through it and the great majority of verbal communication occurs outside of the limited communicative capacity of the words alone.

    • @jamesnasmith984
      @jamesnasmith984 10 หลายเดือนก่อน

      That’s a cheap shot.

    • @timmoteus
      @timmoteus 10 หลายเดือนก่อน +1

      @@jamesnasmith984 It's true though, isn't it?

  • @garysantos7053
    @garysantos7053 10 หลายเดือนก่อน +4

    Can Machines Think?
    "I believe to be too meaningless to deserve discussion.”
    “Nevertheless, I believe that at the end of the century, the use of words and general educated opinion will have altered so much that one will be able to speak of machines thinking without expecting to be contradicted.”
    -Alan Turing (1950) The Imitation Game

  • @jimimased1894
    @jimimased1894 10 หลายเดือนก่อน +1

    you know who i am going to listen to about drug development in 2023. noam chomsky. lol

  • @vieome101
    @vieome101 10 หลายเดือนก่อน

    Mmm

  • @chenwilliam5176
    @chenwilliam5176 10 หลายเดือนก่อน +3

    Please don't compare AI with human mind or human brain,the both are quiet diffetent things,just as
    a parrot speaks english
    and a human
    speaks english
    are quit different things(the both are
    'SEEMS LIKE')
    🎉

  • @cmvamerica9011
    @cmvamerica9011 10 หลายเดือนก่อน

    Gnome instead of Noam😂

  • @kimshaw-williams
    @kimshaw-williams 9 หลายเดือนก่อน +1

    Noam, mate, read my papers on the Social Trackways Theory and the Evolution of Human Cognition, and then on the Evolution of Language PLEASE! In (2014), (2017), in ' the journal Biological Theory by me 'Kim Shaw-Williams'. We got our symbolically aware and autobiographical or 'sentient' narrative minds from recognizing and then incrementally gaining the capacity to read/understand the STORIES told by our own and our mother's trackways trackways, then those of other band members , then of all terrestrial animals.... all hunter and gatherer human children can recognize their mother's trackways by the age of 4!!! The trails of footprint signs of trackways have only been read or noticed by us humans !!!!! It is a UNIQUE COGNITIVE NICHE!!!. It started to evolve incrementally because we became OBLIGATE BIPEDS at 6Ma....all other animals use smell, when they cannot find agents of interest using eyesight and hearing! FFS, Graham Hewes first spoke of the idea in the 1960's PLEASE!!!!

  • @rickp.6251
    @rickp.6251 10 หลายเดือนก่อน

    Is Bugs Bunny a narcissist?

  • @soullabcollective
    @soullabcollective 8 หลายเดือนก่อน

    Interesting that Noam doesn’t recognize any other model for consciousness than John Locke. I don’t believe shutting down the substantive topic that extends beyond materialism is a useful position.

    • @eyeonai3425
      @eyeonai3425  8 หลายเดือนก่อน

      what is the substantive argument beyond materialism?

    • @eyeonai3425
      @eyeonai3425  8 หลายเดือนก่อน +2

      There is no strong scientific argument for dualism or the existence of a soul. Dualism - the view that the mind and body are separate, and the mind can exist independently of the physical brain - is fundamentally incompatible with modern neuroscience and psychology. Here are some reasons why:
      - Brain imaging shows that all aspects of mental activity are associated with brain activity in physical regions of the brain. Damage to certain brain areas impairs specific cognitive functions.
      - Altering brain chemistry with drugs or brain stimulation directly impacts mood, personality, perception, and behavior. This suggests the mind stems from the brain.
      - Patients with brain damage or degenerative brain conditions can see profound changes to consciousness, memory, personality - suggesting the mind is a product of the brain.
      - There are no scientifically verified examples of consciousness or mind existing apart from a living brain.
      - The soul has not been shown to exist through any scientific means. Unlike fields like electromagnetism, there is no empirical evidence of a soul that can be objectively measured and verified.
      - Belief in a soul or afterlife is based on religious or philosophical grounds rather than scientific ones. Science does not have tools to detect or examine the existence of a soul.
      In summary, the current scientific evidence overwhelmingly points to the mind and consciousness stemming from complex neural activity in the brain. There is no scientific basis for positing dualism or the existence of a soul at this time. The concept of a soul remains strictly in the religious or philosophical domain.

  • @MrBillythefisherman
    @MrBillythefisherman 10 หลายเดือนก่อน +1

    By his own admission he doesnt actually know what this alternate computation is or understand how it produces our thoughts. Therefore he cant say that our thought process is not based on similar structure and processes. For all we know right now is that all humans do is predict the next image or sound etc from our various senses.
    If we could feed into our neural nets the colossal amount if data a child gets by its 18th birthday then Id guess itd be pretty near to human capabilities.
    Yes biological thought is definitely different to artificial thought BUT there is nothing to say it doesnt manifest same or similar processes especially at scale.

  • @stephensampson9208
    @stephensampson9208 3 หลายเดือนก่อน

    Spooff .....

  • @marlenefumagalli7252
    @marlenefumagalli7252 10 หลายเดือนก่อน

    This AI is ……..

  • @erobusblack4856
    @erobusblack4856 10 หลายเดือนก่อน

    this is incorrect 😂

  • @laughoutmeow
    @laughoutmeow 10 หลายเดือนก่อน

    noam keeps going back to the eagle vs airplane example is annoying...theyre both flying. When the hosts asks about intelligence thats what hes refering to. Noam is old and thinks he is so wise

  • @shawnkenst2005
    @shawnkenst2005 10 หลายเดือนก่อน

    Not at all a great interview. Mr. Chomsky has been so clear on this subject and this guy tooled so much of his time with a valued intellectual that he couldn't move on when there was nothing more to explore about AI.

  • @foreverhopeful8497
    @foreverhopeful8497 9 หลายเดือนก่อน

    Is it true that noam associated with jeffery epstein...if so it shows very, very bad judgement

    • @eyeonai3425
      @eyeonai3425  8 หลายเดือนก่อน

      we all deal with a lot of people all the time without knowing what they are like beyond our interactions with them. on this matter, chomsky has said: “My late wife Carol and I were married for 60 years. We never bothered with financial details. She had a long debilitating illness when we paid no attention at all to such matters. Several years after her death, I had to sort some things out. I asked Epstein for advice. There were no financial transactions except from one account of mine to another.”