Geoffrey Hinton: The Foundations of Deep Learning

แชร์
ฝัง
  • เผยแพร่เมื่อ 1 มิ.ย. 2024
  • Godfather of artificial intelligence Geoffrey Hinton gives an overview of the foundations of deep learning. In this talk, Hinton breaks down the advances of neural networks, as applied to speech and object recognition, image segmentation and reading or generating natural written language.
    #ElevateTechFest
    For more info visit:
    Website: elevatetechfest.com
    Twitter: @elevatetechfest
    Facebook: @elevatetechfest
    Instagram: @elevatetechfest
  • วิทยาศาสตร์และเทคโนโลยี

ความคิดเห็น • 110

  • @blek1987
    @blek1987 4 หลายเดือนก่อน +2

    What a luxury to be able to watch this on-demand, from anywhere, and for free!

  • @atifadib
    @atifadib 3 ปีที่แล้ว +24

    Man he has a great sense of humour

    • @kuldeepsingh876
      @kuldeepsingh876 ปีที่แล้ว +1

      and has the clarity at the same time.

  • @dripcode2600
    @dripcode2600 ปีที่แล้ว

    Always been fascinated with computer neural networks. Exciting times!

  • @powertester5596
    @powertester5596 ปีที่แล้ว

    This is extraordinary!

  • @kentrader2489
    @kentrader2489 4 ปีที่แล้ว +15

    This was a great presentation

  • @xiaochengjin6478
    @xiaochengjin6478 5 ปีที่แล้ว +3

    watching such an amazing video at 5 am

  • @Alp09111
    @Alp09111 5 ปีที่แล้ว +5

    loved this, thank you!

    • @ElevateTechCA
      @ElevateTechCA  4 ปีที่แล้ว +1

      No, thank YOU for checking us out!

  • @neerajsingh-xf3rp
    @neerajsingh-xf3rp 11 หลายเดือนก่อน +1

    deeply insightful

  • @MrMehrd
    @MrMehrd 6 หลายเดือนก่อน

    13:13 this photo of rnn is most best photo I’ve ever seen about rnns

  • @shivakumarcd
    @shivakumarcd 6 ปีที่แล้ว +92

    "so if you're obsessed with only being one correct answer and you're being able to prove you get it, backpropagation is not for you nor is LIFE"

    • @loopuleasa
      @loopuleasa 6 ปีที่แล้ว +5

      classic Geoffrey

    • @wishall007
      @wishall007 5 ปีที่แล้ว +11

      He hasn't lost the British sarcasm

    • @shubhampandey1997shreeg
      @shubhampandey1997shreeg 4 ปีที่แล้ว +2

      Actually by that line prof Hinton refers to the time when no one believed in his line and work of research and that decade taught him a great deal of patience until the technology reached a certain level to cope up with his knowledge.

    • @shivscd
      @shivscd 3 ปีที่แล้ว

      @Ernest Alonzo WOW.. Do you think people who watch these video fall for you?

    • @RyckmanApps
      @RyckmanApps ปีที่แล้ว

      That was the best of his one-liners and zingers.

  • @dannyiskandar
    @dannyiskandar 5 ปีที่แล้ว

    amazing ..thank you

  • @bensonmwaura9494
    @bensonmwaura9494 5 ปีที่แล้ว +1

    A tensor for paradigm shifts.

  • @mohammedalmukhtar5428
    @mohammedalmukhtar5428 5 ปีที่แล้ว +7

    He is a Genius..Period.

    • @holmerlike8395
      @holmerlike8395 2 ปีที่แล้ว +1

      AND, you must be a complete moron for believing such !
      Or perhaps simply, just riding the gravy train... Keep it go'in Buddy !

  • @jmf3210
    @jmf3210 ปีที่แล้ว +1

    Cool it with the 1960's slide presentation....definitely needs a producer..

  • @kuldeepsingh876
    @kuldeepsingh876 ปีที่แล้ว +1

    Geoffrey Hinton sir has the super clarity about his thoughts. I love it. He does not beat around the bush.

    • @madamedellaporte4214
      @madamedellaporte4214 10 หลายเดือนก่อน

      He should be put through court for paying with the future of humanity. Of us all so he can make a big stash of money and we see our children have no future ..That is what happens with mad scientists who let their vanity take hold of them.

  • @j.wilmararcila4150
    @j.wilmararcila4150 ปีที่แล้ว

    Gracias doc, que LINDO Mundo en El que sumerced SE mueve !

  • @nguyenngocly1484
    @nguyenngocly1484 3 ปีที่แล้ว

    You can make inside-out neural networks with fixed weighted sums (dot products) and adjustable (parametric) activation functions. Rather than the other way around.
    Then you are free to use high speed fast transforms for the fixed dot products.

  • @cowardmildredj.7250
    @cowardmildredj.7250 4 ปีที่แล้ว +2

    loved this, thank you!

  • @klausunscharferelation6805
    @klausunscharferelation6805 11 หลายเดือนก่อน

    about the singularity
    As Ray Kurzweil says
    When the whole universe becomes a computer,
    What does it calculate?
    Even though the purpose for calculating has already disappeared?

  • @paulmitchell5349
    @paulmitchell5349 5 ปีที่แล้ว +4

    Knowledge is accessible data.Intelligence is ability to infer.

    • @Bmens71
      @Bmens71 4 ปีที่แล้ว

      paul mitchell like this quote

  • @TheCriticsAreRaving
    @TheCriticsAreRaving 4 ปีที่แล้ว +17

    17:16 Hinton flips off the audience

  • @mangoldm
    @mangoldm ปีที่แล้ว +1

    Are hidden Markov models as relevant as Ray Kurzweil suggested?

  • @Sp8e
    @Sp8e ปีที่แล้ว

    I like this guy.

  • @bingeltube
    @bingeltube 6 ปีที่แล้ว

    Recommendable

  • @TheHamoodz
    @TheHamoodz 5 ปีที่แล้ว +16

    How can someone be intelligent enough to invent neural networks and entertaining enough to give a presentation like that. Its almost unfair lol.

    • @ArtOfTheProblem
      @ArtOfTheProblem 5 ปีที่แล้ว +3

      and you forgot how clearly he explained the 'key concepts' there is maybe 300 pages of a typical book on the subject compressed into about 20 phrases in this talk.

    • @shubhamp.4155
      @shubhamp.4155 4 ปีที่แล้ว

      He did not invent neural networks

    • @prashanthadepu3013
      @prashanthadepu3013 4 ปีที่แล้ว +2

      @@shubhamp.4155 but he brought to life many of them and redesigned completly

    • @mateuszanuszewski69
      @mateuszanuszewski69 4 ปีที่แล้ว

      It is just math, and nothing else. So if one understands math at academic level can easly learn how neural networks will work and how to manipulate notations on them to get different types. And i am not talking about "oh learn Neural networks in 5 minutes" and people show you how to program a model in tensorflow.

  • @Gabcikovo
    @Gabcikovo ปีที่แล้ว +1

    9:37 💜

  • @Gabcikovo
    @Gabcikovo ปีที่แล้ว +1

    11:27 Tomáš Mikolov just smiled :))

    • @Gabcikovo
      @Gabcikovo ปีที่แล้ว

      17:16 :D

    • @Gabcikovo
      @Gabcikovo ปีที่แล้ว +1

      17:18 🤣🤣🤣

    • @Gabcikovo
      @Gabcikovo ปีที่แล้ว +1

      🤖🥇🤣🐬

    • @Gabcikovo
      @Gabcikovo ปีที่แล้ว +1

      19:23 word2vec

    • @Gabcikovo
      @Gabcikovo ปีที่แล้ว

      20:51

  • @obsiyoutube4828
    @obsiyoutube4828 4 ปีที่แล้ว

    smart!long life

  • @HerrWortel
    @HerrWortel 3 ปีที่แล้ว +3

    Hinton is giving us the finger at 17:15 xD

  • @janaenae1338
    @janaenae1338 ปีที่แล้ว

    I really love you!!!❤

    • @loopuleasa
      @loopuleasa ปีที่แล้ว +1

      this guy was waaaay ahead of his time
      he casually defined what a thought is, and this thought never left my head 5 years ago

  • @zakali92
    @zakali92 5 ปีที่แล้ว +3

    Absolutely fascinating for a dummy like me

  • @PaulScotti
    @PaulScotti 2 ปีที่แล้ว +1

    Could someone clarify? He explained that backprop is better than "mutation" because backprop is parallelized vs. serialized -- but his explanation doesnt convey why backprop is achievable in parallel?

    • @brendawilliams8062
      @brendawilliams8062 ปีที่แล้ว

      Maybe if you have a neg. and a positive direction then you’d be best covering the known ground. I don’t know either.

    • @panda5088
      @panda5088 10 หลายเดือนก่อน +1

      Because of the way the vector math works, you can calculate the difference in the result that a change to any one weight or bias would cause. Therefore you can adjust the result by manipulating multiple weights or biases at the same time. Here's a pretty good video explaining back prop more in-depth: th-cam.com/video/Ilg3gGewQ5U/w-d-xo.html

  • @vtrandal
    @vtrandal 2 ปีที่แล้ว +1

    At 8:59 some comments about RIM. What is RIM?

    • @bcbcbcbcbc
      @bcbcbcbcbc ปีที่แล้ว

      Research in motion, the original name for Blackberry who used to make smart phones.

  • @rkara2
    @rkara2 5 ปีที่แล้ว +1

    Process or singularity is the Heart of AI.
    Alan Turing clearly define this in his 1936 paper on computable numbers.
    Input > Process > Output (Turing complete expression or circular)
    Process (Turing incomplete expression or non-circular)
    !DA

  • @paulmitchell5349
    @paulmitchell5349 5 ปีที่แล้ว +2

    Learning is not necessarily intelligence.More rapid learning means to twig the concept and apply the concept to new problems.

  • @Free_Ya_Mind
    @Free_Ya_Mind 8 หลายเดือนก่อน

    In the nutshell, Artificial Neural Network is just a parametric composite function trained using the chain rule of derivative.

  • @dearheart2
    @dearheart2 ปีที่แล้ว +2

    RNN is fun. I made a RNN for translation (word in, "thoughts" (RNN) works out), over the breaks in 1 week in high school in early 80ties. It could learn new words, structures and did an ok translation. Just made it for fun, like all the NN, AI at that time.

  • @dearheart2
    @dearheart2 ปีที่แล้ว +1

    Used evolutionary algorithm for training NN's in the 80ties. Worked well already then. Limited hardware, had to program all myself, but I got general AI that could be used for almost anything.

  • @fuckboy323
    @fuckboy323 6 ปีที่แล้ว +3

    what is the time of this
    speech ?

    • @ElevateTechCA
      @ElevateTechCA  6 ปีที่แล้ว +6

      This speech took place in September 13, 2017 at Elevate TechFest.

    • @jj-ry8xv
      @jj-ry8xv 6 ปีที่แล้ว +2

      1998

    • @fuckboy323
      @fuckboy323 5 ปีที่แล้ว

      ethan chow you e d

  • @damoonrobatian9371
    @damoonrobatian9371 2 ปีที่แล้ว +1

    Geoff himself doesn't even know how it works! It just works!!! What kind of scientist could be satisfied with this type of "reasoning"? HYPE

  • @bopeng9504
    @bopeng9504 5 ปีที่แล้ว

    Great job Geoff. Pray that God would bless your life!

  • @TomerBenDavid
    @TomerBenDavid 3 ปีที่แล้ว

    Wow :)

  • @samdavisok
    @samdavisok ปีที่แล้ว

    25:00

  • @sakathvenu
    @sakathvenu 4 ปีที่แล้ว +1

  • @fallhdesls5226
    @fallhdesls5226 4 ปีที่แล้ว

    smart!long life

  • @morthim
    @morthim 4 ปีที่แล้ว

    if you are going to call people stupid you shouldn't contradict yourself and agree with the people you insult.

  • @ngocquynhnhuhuynh3227
    @ngocquynhnhuhuynh3227 ปีที่แล้ว +1

    I'm proud to be his student's student 😆 I graduated with a thesis related to AI though have no fundamental knowledge about it 🤣

    • @ngocquynhnhuhuynh3227
      @ngocquynhnhuhuynh3227 ปีที่แล้ว

      Looking back.. that time was truly a miracle to complete the whole thesis ^^ & also thanks for the accident too. Maybe confronting the bandages, the council was more lenient 😁

  • @ancestralrocha7709
    @ancestralrocha7709 5 ปีที่แล้ว +4

    Some basic shit? Did I hear correctly?

  • @leo.budimir
    @leo.budimir 4 ปีที่แล้ว +1

    Damn, he looks like Palpatine here

  • @kavorka8855
    @kavorka8855 ปีที่แล้ว

    He failed to give any sensical reasons to his recent assertion about the dangers of AI. He does, however, seem to have issues with google, perhaps he's angry at something google didn't do for him?

    • @prashanpremaratneAU
      @prashanpremaratneAU ปีที่แล้ว

      If you look at ChatGPT, a leader of a country who is failing politically could ask chatGPT to suggest ways to cling on to power. Now, the answer could result in bloodshed. Another country could use chatGPT like system to control the entire defence establishment. That is the danger of AI according to Junaid Maubeen - Author of Mathematical Intelligence

    • @kavorka8855
      @kavorka8855 ปีที่แล้ว

      @@prashanpremaratneAU He seems to be stupid, the author.

  • @u2naru
    @u2naru ปีที่แล้ว

    This guy now says that AI is dangerous after decades of leading projects on AI. Why now not the time this presentation was done?

    • @yadayada111986786
      @yadayada111986786 ปีที่แล้ว

      He ays himself he was surprised by the pace of the AI development. He thought these dangers would come much later and slower

  • @mutterich5290
    @mutterich5290 2 ปีที่แล้ว

    LM21 was geht ab

  • @janaenae1338
    @janaenae1338 ปีที่แล้ว

    ❤️🧡💛💚💙💜💙💚💛🧡❤️🧡💛
    We are ALL the SAME PERSON experiencing life in a BUNCH
    OF DIFFERENT BODIES!!! which
    means that EVERY PERSON
    that you meet, is really just YOU...
    LIVING IN ANOTHER BODY!!
    you see..you are INTERACTING with YOURSELF at ALL TIMES!!! & once you understand this,you can achieve unity!
    I and my father are one
    Love Thy Neighbor as Thyself
    💜💙💚💛🧡❤️🧡💛💚💙💜💙💚

    • @robertolupot2497
      @robertolupot2497 ปีที่แล้ว

      Interesting. So how does the death of one body affect the living body?

  • @mateuszanuszewski69
    @mateuszanuszewski69 4 ปีที่แล้ว

    omg so many ads

  • @dr.mikeybee
    @dr.mikeybee 5 ปีที่แล้ว +1

    Professor Hinton is amazing, but there are too many of these NN for dummies lectures. They're starting to clog the space. It's a shame he didn't say anything really interesting here.

    • @mtoman
      @mtoman 5 ปีที่แล้ว

      True, finding advanced talks is getting pretty hard.

    • @pd.dataframe2833
      @pd.dataframe2833 4 ปีที่แล้ว +6

      For advanced knowledge you dont come to youtube....you fucking read research papers

    • @atomskreigns8071
      @atomskreigns8071 4 ปีที่แล้ว +2

      Sivaram Karanam and even that's not true you can search any ML topic on TH-cam and get a lecture as advanced as u like a whole series of them

    • @SameenIslam
      @SameenIslam 4 ปีที่แล้ว

      Did you not read the title of this video? Clearly says foundations

    • @OptionGal
      @OptionGal 4 ปีที่แล้ว

      @@pd.dataframe2833, not entirely true. Some of the best research papers are published and presented at symposiums such as this one. We are all very lucky that there are videos of these podium presentations so that we may also be inspired to learn.

  • @nbme-answers
    @nbme-answers 4 ปีที่แล้ว

    14:47 symbols go in, symbols go out but in the middle it can't be "symbols"!

  • @bobtarmac1828
    @bobtarmac1828 ปีที่แล้ว

    Today, Losing your job to ai agents is unacceptable. Ai Jobloss is here. So are Ai as weapons. Can we please find a way to Cease Ai / GPT? Or begin Pausing Ai before it’s too late?

  • @JazzyGinger1
    @JazzyGinger1 4 หลายเดือนก่อน

    Hello🦩🦩🦩,
    God the Father loves you so much that He sent Holy, Sinless Jesus (His Holy Son) to earth to be born of a virgin. Then He grew up and died on a cross for our sins. He was in the tomb for 3 days, then Father God raised Holy and Sinless Jesus Christ (Y'shua) to life! He appeared to people and went back to Heaven. We must receive Sinless Jesus sincerely to be God's child.
    John 1:12 says, "But as many as received him, to them gave he power to become the sons of God, even to them that believe on his name."

    Will you receive Christ sincerely?

  • @thiemtranthi7760
    @thiemtranthi7760 ปีที่แล้ว

    Ok hinton them ok😂

  • @m3n4cE6
    @m3n4cE6 11 หลายเดือนก่อน

    look at them, fatal wound/mark on their forehead

  • @zzbeasley
    @zzbeasley 5 ปีที่แล้ว +1

    Is a thought more than an image? Think about it.

  • @rajaasim8229
    @rajaasim8229 5 ปีที่แล้ว +2

    Who dislikes Hinton?

    • @MrCmon113
      @MrCmon113 4 ปีที่แล้ว

      Well he shit on symbolists during the talk.

  • @DanOneOne
    @DanOneOne ปีที่แล้ว

    thank God I decided not to be a PhD student...

  • @yvespetit
    @yvespetit 2 ปีที่แล้ว

    A spiteful professor who thinks his tinkering with computers does good for humanity! Talk about speech recognition, the machine voice announcing a caller on our phone system is always wrong.