Ilya Sutskever: Sequence to Sequence Learning with Neural Networks at NeurIPS 2024

แชร์
ฝัง
  • เผยแพร่เมื่อ 13 ธ.ค. 2024

ความคิดเห็น • 18

  • @clumsymoe
    @clumsymoe 7 ชั่วโมงที่ผ่านมา +8

    woah it is 2024 Ilya thank you for the upload

  • @xiaominsong
    @xiaominsong 12 ชั่วโมงที่ผ่านมา +5

    Thanks for the upload. The age of pre-training will end due to that the data is not growing (8:45)

  • @branlob
    @branlob 5 ชั่วโมงที่ผ่านมา +4

    16:00 he wanted to say, these systems will have great potential to make dictatorships infinitely stable, as he mentioned some time ago in another talk

    • @wonmoreminute
      @wonmoreminute ชั่วโมงที่ผ่านมา

      This feels like the inevitable path, at least as an objective. And we can clearly see the path forming, with extreme wealth, particularly in the techno-manifesto crowd, coalescing around the levers of power and populism. Not only in a way they never have, but with a scorched-earth urgency as well.

  • @DAFascend
    @DAFascend ชั่วโมงที่ผ่านมา

    Ilya Sutskever agreeing with Yan Lecun and Yan Lecun agreeing with IlyaSutskever is wild.

  • @RaviAnnaswamy
    @RaviAnnaswamy 3 ชั่วโมงที่ผ่านมา +1

    Ilya is one of my heros, I have been following since his university days (anyone remember his website that had the sentence completion engine using Hessian?). I like this because seq2seq is still underutilized idea - taken over by subsuming the encoder in GPT, it is probably the most simply understood, easily buildable at small scale and tractable model architecture and I consider that as the most nonintuitive insight that led to modern breakthroughs by shifting an RNN into a data-transformer mode.
    The only crib I have on this talk is Ilya isting LSTM under What we got wrong! and LSTM as ResNet turned 90 degrees. Really Ilya? For someone who made breakthrough implementation relying on an innovative algorithm to brush off disrespectfully and also wash out the name retrospectively, Wow, I did not expect it from you Ilya, Please be aware of such arrogance that spills casually in thought.
    This talk by Gemini lead Oriol Vinyals, one of the coauthors of Seq2Seq - is chock full of insights too: th-cam.com/video/78mEYaztGaw/w-d-xo.html

  • @David-o6n3h
    @David-o6n3h 44 นาทีที่ผ่านมา

    Thanks for the analysis! Could you help me with something unrelated: I have a SafePal wallet with USDT, and I have the seed phrase. (alarm fetch churn bridge exercise tape speak race clerk couch crater letter). How can I transfer them to Binance?

  • @amortalbeing
    @amortalbeing 6 ชั่วโมงที่ผ่านมา

    thanks

  • @nemuritai
    @nemuritai 40 นาทีที่ผ่านมา

    Is that Sam Altman at 20:04?

  • @user-pt1kj5uw3b
    @user-pt1kj5uw3b 5 ชั่วโมงที่ผ่านมา +1

    The end lol

  • @BeeStone-op1nc
    @BeeStone-op1nc 3 ชั่วโมงที่ผ่านมา +1

    He's alive!

  • @findjoseph
    @findjoseph ชั่วโมงที่ผ่านมา

    w

  • @BruceWayne_311
    @BruceWayne_311 3 ชั่วโมงที่ผ่านมา

    he needs to go to turkey

  • @afterglow5285
    @afterglow5285 6 ชั่วโมงที่ผ่านมา +4

    Ilya is crashing out

    • @Jason_vinion
      @Jason_vinion 2 ชั่วโมงที่ผ่านมา +1

      Can someone explain to me what “crashing out” means please?

    • @flopasen
      @flopasen 29 นาทีที่ผ่านมา

      ​@@Jason_vinionAs of my training cut off (September 2021), crashing out means falling asleep before finding a comfortable and appropriate place or position to rest, usually on a couch or carpeted surface.