A Complete Overview of Word Embeddings

แชร์
ฝัง
  • เผยแพร่เมื่อ 22 ก.ย. 2024

ความคิดเห็น • 173

  • @impracticaldev
    @impracticaldev ปีที่แล้ว +17

    Would love a video on ELMo further. Thanks for all this!

  • @ozgurak1840
    @ozgurak1840 ปีที่แล้ว +86

    Thank you. It is very clear and informative, though i really think you (AssemblyAI) should lose the music on the background; it is distracting and it gives the whole thing an infomercial feeling.

    • @nirash8018
      @nirash8018 ปีที่แล้ว +9

      Somehow the music had a motivational influence for me. I caught myself vibing to it a few times

    • @rangi500
      @rangi500 3 หลายเดือนก่อน +2

      I would love the no-music option too.

  • @marten9334
    @marten9334 8 หลายเดือนก่อน +5

    amazing video. Perfectly clear speech, good explanations, logical visualisations and the background music makes it a lot easier to focus. Thank you!!

  • @originalmianos
    @originalmianos ปีที่แล้ว +3

    There are maybe 30 videos on this topic and this is the only one that does not suddenly make a massive jump across whole concepts that the presenter knows but the watcher does not.

  • @manojjoshi1102
    @manojjoshi1102 ปีที่แล้ว +18

    Excellent explanation. I did some study on this topic before coming here and the reason was because so many terms and concepts were quite overwhelming. I generally understood those but still missed the fine tuned clarity. After watching this video, most of what I read before started making a lot of sense. I highly recommend this video. Thank you so much.

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว +2

      This is great to hear! You are very welcome!

  • @Arriyad1
    @Arriyad1 3 หลายเดือนก่อน +2

    Great explanation! Thank you! Pls. drop the music for next videos.

  • @KidistAmde
    @KidistAmde 9 หลายเดือนก่อน +2

    Excellent ! Thank you so much for making an absolutly clear explanation.

  • @TuhinBhattacharya
    @TuhinBhattacharya 2 ปีที่แล้ว +6

    Awesome overview.. Loved it.. Waiting for videos explaining GloVe and Elmo..

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว

      Great to hear you liked it!

  • @johnpuopolo4413
    @johnpuopolo4413 หลายเดือนก่อน

    Thanks for the explanation of word embeddings. Nicely done!

  • @Kmmc2011
    @Kmmc2011 2 ปีที่แล้ว +2

    Thanks for taking the time to break this down and share!

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว

      You are very welcome! - Mısra

  • @sajjaddehghani8735
    @sajjaddehghani8735 2 ปีที่แล้ว +10

    great explanation. please explain elmo and other approaches. also please make a video about efficient ways of clustering the embeddings👍

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว

      Thank you Sajjad for the suggestion!

  • @augurelite
    @augurelite ปีที่แล้ว +2

    Wow such a good presenter. I really like the examples super clear. This stuff is amazing

  • @deepaksingh9318
    @deepaksingh9318 7 หลายเดือนก่อน

    Amazing Content.. Exactly what a learner wants .. to Have all the concepts in a single Video with easy to understand way in minimum time..

  • @cigdemtas997
    @cigdemtas997 หลายเดือนก่อน

    Thank you for great explanation! Would love to see pre-trained word embeddings for sentiment analysis.

  • @hadiloghman1572
    @hadiloghman1572 2 ปีที่แล้ว +8

    great explanation. Please explain ELMO and GloVe. it was really great

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว +3

      Thank you for the suggestions!

    • @cimmik
      @cimmik 8 หลายเดือนก่อน

      ​@@AssemblyAII'd love to see those videos too

  • @TravelWithSalsa
    @TravelWithSalsa 2 หลายเดือนก่อน

    Thank you. Very good and complete explanation.

  • @lavanyaseetharaman
    @lavanyaseetharaman ปีที่แล้ว

    simple and clear explanation. please explain Elmo, thanks

  • @estelitaribeiro4196
    @estelitaribeiro4196 5 หลายเดือนก่อน

    Thanks! Great information in a very objective way!

  • @tommyhuffman7499
    @tommyhuffman7499 8 หลายเดือนก่อน

    The absolute best video I've seen on this topic!!

  • @berkk1993
    @berkk1993 ปีที่แล้ว

    çok teşekkürler, bu kadar iyi anlatan başka video yok

  • @idrissnguepi7842
    @idrissnguepi7842 ปีที่แล้ว +2

    Very nice explanation of embedding concept, Would love to see pre-trained word embeddings for sentiment analysis.

  • @whifflingtove
    @whifflingtove ปีที่แล้ว +2

    Very interested in an in depth explanation of ElMo

  • @diegovnoble
    @diegovnoble 6 หลายเดือนก่อน

    Thanks for the video! I've enjoyed watching and liked the format and pace. I'd add the retrowave background to my playlist if I knew the name. I guess that people would note it less if the volume was lower.

  • @lahiru954
    @lahiru954 ปีที่แล้ว

    Great explanation! I went through the topics hours of hours. But this channel saved my time. And on target.

  • @UkiDLucas
    @UkiDLucas ปีที่แล้ว

    Very good explanation, thank you!

  • @glowwell4292
    @glowwell4292 ปีที่แล้ว

    Thanks dear. Nicely paced intro. Good for recap.

  • @jeremymarkson1423
    @jeremymarkson1423 2 ปีที่แล้ว +2

    Would be great to see a video on Elmo!

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว

      Thank you for the suggestion, noted!

  • @emandiab9524
    @emandiab9524 ปีที่แล้ว

    Thanks that helped a lot.

  • @hamitguner
    @hamitguner 8 หลายเดือนก่อน

    Thank you

  • @michaelng3126
    @michaelng3126 9 หลายเดือนก่อน

    This was awesome. Would love to see Elmo video and sentiment analysis video you mentioned possibly making!

  • @maysammansor
    @maysammansor 3 หลายเดือนก่อน

    would love to see a video on building Elmo Embedding model. Thanks for this one

  • @ShubhamDasCoder
    @ShubhamDasCoder 2 ปีที่แล้ว

    Great explanation in less amount of time. Really liked the video.

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว

      That's great to hear!

  • @captainmustard1
    @captainmustard1 ปีที่แล้ว

    top video for embedding introduction

  • @bibhutibaibhavbora8770
    @bibhutibaibhavbora8770 ปีที่แล้ว

    Great and very illustrative video

  • @draziraphale
    @draziraphale ปีที่แล้ว

    Excellent presentation. I will be teaching this topic to students shortly and will recommend this material.

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว

      Great to hear, thank you!

  • @HashimWarren
    @HashimWarren 5 หลายเดือนก่อน

    Very clear, thank you

  • @soheiltehrani3792
    @soheiltehrani3792 2 ปีที่แล้ว +1

    Great visual, Great Voice , Good pace of presentation . Everything is awesome in this video.
    thanks for sharing :D

    • @AssemblyAI
      @AssemblyAI  2 ปีที่แล้ว

      Thank you for the nice words Soheil! Glad it was helpful!

  • @investime247
    @investime247 ปีที่แล้ว

    Thank u very clear. Need to know how to use word embedding for text classification

  • @vigneshpadmanabhan
    @vigneshpadmanabhan ปีที่แล้ว

    Well explained ! Thanks a lot

  • @JayTheMachine
    @JayTheMachine ปีที่แล้ว

    thnak you soo much, amazing explaination and you beautiful

  • @kfirgollan
    @kfirgollan ปีที่แล้ว

    Great explanation! Thanks for sharing

  • @Harduex
    @Harduex 8 หลายเดือนก่อน

    Great videos there, thank you for your content and keep up the good work!

  • @yuanjunren5220
    @yuanjunren5220 7 หลายเดือนก่อน

    amazing video!!!❣❣❣ Thanks for sharing

  • @nogur9
    @nogur9 ปีที่แล้ว

    It's a really good explanation, thank you very much :)

  • @leo-phiponacci
    @leo-phiponacci 3 หลายเดือนก่อน

    Thank you, I want to ask if there are any techniques that use Hidden Markov Models to represent the embeddings?

  • @ShaikRaasikha21
    @ShaikRaasikha21 8 หลายเดือนก่อน

    Video on Training a sentiment analysis model please

  • @shubham-pp4cw
    @shubham-pp4cw 2 ปีที่แล้ว +1

    nice video on word embedding keep it upp.............

  • @ehichamu
    @ehichamu ปีที่แล้ว +1

    Very Good video. I second the other comments. PLEASE drop the music completely. It would increase the quality of the experience by at least 70%. I had hard time finishing the video because of the music

  • @yusufkemaldemir9393
    @yusufkemaldemir9393 ปีที่แล้ว

    Interested in “Creating your own embedding before doing binary or multi label classification prediction”! Thanks for the clarity.

  • @hileamlakyitayew9450
    @hileamlakyitayew9450 ปีที่แล้ว

    Awesome video!!

  • @AnthonyForde-l6o
    @AnthonyForde-l6o ปีที่แล้ว +4

    Brilliant video, as always, thanks so much. Would love to see your suggested follow on using pre-trained word embeddings for sentiment analysis if you ever have time 🙂

  • @dalehu5606
    @dalehu5606 ปีที่แล้ว

    Clear explanation! 👍

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว

      Glad you think so!

  • @davidheilbron
    @davidheilbron ปีที่แล้ว

    Great! Thanks

  • @dessiabdelkerym5612
    @dessiabdelkerym5612 ปีที่แล้ว

    Thanks for the explanation please try to make a video about how ELMOS works

  • @toshyamg
    @toshyamg ปีที่แล้ว

    Great job 👍

  • @AhmedKhaliet
    @AhmedKhaliet ปีที่แล้ว

    Thank youuuu it's my first video but I guess I should make your video my periorties I'm NLP thanks alot❤

  • @smudgepost
    @smudgepost ปีที่แล้ว +1

    Yes - to all videos you suggest making! Great guide thank you.. was struggling to see value in lemmatization and concerned a bout a loss of coherence. Seeing several worked examples are great. Interested how the final results were all different but all had similarly high percentage match. How do you tackle this?

  • @r.walid2323
    @r.walid2323 ปีที่แล้ว

    Great explanation

  • @lbognini
    @lbognini ปีที่แล้ว

    From the embeddings of your name, I removed those of "work", added "great" and "relationship" and I came up with the embeddings of my own name? How come? Mere coincidence? 🤔🤔
    Great video, btw!

  • @ali75988
    @ali75988 10 หลายเดือนก่อน

    8:15 i am having problem with the sentence "no of neurons in hidden layer = size of embedding".
    i am confused what is size of embedding?

  • @PaulFishwick
    @PaulFishwick 2 หลายเดือนก่อน

    Do you have a link to the Python notebook you go over at the end?

  • @altantoksoz5999
    @altantoksoz5999 ปีที่แล้ว

    Great tutorial. She speaks like a native speaker. She looks like a Turkish girl, beautiful one :)

  • @RiccardoCarlessoGoogle
    @RiccardoCarlessoGoogle 9 หลายเดือนก่อน

    This is amazing. Can you share the python notebook you show at 12m33s?

  • @praveenbehara
    @praveenbehara ปีที่แล้ว +1

    Hi.. thank you for the video.. great introduction and also a practical example.. One request is to drop or reduce the intensity of the music. It was distracting.

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว

      Noted! Thank you for the feedback Praveen

    • @javidjamae
      @javidjamae ปีที่แล้ว

      Yes, great video but music is definitely too loud and distracting! It's really hard to concentrate on what you're saying.

  • @MohamedElGhazi-ek6vp
    @MohamedElGhazi-ek6vp 9 หลายเดือนก่อน

    Excellent Explanation. I have one question please how could I fit my model with this embedding vectors cause for Example in one of my projects for extracting informations from fils. instead of using texts for training my models I thinked of using embedding but I don't know the best way to represent them to my model . I hope u understand my question and thank you.

  • @AliZaki1401
    @AliZaki1401 ปีที่แล้ว

    Great work !!
    Can you make a video on Elmo and Transformer-based word embeddings ???

  • @joergbieri9701
    @joergbieri9701 ปีที่แล้ว

    Great content thanks. Due to a hearing problem I would appreciate it, if you could remove the backround music. Ok? Thanks

  • @yigalirani308
    @yigalirani308 ปีที่แล้ว

    super helpful, but is there a version of this without the music?

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว +2

      Sorry about that! We got a lot of feedback in this. Let me see if we can upload without the music. :D

  • @danielcanedo5240
    @danielcanedo5240 ปีที่แล้ว

    I'm your fan already, please make an ELMo video....!!!

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว

      Thank you for the suggestion!

  • @abdelazizkhalid4231
    @abdelazizkhalid4231 ปีที่แล้ว

    is there a video about sentiment analysis yet?

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w ปีที่แล้ว

    be great to see a video on Elmo.

  • @MartinJohannesNilsen
    @MartinJohannesNilsen ปีที่แล้ว

    Great video! As for your analogy, I would guess that changing cocktail to bar would indeed give you cocktail. The analogy of having dinner at a restaurant, is not matching to having bar at cocktail.

  • @tamoghnamaitra9901
    @tamoghnamaitra9901 ปีที่แล้ว

    New crush added to life

  • @HappyDataScience
    @HappyDataScience ปีที่แล้ว

    i would surely like to learn elmo guessing that chatgpt used the same correct me if i'm wrong 🙇🏻‍♂️

  • @mariussame9357
    @mariussame9357 ปีที่แล้ว

    Thanks for the video I do have a question when you said that for instance in the CBOW there is only one layer it means that the ouput of this layer should be a vector of size dimension of the embedding but in order to train the model we need to compaire this output with the word in the midlle which is actually a one hot encoded vector of size dimension of the vocabulary so it migth have another layer and a softmax.

  • @jtauber
    @jtauber ปีที่แล้ว +1

    I love that all your examples are Lord of the Rings quotes because I run the Digital Tolkien Project which applies computational text analysis techniques to the works of Tolkien :-)

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว +2

      That's amazing! Nice to meet you! Huge Tolkien fan here. :)

    • @jtauber
      @jtauber ปีที่แล้ว

      @@AssemblyAI you should join the Digital Tolkien Project!

    • @sidindian1982
      @sidindian1982 10 หลายเดือนก่อน +1

      @@AssemblyAI Pls provide the notebook code ..
      thnx

  • @cimmik
    @cimmik ปีที่แล้ว

    Would it be possible to use word embedding to ask if a text is about a certain topic (or rather to what degree a text is about a topic)?

  • @automatster
    @automatster 2 ปีที่แล้ว

    Great video. Thanks for sharing it. It would be great if you do a task like train sentiment analysis model with word embedding and share with us.

  • @__________________________6910
    @__________________________6910 2 ปีที่แล้ว +2

    Noice !

  • @jenot7164
    @jenot7164 ปีที่แล้ว

    How large should data for a custom embedding be and is it possible to utilize a GPU for the creation of a word embedding vector space?

  • @mimori.com_
    @mimori.com_ ปีที่แล้ว

    Thank you. Easy to understand. But I don't need the music at all. I fight myself listening to the music than your talk.

  • @lexflow2319
    @lexflow2319 ปีที่แล้ว +1

    Do transformers from scratch. I heard they can be written in 50 lines. I would like to understand how bert encodes words

  • @lemoniall6553
    @lemoniall6553 ปีที่แล้ว

    if we have a sentence "vishy eat bread". then we vectorize the word "eaat"(misspelled word), why does fasttext see that the word "eaat" is more similar to the word "eat"?. How is the architecture?, is it possible for fasttext without using skipgram to be able to classify words?. Thanks

  • @hashemipeyman
    @hashemipeyman ปีที่แล้ว

    Great!

  • @davidswearingen7571
    @davidswearingen7571 ปีที่แล้ว

    Another good video marred by the inclusion of unnecessarily loud music.

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w ปีที่แล้ว

    Can the embeddings from Transformer be used elsewhere, like with Word2Vec?

  • @brunam7908
    @brunam7908 ปีที่แล้ว

    Waiting for the ELMo video.

  • @TuhinBhattacharya
    @TuhinBhattacharya 2 ปีที่แล้ว

    How do I know which embedding will be best choice for a specific use case? How do I know which distance measure will be best?

    • @pathikghugare
      @pathikghugare 2 ปีที่แล้ว

      Depends on your use case, cuz lets say if your use case contains more in general words like tea, king, actor, etc. then you may try different embeddings and see for yourself which ones are working well for particular examples from your use case
      OR
      If your use case is quite specific, something like say representing skills as a vector then you may need to train your own word2vec model on your data since pretrained embeddings may not cover what you need

  • @YuraZavadenko
    @YuraZavadenko ปีที่แล้ว

    what about BOW?

  • @zaratushtra21
    @zaratushtra21 ปีที่แล้ว

    You should also add the name of the speak to videos. She says I in the video and we even do not know who is she :)

  • @j0nrages851
    @j0nrages851 ปีที่แล้ว

    Is there a sentiment training model video that builds from this? Trying to build a recommendation system based on candidate sentences and a job description

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว

      We don't have that video yet but thank you for the suggestion!

  • @iravkr
    @iravkr ปีที่แล้ว

    Your pretty face holds my concentration, and thus I understand anything taught by you, especially transformer, more than any other youtube video..Thank you so much for such videos...indebted!

  • @HikmetYolcusu
    @HikmetYolcusu 9 หลายเดือนก่อน

    Why is there a background soundtrack during the lecture? Does it help with learning or focus? I find it kinda distracting and feel rushed.

  • @user-wr4yl7tx3w
    @user-wr4yl7tx3w ปีที่แล้ว

    Be interested in seeing a python example of Word2Vec.

  • @EkShunya
    @EkShunya ปีที่แล้ว +1

    nice and crisp, just one suggestion "please remove background music", It is reductive to the viewers experience :)

    • @AssemblyAI
      @AssemblyAI  ปีที่แล้ว

      Thank you! And noted!

  • @princegoyal1843
    @princegoyal1843 7 หลายเดือนก่อน

    Hi, Can you please tell you name. Going forward to learn more from you.

  • @flaashmindstudio1468
    @flaashmindstudio1468 ปีที่แล้ว

    Can you make a video about ELmo?

  • @juanantonionavarrojimenez2966
    @juanantonionavarrojimenez2966 26 วันที่ผ่านมา

    I love "The lord of the rings" too. :)

  • @moeal5110
    @moeal5110 ปีที่แล้ว

    Awesome content but these background music are slightly distracting specially when you play video on 1.5 speed

  • @Nice-po4xg
    @Nice-po4xg ปีที่แล้ว

    Cosine Similarity, not equal distance bro it just tells direction of that word