Consistent Hashing | Algorithms You Should Know #1

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 ส.ค. 2022
  • Weekly system design newsletter: bit.ly/3tfAlYD
    Checkout our bestselling System Design Interview books:
    Volume 1: amzn.to/3Ou7gkd
    Volume 2: amzn.to/3HqGozy
    Other things we made:
    Digital version of System Design Interview books: bit.ly/3mlDSk9
    Twitter: bit.ly/3HqEz5G
    LinkedIn: bit.ly/39h22JK
    Animation tools: Illustrator and After Effects
    ABOUT US:
    Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

ความคิดเห็น • 246

  • @ByteByteGo
    @ByteByteGo  ปีที่แล้ว +52

    Subscribe and leave a comment, we read them all :)

    • @praenubilus1980
      @praenubilus1980 ปีที่แล้ว +1

      hope you can update more requently 😄

    • @matthayden1979
      @matthayden1979 ปีที่แล้ว +1

      Yes! I already did. Difficult concepts explained in such an easy way.

    • @AdityaDodda
      @AdityaDodda ปีที่แล้ว

      Amazing video! Can you make a video comparing this to Rendezvous Hashing please.

    • @pajeetsingh
      @pajeetsingh ปีที่แล้ว

      Service mesh.

  • @RajeevSoni007
    @RajeevSoni007 ปีที่แล้ว +149

    Hats down. This channel is really a blessing for the software engineers. This is the most simplified video on consistent hashing i have seen till now 👍

  • @amitchoraria5737
    @amitchoraria5737 24 วันที่ผ่านมา +2

    I cant get my head around the fact that this channel is having less than a million subscribers. It deserves much more than that!!!

  • @chrisfrancisbass8991
    @chrisfrancisbass8991 8 หลายเดือนก่อน +6

    You know when you try hard to understand something that just doesn't make sense to you, then you find an explanation so clear and simple that it actually makes you chuckle... For me, that's this video.

  • @shoooozzzz
    @shoooozzzz ปีที่แล้ว +146

    Watching your channel should be a requirement for anyone in software engineering. Love the variety of topics

  • @PrevalentAA
    @PrevalentAA ปีที่แล้ว +43

    This is one of the best teaching styles I've personally encountered on TH-cam.
    Would be absolutely amazing if you could make a playlist for beginner software engineers starting with the core concepts. I would definitely pay for such a playlist/course.
    Thank you for all the time and effort you put into these videos, the visualisations definitely help to drive the point home like no others.

  • @ameliasundman2388
    @ameliasundman2388 ปีที่แล้ว +1

    I don't know where I would be without this video, thank you. So much effort was clearly put into this and it was so worth it. Very easy to understand.

  • @AditiAgarwal1695
    @AditiAgarwal1695 ปีที่แล้ว +12

    You explain each concept so well with just the right amount of detail. An added bonus is your way of speaking which is so calming and peaceful.
    Thanks for this amazing content you put out and wishing you the very best for the future!

  • @skdevv
    @skdevv ปีที่แล้ว

    Teaching style of Sahn Lam is the best I have come across in TH-cam.. his way of teaching is evenly paced, pleasant & clear. Thank you.

  • @lucasnoetzold
    @lucasnoetzold ปีที่แล้ว +5

    dude your content is simply outstanding
    you synthesize very complex subjects in the amount of explanation that is just right for understanding without getting lost
    how come I've not seen you earlier?

  • @glebbondarenko67
    @glebbondarenko67 ปีที่แล้ว +14

    I really liked that explanation. I didn't know that server are also using the same hash function. And this workaround with virtual nodes is awesome

  • @cyboticIndustries
    @cyboticIndustries ปีที่แล้ว +3

    Such clarity and brevity to this and all your videos. Many of these topics are of little use to me, but I watch and learn anyway due to your teaching style. Fantastic! Thankyou ! 🙏

  • @komalkungwani4625
    @komalkungwani4625 ปีที่แล้ว +4

    I was never able to properly understand what consistent hashing is, but after watching this video it seems so clear now. Thank you so much for such videos. Please keep it up and upload more videos . We are here to support. 🎉

  • @Akahatoo
    @Akahatoo ปีที่แล้ว +1

    Just found out your channel, it's incredible how you easily teach with graphical assistance. It helps a lot bringing down complex topics, awesome videos!

  • @theRenjie
    @theRenjie ปีที่แล้ว +1

    The illustration is the best I have seen for the virtual nodes. Thank you so much for the clear explanation.

  • @jordanweir7187
    @jordanweir7187 ปีที่แล้ว +2

    The amount of genius in the ideas here, the ring, someone did an insane job there at some point. also great explanation

  • @rhtcguru
    @rhtcguru ปีที่แล้ว +1

    Stumbled on your videos recently. I really like your style. Animations are great and the summaries are clear and concise. Keep up the great work!

  • @davidwilliams6089
    @davidwilliams6089 ปีที่แล้ว

    Found this via a Hacker News post. While I don't have any background in computer science, your explanation of the implementation approaches, issues, leading to virtual nodes in consistent hashing was clear and made sense to me. Thank you!

  • @thisaintmyrealname1
    @thisaintmyrealname1 ปีที่แล้ว +1

    Thank you! I came across consistent hashing while reading the chapter on Metrics Monitoring from System Design Vol. 2. I had never heard the concept, so I searched it on youtube, and there you were as the 1st result! Great explanation. Now back to the book 👋

  • @larryd9577
    @larryd9577 ปีที่แล้ว

    I found your blog through Twitter and swallowed it whole. Your videos are even better. Keep up the great work!

  • @biju2848
    @biju2848 ปีที่แล้ว +3

    Great way of simplifying and explaining the concepts. Great work! Will recommend this channel to every software engineers

  • @DanielTorres-gd2uf
    @DanielTorres-gd2uf ปีที่แล้ว

    These just started popping up in my feed. Very cool. Love the production quality on these videos keep em coming!

  • @diyoptics1387
    @diyoptics1387 ปีที่แล้ว

    I know explanation is good when I have questions and immediately the answer is narrated! Well done!

  • @agatapysz1628
    @agatapysz1628 ปีที่แล้ว +1

    I really like the way you explain different topics in your videos. The images and animations are very helpfull to visualise and understand the concepts. Waiting for new ones!:)

  • @dishantchauhan4775
    @dishantchauhan4775 ปีที่แล้ว +2

    Content is so awesome and well explained, that every new video release sticks to the mind until you watch it. Please keep up the great content delivery.🙌

  • @joanagomes635
    @joanagomes635 ปีที่แล้ว

    This video was extremely helpful! I have an exam next week on distributed systems and consistent hashing will be on it. With this video, I feel like I will ace this part of the exam! Thank you!!

  • @kapilshekhar
    @kapilshekhar ปีที่แล้ว

    Unambiguous, clear and simple explanation .. this channel is full of wisdom !

  • @distrologic2925
    @distrologic2925 ปีที่แล้ว

    Thanks, this is what the world needs. Quick and digestable instructions on useful algorithms.

  • @cristianb.3683
    @cristianb.3683 ปีที่แล้ว +1

    Best explanation of consistem hashing I have found so far! Keep it up!

  • @ozzyfromspace
    @ozzyfromspace ปีที่แล้ว +1

    Wow, this presentation on consistent hashing was absolutely beautiful 🏆💯❤. Even though you didn't' write any code, the principle was so clear that most people could probably implement such an algorithm. Bravissimo!

  • @ketandixit
    @ketandixit ปีที่แล้ว +2

    This is the best and most concise explanation !! Very impressive !! 👏

  • @gigakoresh
    @gigakoresh ปีที่แล้ว +3

    Amazing content, I am gonna recommend these books be bought by the company and put to premises where people can read them to understand these concepts. I have a suggestion for a video btw: can you explain CPU metrics and throttling on container systems? There is lots of misunderstanding especially with Kubernetes resources like "millicores" about what it actually means and how the usage is calculated and when throttling is performed on Kubernetes nodes and how. Also what are the implications of these metrics and quotas on CPUs with many cores and the difference between nodes running on hypervisor vs bare metal. It's a hole can of worms of course, but I think just starting with the quotas and throttling would already clear things up a lot.

  • @YashSharma0605
    @YashSharma0605 10 หลายเดือนก่อน

    I das reading the book and then came across this video. The visual really helps to drive the topic home. Nicely done.

  • @donaldcheung3193
    @donaldcheung3193 ปีที่แล้ว

    This explanation is simple and clear! Amazing!

  • @uppner147
    @uppner147 ปีที่แล้ว

    Love this channel! Perfectly explained, relevant and beatiful.

  • @wiri2391
    @wiri2391 ปีที่แล้ว +2

    Wow, super clean animations and the explanations are on point!

  • @deepakbhoria4172
    @deepakbhoria4172 11 หลายเดือนก่อน

    i read cassandra docs but couldn't understand virtual nodes, your video taught me so simply.

  • @go_better
    @go_better ปีที่แล้ว

    Thank you! Very interesting episode. And in general you explain things very clearly! Great series.

  • @user-ix5hq9cz4y
    @user-ix5hq9cz4y 2 หลายเดือนก่อน

    I feel joy when I see this presenter. Def one reason is his videos are simple and have lots of animation other at human level he seems to be pretty descent person.

  • @_cocoalabs
    @_cocoalabs ปีที่แล้ว +1

    Fantastic, clear, and concise explanation!

  • @Nicolas-jx3oo
    @Nicolas-jx3oo ปีที่แล้ว

    Impressively clear and concise, good job!

  • @abhisheksitar
    @abhisheksitar ปีที่แล้ว +1

    Brilliant way to teach such a concept! Thanks to you!

  • @amithreat
    @amithreat ปีที่แล้ว

    simplest explanation I found to date...gr8 work!!

  • @yash7891
    @yash7891 ปีที่แล้ว +3

    What an amazing explanation.
    Please keep producing more content

  • @kaidollarsense
    @kaidollarsense ปีที่แล้ว +1

    Very concise video in explaining the concept. Keep it coming, you've earned yourself a new sub!

  • @gui1221000
    @gui1221000 ปีที่แล้ว +1

    That's the kind of quality content that I was looking for!

  • @dsinkey
    @dsinkey ปีที่แล้ว +5

    I read the chapter on consistent hashing in System Design Interview, and didn’t feel like I understood it completely. This video helped so much. I’d love to see walk throughs of some of the systems on this channel.

    • @ByteByteGo
      @ByteByteGo  ปีที่แล้ว +4

      Thank you for the feedback. We agree videos augment text and they could be very useful.
      The chapter length videos take a lot of efforts to make. We will try to make one once a month, or maybe every two months.

  • @wilfredv1930
    @wilfredv1930 ปีที่แล้ว

    I just recently subscribed to your newsletter, and this channel is also awesome.

  • @yehya7537
    @yehya7537 5 หลายเดือนก่อน

    I just read this topic in the first book volume. Great explanation, thank you!

  • @karwanautiyaal1202
    @karwanautiyaal1202 ปีที่แล้ว

    Loving this series, Database Sharding and Database Indexing.

  • @hiteshklalwani
    @hiteshklalwani ปีที่แล้ว

    I love your explanation, it is very clear and core concepts covered in so less time and words :)

  • @1shadyholic
    @1shadyholic 4 หลายเดือนก่อน

    this channel is a game changer. I love it!!!

  • @mailnrajesh
    @mailnrajesh ปีที่แล้ว

    Finally, I was able to understand what consistent hashing is!!!

  • @DreckbobBratpfanne
    @DreckbobBratpfanne 4 หลายเดือนก่อน

    1) Great explanation
    2) Its oddly satisfying when he says "the other keys are unaffected"

  • @ManojKrVerma-vw4dx
    @ManojKrVerma-vw4dx ปีที่แล้ว

    The video I was waiting for .. will see on Saturday evening... Currently busy in thesis ppt preparation ... I like yours video without watching... ThankYou sir...

  • @anastasianaumko923
    @anastasianaumko923 10 หลายเดือนก่อน +1

    Thank you so much! Very elaborate explanation. Great work!😌

  • @zdravkochorlev8540
    @zdravkochorlev8540 ปีที่แล้ว

    The videos are perfect - short and well explained.

  • @andriidanylov9453
    @andriidanylov9453 ปีที่แล้ว

    Cool, thanks. I have read Your first book and now thinking about buying volume 2.

  • @Galakyllz
    @Galakyllz ปีที่แล้ว

    This was great and to the point. The only confusion that I had was about how the ring was constructed, but I figured that it must be the possible hash values. A quick example of "server 1's hash is 1234, so it goes here on the ring. The other server hashes place them at points in the ring in exactly the same way" would have been more clear.
    Thanks for the video!

  • @HikeWithUsMagarFamily
    @HikeWithUsMagarFamily ปีที่แล้ว

    good good, thanks for the content, precise, clear. liked the way you connect with real world products as well

  • @priyankverma7434
    @priyankverma7434 2 หลายเดือนก่อน

    Very well explained and easy to understand. You made this concept so easy to understand that anyone can implement this. Thanks for the good video.

  • @SHUBHAMKUMAR-ij7cx
    @SHUBHAMKUMAR-ij7cx ปีที่แล้ว

    Thanks @ByteByteGo team, for explaining an important concept like Consistent Hashing in such an easy manner.

  • @derekyingzhi8009
    @derekyingzhi8009 ปีที่แล้ว +1

    The best system design video ever. I wish you could make more videos like this available on youtube. Thank you!

    • @ByteByteGo
      @ByteByteGo  ปีที่แล้ว +1

      Thank you for the feedback. We’ll definitely make more videos like this. Let us know if you have specific topics you’d like to see.

  • @funnyclipz520
    @funnyclipz520 ปีที่แล้ว

    this video is truly golden... keep em coming...

  • @sumanshekhar8110
    @sumanshekhar8110 ปีที่แล้ว +2

    Man, you should bring out an entire series, It takes too much effort to come up with a video where you show too many concepts in a short amount of time. you are a saviour for legion like us.

    • @AlphaTheSkunk
      @AlphaTheSkunk ปีที่แล้ว +1

      I agree, and furthermore, I am willing to pay if it helps bring a series with this level of quality and information density. Especially your videos on systems design are a blessing.

  • @NikolaJanevski
    @NikolaJanevski ปีที่แล้ว

    Love the video and the animation. Keep them coming.

  • @kacy6014
    @kacy6014 9 หลายเดือนก่อน

    This was beautiful. I just wish you would've mentioned how the the virtual node positions get decided.

  • @delta3979
    @delta3979 ปีที่แล้ว

    Such an interesting and important algorithm that I didn't even knew I needed.

  • @praveenX
    @praveenX ปีที่แล้ว +3

    Awesome video 👏loved the animation and explanation.
    A side question: Animation on your channel is just awesome, which tool you are using?

  • @MrBidi1992
    @MrBidi1992 ปีที่แล้ว +1

    Another amazing video ! Thank you so much 👍

  • @matthewfala
    @matthewfala ปีที่แล้ว

    Beautiful graphics! Love the explanation

  • @sjndfot
    @sjndfot 8 หลายเดือนก่อน

    this is so beautiful!

  • @VinodKumar-wh1mq
    @VinodKumar-wh1mq ปีที่แล้ว

    Animations are awesome :) please keep the good contents coming!

  • @RaviSurulikamu
    @RaviSurulikamu ปีที่แล้ว

    As usual this video is nicely presented with all the important aspects covered. I just have one correction. Amazon DynamoDB doesn't use consistent hashing, but Amazon Dynamo which is completely different uses it.

  • @javisartdesign
    @javisartdesign ปีที่แล้ว

    Very graphical and simple explanation! thanks

  • @zahidulislam2068
    @zahidulislam2068 ปีที่แล้ว

    Your channel is a must watch

  • @mooseyard
    @mooseyard ปีที่แล้ว +1

    This isn’t just used in servers. Many peer-to-peer networks, like Kademlia, use a similar “hash ring” to determine which peers should hold which keys/values. They usually put in quite a bit of redundancy, spreading data among multiple “nearby” peers, since peers come and go so frequently.

  • @liftingisfun2350
    @liftingisfun2350 ปีที่แล้ว

    Incredible visuals and fantastic information

  • @programming6881
    @programming6881 10 หลายเดือนก่อน

    Simple and excellent explanation. Thanks.

  • @debashishdeka7698
    @debashishdeka7698 ปีที่แล้ว

    Great content. Thanks. Could you cover LSM Tree ? For example, in this video, individual node might use LSM Tree to store [k,v] s

  • @Ed-kq9nu
    @Ed-kq9nu 9 หลายเดือนก่อน

    Great explanation! Ty!

  • @gautam4934
    @gautam4934 10 หลายเดือนก่อน

    Brilliantly explained!

  • @ByteByteGo
    @ByteByteGo  ปีที่แล้ว +10

    What algorithms should we talk about next?

    • @mdwakil7263
      @mdwakil7263 ปีที่แล้ว +2

      Can you please cover architectural design patterns like Saga etc?

    • @igboman2860
      @igboman2860 ปีที่แล้ว +2

      cryptographic algorithms? Huffman, RSA etc

    • @muddhitbaid2831
      @muddhitbaid2831 ปีที่แล้ว +2

      Quad tree

    • @helloworld7313
      @helloworld7313 ปีที่แล้ว +3

      Bloom Filter

    • @eliyahubasa9401
      @eliyahubasa9401 ปีที่แล้ว +2

      Bloom Filter or hash function under the hoods

  • @djplt1240
    @djplt1240 ปีที่แล้ว +1

    Loved the video, really helped me in a recent interview! Just wondering, can consistent hashing be used to redistribute load across hot shards?

  • @selvakannan2548
    @selvakannan2548 ปีที่แล้ว

    clean and concise. subbed

  • @RahulPuls
    @RahulPuls ปีที่แล้ว +6

    Awesome content like always. Again please share the tools you use for creating such cool animations. I'm a BIG fan!!

    • @ByteByteGo
      @ByteByteGo  ปีที่แล้ว +6

      Thanks. Illustrator and After Effects

  • @glebbondarenko67
    @glebbondarenko67 ปีที่แล้ว

    haha. And thank you for adding `Animation tools` in the description :)

  • @freud6343
    @freud6343 ปีที่แล้ว

    I am not sure whether I should comment on the excellent explanation or mind-blowing presentation.

  • @TheNilesh00
    @TheNilesh00 3 หลายเดือนก่อน

    Awesome content as always. I'm a paid blog subscriber as well as have the annual pass for the System design course. I'm amazed by all the graphics used in this video. Is there a particular tool you use that you can share for our own presentations?

  • @adamrizk6735
    @adamrizk6735 4 หลายเดือนก่อน

    Awesome video, thanks for sharing this.

  • @clapathy
    @clapathy ปีที่แล้ว

    Super nice presentation, thank you!

  • @dibll
    @dibll ปีที่แล้ว

    Amazing Content. Could you pls cover Vector clocks and Consensus Algorithms in the future segments.

  • @ManuelBTC21
    @ManuelBTC21 ปีที่แล้ว

    Quality content. Great job.

  • @JohnnyRotten-uf6xw
    @JohnnyRotten-uf6xw หลายเดือนก่อน

    Why th are all of your videos so good? Omg

  • @MrEW1985
    @MrEW1985 ปีที่แล้ว

    I learned something new. Thank you very much.

  • @chadblair5974
    @chadblair5974 ปีที่แล้ว

    That was fantastic. Thank you.

  • @fergeraci
    @fergeraci ปีที่แล้ว

    Fantastic video and books. Thank you.

  • @ovidiurosu6632
    @ovidiurosu6632 ปีที่แล้ว

    super well described, thank you

  • @thisismara
    @thisismara ปีที่แล้ว

    Subscribing. I've watch a handful of your videos and I am learning a lot as a SWE. Thank you!

  • @yzhang2008
    @yzhang2008 ปีที่แล้ว

    Very well explained!