Throughput vs. Latency: How To Debug A Latency Problem

แชร์
ฝัง
  • เผยแพร่เมื่อ 2 มิ.ย. 2024
  • Imagine you’re on call for the service you work on and you get paged in the middle of the night. Phone blaring, you stumble out of bed, sleepily turn on your computer, and look at your metrics. Looks like request latency went up a lot and users are getting errors. How do you figure out what’s going on? In this video, we’ll answer this question by looking at the relationship between throughput and latency, subtypes of latency like queuing latency, and techniques for debugging high latency. All you need is a little familiarity with software engineering. Let’s go!
    00:00 Intro
    00:28 Servers & Threads
    00:53 What Is Latency?
    01:24 What Is Throughput?
    01:46 Ice Cream Analogy
    02:19 Max Throughput
    03:32 Queueing Latency
    04:36 Server Simulation (don't miss this!)
    07:17 Summary
    07:58 How To Debug High Latency
    08:33 Things Can Be Even More Complicated

ความคิดเห็น • 33

  • @mykhailo_klym
    @mykhailo_klym 2 ปีที่แล้ว +22

    man, these videos you make on programming, they're amazing ! Keep it up !

    • @user-qr8gx2kx9q
      @user-qr8gx2kx9q 2 ปีที่แล้ว +1

      Agree 100%, this channel is a gem

  • @arber10
    @arber10 ปีที่แล้ว +6

    Very nice explained and excellent animations with the graphs. I like this channel. 10/10

  • @mostinho7
    @mostinho7 ปีที่แล้ว +4

    Thanks for making this!
    Where can I learn more about this topic? Any good resource recommendations?

  • @kokolingga9673
    @kokolingga9673 ปีที่แล้ว

    This is very helpful. Thank you Alex!

  • @user-cl7ev6xm9s
    @user-cl7ev6xm9s 11 หลายเดือนก่อน

    this is the best video i have ever seen on this topics , thanks bro

  • @shashink5923
    @shashink5923 2 ปีที่แล้ว

    This video is dope AF!!. Thank you

  • @radub6436
    @radub6436 2 ปีที่แล้ว +1

    Excellent video!

  • @saurabhman
    @saurabhman 2 หลายเดือนก่อน

    Good work Alex!

  • @aysubetin-can6435
    @aysubetin-can6435 3 หลายเดือนก่อน

    Great video series, please do more

  •  ปีที่แล้ว

    Excellent video. I’m surprised it didn’t get many likes.

  • @thehimanshukeshri
    @thehimanshukeshri ปีที่แล้ว

    well explained

  • @SamarthSoni-qo8je
    @SamarthSoni-qo8je ปีที่แล้ว

    Please more videos like this. Ready to join this channel too if you're activating the join or membership kinda thing

  • @cale7306
    @cale7306 6 หลายเดือนก่อน

    a good example to add is intrinsic latency is very important for gaming where to data packets are relatively small, but you want it it get to destination and back fast.. there concept difference between downloading a file vs live streaming or gaming.., Cable Internet have bad intrinsic latency..

  • @user-xo4rr5en3e
    @user-xo4rr5en3e 7 หลายเดือนก่อน

    thanks man

  • @Y3arin
    @Y3arin 2 ปีที่แล้ว +9

    Great video, thanks!
    I'd recommend you consider getting rid of the background music though, it's really distracting :(

    • @StudyingWithAlex
      @StudyingWithAlex  2 ปีที่แล้ว +3

      Sorry about that! I've noticed the music sounds completely different depending on the speakers you're using. What speakers do you use? Does it sound loud if you listen to it on a computer or with headphones?

    • @YuriWZM
      @YuriWZM 2 ปีที่แล้ว

      @@StudyingWithAlex eiiii yooo :))

    • @shashink5923
      @shashink5923 2 ปีที่แล้ว +3

      On the contrary, I really like the background music. Makes it more engaging!!

  • @1Lightest
    @1Lightest หลายเดือนก่อน

    nice content

  • @Saikumar_vgs
    @Saikumar_vgs 10 หลายเดือนก่อน

    Hi @StudingWithAlex, Loved your videos and great animation with right context.
    Can you make a video or any guide to make videos like this...
    Thank You 😃😃

  • @cvramankishore4u
    @cvramankishore4u ปีที่แล้ว

    nice videos

  • @YuriWZM
    @YuriWZM 2 ปีที่แล้ว

    Clockwork hell yeah!

  • @krishnasai4742
    @krishnasai4742 2 ปีที่แล้ว

    does throughput care about the correctness of the output? or only churning out the date ?

    • @blucky_yt
      @blucky_yt ปีที่แล้ว

      Throughput is only a metric of how fast the work is done, not how good it is done, it doesn't care if it's wrong, only if it's fast. It's like in that dumb joke:
      -I am the fastest counter in the world
      -what's 2+2
      -5
      -that's wrong
      -but fast

  • @et4493
    @et4493 ปีที่แล้ว

    godly

  • @Browqueen
    @Browqueen 2 ปีที่แล้ว

    Hey Alex - I have a code to crack and was wondering if you were able to help me at all?

  • @LioPrime
    @LioPrime 8 หลายเดือนก่อน

    i watch these for entertainment lol

  • @nihar108
    @nihar108 24 วันที่ผ่านมา

    Why did you stop making videos? Please restart if you can!

  • @markarca6360
    @markarca6360 29 วันที่ผ่านมา

    Caches have entered the chat.

  •  ปีที่แล้ว +1

    please lower music volume
    I am not here to listen music but to listen and learn

  • @markcuello5
    @markcuello5 ปีที่แล้ว

    PLEASE HELP ME -- My channel is being infiltrated from 2 persons at 06880 + others. [Some of the others: 06830].

  • @Pedritox0953
    @Pedritox0953 ปีที่แล้ว

    Great video!