Throughput vs. Latency: How To Debug A Latency Problem

Показать описание

Imagine you’re on call for the service you work on and you get paged in the middle of the night. Phone blaring, you stumble out of bed, sleepily turn on your computer, and look at your metrics. Looks like request latency went up a lot and users are getting errors. How do you figure out what’s going on? In this video, we’ll answer this question by looking at the relationship between throughput and latency, subtypes of latency like queuing latency, and techniques for debugging high latency. All you need is a little familiarity with software engineering. Let’s go!

00:00 Intro
00:28 Servers & Threads
00:53 What Is Latency?
01:24 What Is Throughput?
01:46 Ice Cream Analogy
02:19 Max Throughput
03:32 Queueing Latency
04:36 Server Simulation (don't miss this!)
07:17 Summary
07:58 How To Debug High Latency
08:33 Things Can Be Even More Complicated

Studying With Alex

Рекомендации по теме

Комментарии

man, these videos you make on programming, they're amazing ! Keep it up !

mykhailo_klym

Very nice explained and excellent animations with the graphs. I like this channel. 10/10

arber

very well explained! Great video! Subscribed!

peteiscurious

this is the best video i have ever seen on this topics, thanks bro

trialemail-of

Thanks for making this!
Where can I learn more about this topic? Any good resource recommendations?

mostinho

a good example to add is intrinsic latency is very important for gaming where to data packets are relatively small, but you want it it get to destination and back fast.. there concept difference between downloading a file vs live streaming or gaming.., Cable Internet have bad intrinsic latency..

cale

I wonder how two other illustrations might illustrate issues which can arise with servers. One: the counter clerk at the ice cream store is doing fine until one of the ice cream buckets runs empty, so they have to go get another from the freezer, and a line forms.
Two: Now the customers are angry about the line, and each one wants to register a complaint, which decreases the intrinsic throughput. So the process of getting another bucket and any decrease in throughput from the hard-frozen data (I mean ice cream) along with complaints, ends up creating bigger and bigger issues.

scottk

Please more videos like this. Ready to join this channel too if you're activating the join or membership kinda thing

SamarthSoni-qoje

Excellent video. I’m surprised it didn’t get many likes.

Hi @StudingWithAlex, Loved your videos and great animation with right context.
Can you make a video or any guide to make videos like this...

Thank You 😃😃

Saikumar_vgs