Latency vs Throughput. Know the difference? #javascript #python #web #coding #programming

Animation tools: Adobe Illustrator and After Effects.

Checkout our bestselling System Design Interview books:

ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

[Slorthe]

I like how you scaled the volume of scale

[yassine-sa]

Don't forget to not worry about an issue you still don't have, if you're building a system from the ground up, and after you build it it will then start to grow so you'll have time to then optimize it, don't try to optimize it before it's even a thing!

[jagadeeshgurana]

Thats so beautiful of you to teach them very well🎉

[ahmedhafiz]

Wow. Nicely explained with the catch in a short time. 🎉

[hrishabhg]

Not really making much sense. Single core server, if it can respond faster, it will increase throughput. You should add if resources are fixed, then increasing the throughput, might (not will) worsen the latency and vice-versa.
In modern auto-scalable systems, the latency and throughput should be considered w.r.t dependency of an API on which resource.

If API latency was poor and I added resource (redis), my latency become better as well throughput of the single web-server increased. However, I had to now add a new component Redis.

[joserenatonunes]

Wonderful explanation. What tool did you use to create these diagrams?

[Pellonie]

First time I’m starting to understand latency and throughput 😂 thx

[SystemErrorMessage]

not quite, it depends on the design in code and components. when you design you decouple things so cache does not eat into processing memory.

[LimitedWard]

Is there a way to quantitatively estimate throughput prior to implementing such changes?

[keenheat]

peer to peer hosting, get the best of both worlds. More users = more service hosting = more throughput. Although data consistency become an issue then.
I guess everything comes down to CAP.

[pranavmahajan]

I didnt understand how using cache can reduce throughput? Can someone please elaborate?

[KrishnaDasPC]

Teaches more than a university in short videos.

[elpo]

What's the difference between throughput and bandwidth?

[lllllMlllll]

Can you specify higher latency for subset of users? I believe AI is best at calculating best balance between latency and throughput

[chiebidoluchinaemerem]

Zig's performance is scary
I am really shocked to see that Zig is this good

[abhishek-]

Why is throughput defined as "number of requests handled simultaneously"? What if you handle them one at a time, say if your load is low?

[gryrvn]

great... 🥱

please check your audio... balance... =_=

[logeshkumarrajkumar]

If we are using Redis for caching, we can spin up more Redis instances right? That won’t solve the memory problem without affecting the throughput?

[muizzy]

They're not always mutually exclusive. e.g. often times when you get too much throughput, latency will go up as a lack of resources is reached.

[bharvadhardik]

The youtube channel and all contains is excellent but To improvement in your voice