Latency vs Throughput | System Design Essentials

Подписаться 222 тыс.

Просмотров 27 тыс.

50% 1

Understanding the difference between Latency and Throughput are important concepts in system design, distributed systems, and cloud computing. In this video, I explain to you the difference between the two walking through official definitions, and providing real-world examples.
Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! courses.beabetterdev.com/cour...
🎉SUPPORT Daniel @ BE A BETTER DEV🎉
Become a Patron: / beabetterdev
📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚
Clean Code - amzn.to/37T7xdP
Clean Architecture - amzn.to/3sCEGCe
Head First Design Patterns - amzn.to/37WXAMy
Domain Driver Design - amzn.to/3aWSW2W
Code Complete - amzn.to/3ksQDrB
The Pragmatic Programmer - amzn.to/3uH4kaQ
Algorithms - amzn.to/3syvyP5
Working Effectively with Legacy Code - amzn.to/3kvMza7
Refactoring - amzn.to/3r6FQ8U
🎙 MY RECORDING EQUIPMENT 🎙
Shure SM58 Microphone - amzn.to/3r5Hrf9
Behringer UM2 Audio Interface - amzn.to/2MuEllM
XLR Cable - amzn.to/3uGyZFx
Acoustic Sound Absorbing Foam Panels - amzn.to/3ktIrY6
Desk Microphone Mount - amzn.to/3qXMVIO
Logitech C920s Webcam - amzn.to/303zGu9
Fujilm XS10 Camera - amzn.to/3uGa30E
Fujifilm XF 35mm F2 Lens - amzn.to/3rentPe
Neewer 2 Piece Studio Lights - amzn.to/3uyoa8p
💻 MY DESKTOP EQUIPMENT 💻
Dell 34 inch Ultrawide Monitor - amzn.to/2NJwph6
Autonomous ErgoChair 2 - bit.ly/2YzomEm
Autonomous SmartDesk 2 Standing Desk - bit.ly/2YzomEm
MX Master 3 Productivity Mouse - amzn.to/3aYwKVZ
Das Keyboard Prime 13 MX Brown Mechanical- amzn.to/3uH6VBF
Veikk A15 Drawing Tablet - amzn.to/3uBRWsN
🌎 Find me here:
Twitter - / beabetterdevv
Instagram - / beabetterdevv
Patreon - Donations help fund additional content - / beabetterdev
#SystemDesign
#SoftwareEngineer
#SoftwareDeveloper

Опубликовано:

28 июн 2024

Ссылка:

Скачать:

Готовим ссылку...

Добавить в:

Мой плейлист

Посмотреть позже

Комментарии : 42

@jordanb9363 Год назад

I'm going through the System design playlist and just wanna say these are so valuable. Appreciate all the effort that went behind this and for keeping it free!

@samartajshaikh2601 3 месяца назад

Have never seen someone explain latency and throughput in this much depth

@krishanmadushanka9521 Год назад

Most clear explanation about latency vs throughput in the internet. Thanks!

@BeABetterDev Год назад

Glad it was helpful!

@adrienesquerre5790 Год назад

Such an elegant demonstration ! I am sincerely grateful to you, Master.

@charlesopuoro5295 Год назад

Thank you very much for this clear , pragmatic explanation.

@sakethtadimeti9008 2 года назад

Thanks for taking the time to explain this so well.

@funkykong9001 3 года назад

I would have liked to have heard more about the relationship of latency and throughput and how latency can limit potential throughput.

@carlosflor1766 2 года назад

From my perspective, latency can not limit throughput directly, but it can delay the amount of data that we trying to sent/receive. For example if we have a server in Asia and we are trying to do a request from South America, even if the server in Asia has a high throughput (e.g. up to 500k requests per second in a client server model) the time that our requests will take to reach the server will not affect the amount of requests the server can handle (still 500k requests per second). For us as a client having a high latency means wait more time to servers to react, on other hand low throughput means requests start being denied at some point or server crash (if the server is not prepared for that) There's some cases where throughput can affect latency, for example when we're doing requests and the server reach their limits and it starts scaling up (vertically or horizontally) so our requests will take more time to be processed since those will need to wait for the scaling process (In modern systems, if we are not talking about scaling in different regions across the globe, usually some milliseconds)

@stephenmccallion5886 3 года назад

This is great I really enjoy your content. I'd love to see any videos on CI/CD tools deploying to AWS.

@BeABetterDev 3 года назад

Thanks stephen! I hear you loud and clear - I've added a CI / Deployment item to my backlog of videos. Hopefully I can have something out soon. Cheerss

@rohitmishraet 2 года назад

Thanks, very well explained!!

@uchennaonyia9377 2 года назад

Another great video. Thanks very much. They are always very insightful. I was wondering if you would do a video on instance sizing. Picking the right type of instance for your application and the things to Consider

@BeABetterDev 2 года назад

Great idea for a video, thank you!

@joshbriton2859 2 года назад

Thank you for this clear explanation

@BeABetterDev 2 года назад

You're very welcome Josh!

@BelarusianInUk Месяц назад

Regarding Latency/counts chart. The axises should be swapped. Latency should be on the vertical axis as this is a function of counts

@abdulmoizsheikh8031 3 года назад

THank you soo much. Really enjoyed this talk

@BeABetterDev 3 года назад

You're very welcome abdul!

@ypucandeleteit 3 года назад

thank you this was a really good source of information

@BeABetterDev 2 года назад

You're very welcome Spas!

@adarshrana8243 3 года назад

Sir you are toooo good, love from India

@Neelu2023 3 года назад

Thank you. This is really helpful

@BeABetterDev 3 года назад

You're very welcome Mahesh!

@Teh-Penguin 7 месяцев назад

Great videos!

@bhatsachin 2 года назад

This is a very nice explanation, i was searching for better understating for a while now. Thank you. Also, i have a question around network bandwidth. how much network bandwidth does cloud provider provides? because if I can increase number of servers and my each request is 1 mb how many concurrent requests can my network handle? Because there should be some limit to the network which connects from client to Load balancer.

@aayyaa1188 2 года назад

Thank you soooo much for the awesome tutorial! It is super clear. Just one small question. If we level up throughput, does it mean that the processing latency could be lower? Thank you for any answer you provide.

@BeABetterDev 2 года назад

Hi Anyi, Increasing throughput (concurrency) can actually INCREASE latency. The reason is because typically to increase concurrency, we increase the amount of requests to a host while keeping the number of hosts fixed. This can result in more CPU usage on higher latency API calls. If you add more hosts, then this shouldn't be a problem. Hope this helps, Daniel