jongminchungtech
Engineering

Throughput and Latency

Concurrency improves throughput only to a limit; beyond saturation, queues increase latency nonlinearly.

Verified Source
Throughput and Latency
Image generated with OpenAI from the article topic

Overview

Explain throughput and latency with Little's Law, concurrency, execution models, and utilization curves.

Related articles

Building an Email Relay SystemBuilding from First PrinciplesBuilding an Email Relay SystemBuilding an Encrypted Sharing VaultBuilding from First PrinciplesBuilding an Encrypted Sharing VaultFrontend Caching StrategiesEngineering articleFrontend Caching Strategies