Definition
Throughput is the amount of requests, tokens, tasks, or accepted outcomes completed per unit time.
Distinguish it from nearby terms
Latency describes one item's elapsed time; throughput describes aggregate processing rate.
Check your understanding
State the unit, time window, concurrency, and whether failed or rejected work counts.