SE-Radio Episode 277: Gil Tene on Tail Latency

Gil Tene joins Robert Blumen for a discussion of tail latency.
What is latency? What is "tail latency"? Why are the upper
percentiles of latency more relevant to humans? How is human
interaction with an application influenced by tail latency? What
are the economics of tail latency? What are the origins of tail
latency within a system? What is the difference between response
time and service time? How does queuing within a system
contribute to response time? Java garbage collection and its
contribution to latency outliers. How can we build systems with
bounded tail latency out of components with variable latency?
What type of observability to do we need to build systems with
bounded latency? How is latency a driver of capacity planning?