Quantifying eventual consistency with PBS

• Published in: The VLDB journal Vol. 23; no. 2; pp. 279 - 302
• Main Authors: Bailis, Peter, Venkataraman, Shivaram, Franklin, Michael J., Hellerstein, Joseph M., Stoica, Ion
• Format: Journal Article Conference Proceeding
• Language: English
• Published: Berlin/Heidelberg Springer Berlin Heidelberg 01-04-2014; Springer
• Subjects: Applied sciences; Computer Science; Computer science; control theory; systems; Computer systems and distributed systems. User interface; Database Management; Exact sciences and technology; Information systems. Data bases; Memory and file management (including protection and security); Memory organisation. Data processing; Software; Special Issue Paper; Staleness; NoSQL; Regular semantics; Distributed databases; Consistency; Prediction; Replication; Quorum systems; Dynamo; Availability; Quorum; Distributed database; Time scale; Real time; Modeling; Delay; Workload; Exact solution; Semantics; Internet; Database management system; Obsolescence; Execution time
• ISSN: 1066-8888; 0949-877X
• DOI: 10.1007/s00778-013-0330-1

Data store replication results in a fundamental trade-off between operation latency and data consistency. At the weak end of the consistency spectrum is eventual consistency providing no limit to the staleness of data returned. However, anecdotally, eventual consistency is often “good enough” for practitioners given its latency and availability benefits. In this work, we explain why eventually consistent systems are regularly acceptable in practice, analyzing both the staleness of data they return and the latency benefits they offer. We introduce Probabilistically Bounded Staleness (PBS), a consistency model which provides expected bounds on data staleness with respect to both versions and wall clock time. We derive a closed-form solution for versioned staleness as well as model real-time staleness under Internet-scale production workloads for a large class of quorum-replicated, Dynamo-style stores. Using PBS, we measure the latency–consistency trade-off for partial, non-overlapping quorum systems, including limited multi-object operations. We quantitatively demonstrate how and why eventually consistent systems frequently return consistent data within tens of milliseconds while offering significant latency benefits.