Elastic Provisioning of Cloud Caches: A Cost-Aware TTL Approach

• Published in: IEEE/ACM transactions on networking Vol. 28; no. 3; pp. 1283 - 1296
• Main Authors: Carra, Damiano, Neglia, Giovanni, Michiardi, Pietro
• Format: Journal Article
• Language: English
• Published: New York IEEE 01-06-2020; The Institute of Electrical and Electronics Engineers, Inc. (IEEE); IEEE/ACM
• Subjects: adaptive estimation; Algorithms; Cache storage; Cloud computing; Complexity theory; computational complexity; Computer Science; Cost control; Dynamic scheduling; Heuristic algorithms; minimization; Networking and Internet Architecture; Provisioning; Resource allocation; Servers; Web services
• ISSN: 1063-6692; 1558-2566
• DOI: 10.1109/TNET.2020.2980105

We consider elastic resource provisioning in the cloud, focusing on in-memory key-value stores used as caches. Our goal is to dynamically scale resources to the traffic pattern minimizing the overall cost, which includes not only the storage cost, but also the cost due to misses. In fact, a small variation of the cache miss ratio may have a significant impact on user perceived performance in modern web services, which in turn has an impact on the overall revenues for the content provider using such services. We propose and study a dynamic algorithm for TTL caches, which is able to obtain close-to-minimal costs. Since high-throughput caches require low complexity operations, we discuss a practical implementation of such a scheme requiring constant overhead per request independently from the cache size. We evaluate our solution with real-world traces collected from Akamai, and show that the TTL approach is able to track the optimal cache configuration and achieve significant cost savings specially in highly dynamic settings that are likely to require elastic cloud services.