Feedback-Control-Based Performance Regulation for Multi-Tenant Applications

• Published in: 2009 15th International Conference on Parallel and Distributed Systems pp. 134 - 141
• Main Authors: Hailue Lin, Kai Sun, Shuan Zhao, Yanbo Han
• Format: Conference Proceeding
• Language: English
• Published: IEEE 01-12-2009
• Subjects: Computers; Costs; multi-tenant; performance regulation; Quality of service; Regulators; Resource management; Security; Software prototyping; Testing; Web and internet services; Yarn
• ISBN: 9781424457885; 1424457882
• ISSN: 1521-9097; 2690-5965
• DOI: 10.1109/ICPADS.2009.22

The ability to deliver different performance levels based on tenant-specific service level agreements (SLAs) is a key requirement for multi-tenant Internet applications. However, workload variations and extensive resource sharing among tenants make this goal hard to achieve. We address the issue with a performance regulator based on feedback-control. The regulator has a hierarchical structure, with which a high-level controller manages request admission rates to prevent overloading and a low-level controller manages resource allocation for admitted requests to track a specified level of service differentiation between the cohosted tenants. A prototype implementation of the performance regulator based on Tomcat and MySQL is provided and a multi-tenant version of RUBBoS benchmark is used for evaluation. Experimental results indicate that the regulator effectively bounds the response time for each tenant while maintaining high resource utilization levels.