Derm: SLA-aware Resource Management for Highly Dynamic Microservices

Abstract

In this paper, we present Derm, a new resource management system designed for microservice applications with highly dynamic graphs. Our principal finding is that prioritizing different microservice graphs can lead to a substantial reduction in resource allocation. To take advantage of this opportunity, we develop three main components. The first is a performance model that describes uncertainties of microservice latency through a conditional exponential distribution. The second is a probabilistic quantification of the dynamics of microservice graphs. The third is an optimization method for adjusting the resource allocation of microservices to minimize resource usage. We evaluate Derm in our cluster using real microservice benchmarks and production traces. The results highlight that Derm reduces the resource usage by 68.4% and lowers SLA violation probability by 6.7x, compared to existing approaches. # Summary. An optional shortened abstract.

Liao Chen

2022 - Current

My research interests include distributed system and cloud computing.

Zizhao Mo

2021 - Current

Huanle Xu

2021.01 - Current

I am currently an assistant professor from the Department of Computer and Information Scicence, Univeristy of Macau.