Paper-Conference

SMIless: Serving DAG-based Inference with Dynamic Invocations under Serverless Computing
The deployment of ML serving applications, featuring multiple inference functions on serverless platforms, has gained substantial …
PDF
Derm: SLA-aware Resource Management for Highly Dynamic Microservices
In this paper, we present Derm, a new resource management system designed for microservice applications with highly dynamic graphs. Our …
PDF
Optimizing Dynamic Data Center Provisioning through Speed Scaling: A Primal-Dual Perspective
A significant proportion of energy consumed in modern data centers and clouds is dedicated to provisioning idle servers for maintaining …
PDF
Heet: Accelerating Elastic Training in Heterogeneous Deep Learning Clusters
Modern GPU clusters inherently exhibit heterogeneity, encompassing various aspects such as computation and communication. This …
PDF
Interference-aware Multiplexing for Deep Learning in GPU Clusters A Middleware Approach
A common strategy for improving efficiency in training deep learning entails multiplexing tasks on a single GPU. To mitigate the …
PDF
PERT-GNN: Latency Prediction for Microservice-based Cloud-Native Applications via Graph Neural Networks
Cloud-native applications using microservice architectures are rapidly replacing traditional monolithic applications. To meet …
PDF
Understanding and Optimizing Workloads for Unified Resource Management in Large Cloud Platforms
To fully utilize computing resources, cloud providers such as Google and Alibaba choose to co-locate online services with batch …
PDF
Erms: Efficient Resource Management for Shared Microservices with SLA Guarantees
A common approach to improving resource utilization in data centers is to adaptively provision resources based on the actual workload. …
PDF
The Power of Prediction Microservice Auto Scaling via Workload Learning
When deploying microservices in production clusters, it is critical to automatically scale containers to improve cluster utilization …
PDF Code
Multi Resource Scheduling with Task Cloning in Heterogeneous Clusters
To mitigate the straggler effect, today’s systems and computing frameworks have adopted redundancy to launch extra copies for …
PDF