ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models

Mianjie Yu, Zhongmin Zhao, Zizhao Mo, Jianxiong Liao, Wenxuan Li, Yulin Qiao, Huanle Xu, Wenquan Yang, Yongqiang Yang, Zeren Li, Ruifeng Tang, Chengzhong Xu
July 2026

Abstract

TBD.

Type
Conference paper
Publication
In Proceedings of 24th USENIX Symposium on Networked Systems Design and Implementation
Mianjie Yu
Mianjie Yu
2024 - Current

My research interests include everything.

Zhongmin Zhao
Zhongmin Zhao
2024 - Current

My research interests include distributed training and LLMs.

Zizhao Mo
Zizhao Mo
2025 - Current
Jianxiong Liao
2024 - 2025 RA

My current research interests lie in cloud computing and machine learning systems.

Wenxuan Li
Wenxuan Li
2024 - Current
Yulin Qiao
Yulin Qiao
2024 - Current

My research interests include LLMs and Distributed Systems.I am also interested in Principle of Automatic Control.

Huanle Xu
Huanle Xu
2021 - Current

I am currently an assistant professor from the Department of Computer and Information Scicence, Univeristy of Macau.

Chengzhong Xu
Chengzhong Xu
2019 - Current

I am currently a Chair Professor in the Department of Computer and Information Science and serve as the Dean of the Faculty of Science and Technology at the University of Macau.