ETH: Data-Balanced Heterogeneous Pipeline Parallelism for Training Large Models

Abstract

TBD.

Publication
In Proceedings of 24th USENIX Symposium on Networked Systems Design and Implementation
Mianjie Yu
Mianjie Yu
2024 - Current

My research interests include everything.

Zhongmin Zhao
Zhongmin Zhao
2024 - Current

My research interests include distributed training and LLMs.

Zizhao Mo
Zizhao Mo
2025 - 2026 Postdoc

Zizhao Mo is an Assistant Professor at Great Bay University.

Jianxiong Liao
Jianxiong Liao
2024 - 2025 Research Assistant

My current research interests lie in cloud computing and machine learning systems.

Wenxuan Li
Wenxuan Li
2024 - 2026 Master Student

Wenxuan Li is currently working at Huawei’s Automotive Business Unit (Car BU).

Yulin Qiao
Yulin Qiao
2024 - 2026 Master Student

Yulin Qiao is currently pursuing his PhD at the University of Science and Technology of China.

Huanle Xu
Huanle Xu
2021 - Current

I am currently an assistant professor from the Department of Computer and Information Scicence, Univeristy of Macau.

Chengzhong Xu
Chengzhong Xu
2019 - Current

I am currently a Chair Professor in the Department of Computer and Information Science and serve as the Dean of the Faculty of Science and Technology at the University of Macau.