* indicates correspondence
1 indicates co-first authors
- Pipe-BD: Pipelined Parallel Blockwise Distillation
-
Hongsun Jang, Jaewon Jung, Jaeyong Song, Joonsang Yu, Youngsok Kim and Jinho Lee*
DATE (Accepted), 2023
Top Conf.
AI/ML
Syst. SW
- Optimus-CC: Efficient Large NLP Model Training with 3D Parallelism Aware Communication Compression
-
Jaeyong Song1, Jinkyu Yim1, Jaewon Jung, Hongsun Jang, Hyung-Jin Kim, Youngsok Kim, and Jinho Lee*
ASPLOS (Accepted), 2023
Top Conf.
AI/ML
Syst. SW
- FlexReduce: Flexible All-reduce for Distributed Deep Learning on Asymmetric Network Topology
-
Jinho Lee, Inseok Hwang, Soham Shah, Minsik Cho
DAC, 2020, Author Copy, Paper
Top Conf.
AI/ML
Syst. SW