DAPPLE: A pipelined data parallel approach for training large models S Fan, Y Rong, C Meng, Z Cao, S Wang, Z Zheng, C Wu, G Long, J Yang, ... Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of …, 2021 | 197 | 2021 |
Understanding and bridging the gaps in current GNN performance optimizations K Huang, J Zhai, Z Zheng, Y Yi, X Shen Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of …, 2021 | 78 | 2021 |
AStitch: enabling a new multi-dimensional optimization space for memory-intensive ML training and inference on modern SIMT architectures Z Zheng, X Yang, P Zhao, G Long, K Zhu, F Zhu, W Zhao, X Liu, J Yang, ... Proceedings of the 27th ACM International Conference on Architectural …, 2022 | 53 | 2022 |
Refactoring and optimizing the community atmosphere model (CAM) on the sunway taihulight supercomputer H Fu, J Liao, W Xue, L Wang, D Chen, L Gu, J Xu, N Ding, X Wang, C He, ... SC'16: Proceedings of the International Conference for High Performance …, 2016 | 43 | 2016 |
Whale: Efficient giant model training over heterogeneous {GPUs} X Jia, L Jiang, A Wang, W Xiao, Z Shi, J Zhang, X Li, L Chen, Y Li, ... 2022 USENIX Annual Technical Conference (USENIX ATC 22), 673-688, 2022 | 39 | 2022 |
Versapipe: a versatile programming framework for pipelined computing on GPU Z Zheng, C Oh, J Zhai, X Shen, Y Yi, W Chen Proceedings of the 50th Annual IEEE/ACM International Symposium on …, 2017 | 38 | 2017 |
Fusionstitching: boosting memory intensive computations for deep learning workloads Z Zheng, P Zhao, G Long, F Zhu, K Zhu, W Zhao, L Diao, J Yang, W Lin arXiv preprint arXiv:2009.10924, 2020 | 29 | 2020 |
DISC: A dynamic shape compiler for machine learning workloads K Zhu, WY Zhao, Z Zheng, TY Guo, PZ Zhao, JJ Bai, J Yang, XY Liu, ... Proceedings of the 1st Workshop on Machine Learning and Systems, 89-95, 2021 | 26 | 2021 |
Optimizing distributed training deployment in heterogeneous GPU clusters X Yi, S Zhang, Z Luo, G Long, L Diao, C Wu, Z Zheng, J Yang, W Lin Proceedings of the 16th International Conference on emerging Networking …, 2020 | 26 | 2020 |
Flash-llm: Enabling cost-effective and highly-efficient large generative model inference with unstructured sparsity H Xia, Z Zheng, Y Li, D Zhuang, Z Zhou, X Qiu, Y Li, W Lin, SL Song arXiv preprint arXiv:2309.10285, 2023 | 21 | 2023 |
Drew: Efficient winograd cnn inference with deep reuse R Wu, F Zhang, J Guan, Z Zheng, X Du, X Shen Proceedings of the ACM Web Conference 2022, 1807-1816, 2022 | 17 | 2022 |
Gopipe: a granularity-oblivious programming framework for pipelined stencil executions on gpu C Oh, Z Zheng, X Shen, J Zhai, Y Yi Proceedings of the ACM International Conference on Parallel Architectures …, 2020 | 13 | 2020 |
Exploring deep reuse in winograd CNN inference R Wu, F Zhang, Z Zheng, X Du, X Shen Proceedings of the 26th ACM SIGPLAN Symposium on Principles and Practice of …, 2021 | 12 | 2021 |
HiWayLib: A software framework for enabling high performance communications for heterogeneous pipeline computations Z Zheng, C Oh, J Zhai, X Shen, Y Yi, W Chen Proceedings of the Twenty-Fourth International Conference on Architectural …, 2019 | 10 | 2019 |
Bladedisc: Optimizing dynamic shape machine learning workloads via compiler approach Z Zheng, Z Pan, D Wang, K Zhu, W Zhao, T Guo, X Qiu, M Sun, J Bai, ... Proceedings of the ACM on Management of Data 1 (3), 1-29, 2023 | 8 | 2023 |
Auto-MAP: A DQN framework for exploring distributed execution plans for DNN workloads S Wang, Y Rong, S Fan, Z Zheng, LS Diao, G Long, J Yang, X Liu, W Lin arXiv preprint arXiv:2007.04069, 2020 | 7 | 2020 |
Fp6-llm: Efficiently serving large language models through fp6-centric algorithm-system co-design H Xia, Z Zheng, X Wu, S Chen, Z Yao, S Youn, A Bakhtiari, M Wyatt, ... arXiv preprint arXiv:2401.14112, 2024 | 6 | 2024 |
Zeroquant(4+2): Redefining llms quantization with a new fp6-centric strategy for diverse generative tasks X Wu, H Xia, S Youn, Z Zheng, S Chen, A Bakhtiari, M Wyatt, Y He, ... arXiv preprint arXiv:2312.08583, 2023 | 4 | 2023 |
Optimizing DNN compilation for distributed training with joint OP and tensor fusion X Yi, S Zhang, L Diao, C Wu, Z Zheng, S Fan, S Wang, J Yang, W Lin IEEE Transactions on Parallel and Distributed Systems 33 (12), 4694-4706, 2022 | 4 | 2022 |
Whale: Scaling deep learning model training to the trillions X Jia, AW Le Jiang, J Zhang, X Li, W Xiao, Y Li, Z Zheng, X Liu, W Lin arXiv preprint arXiv:2011.09208, 2020 | 4 | 2020 |