HyPar: Towards Hybrid Parallelism for Deep Learning Accelerator Array

Linghao Song, Jiachen Mao, Youwei Zhuo, Xuehai Qian, Hai Li, Yiran Chen
January, 2019
Cite DOI
Type
Conference paper
Publication
2019 IEEE International Symposium on High Performance Computer Architecture (HPCA)
Parallel Processing Training Data Models Neural Networks Computer Architecture Acceleration Accelerator Architecture Accelerator Array Coarse Grain Parallelism Communication in DNN Training Deep Learning DNN Training Domain Specific Architecture Hybrid Parallelism Intra and Inter Layer Communication Tensor Partition
Youwei Zhuo
Youwei Zhuo
Assistant Professor