TY - GEN
T1 - Impacts of Multi-GPU MPI Collective Communications on Large FFT Computation
AU - Ayala, Alan
AU - Tomov, Stanimire
AU - Luo, Xi
AU - Shaeik, Hejer
AU - Haidar, Azzam
AU - Bosilca, George
AU - Dongarra, Jack
N1 - Publisher Copyright:
© 2019 IEEE.
PY - 2019/11
Y1 - 2019/11
N2 - Most applications targeting exascale, such as those part of the Exascale Computing Project (ECP), are designed for heterogeneous architectures and rely on the Message Passing Interface (MPI) as their underlying parallel programming model. In this paper we analyze the limitations of collective MPI communication for the computation of fast Fourier transforms (FFTs), which are relied on heavily for large-scale particle simulations. We present experiments made at one of the largest heterogeneous platforms, the Summit supercomputer at ORNL. We discuss communication models from state-of-the-art FFT libraries, and propose a new FFT library, named HEFFTE (Highly Efficient FFTs for Exascale), which supports heterogeneous architectures and yields considerable speedups compared with CPU libraries, while maintaining good weak as well as strong scalability.
AB - Most applications targeting exascale, such as those part of the Exascale Computing Project (ECP), are designed for heterogeneous architectures and rely on the Message Passing Interface (MPI) as their underlying parallel programming model. In this paper we analyze the limitations of collective MPI communication for the computation of fast Fourier transforms (FFTs), which are relied on heavily for large-scale particle simulations. We present experiments made at one of the largest heterogeneous platforms, the Summit supercomputer at ORNL. We discuss communication models from state-of-the-art FFT libraries, and propose a new FFT library, named HEFFTE (Highly Efficient FFTs for Exascale), which supports heterogeneous architectures and yields considerable speedups compared with CPU libraries, while maintaining good weak as well as strong scalability.
UR - http://www.scopus.com/inward/record.url?scp=85079287951&partnerID=8YFLogxK
U2 - 10.1109/ExaMPI49596.2019.00007
DO - 10.1109/ExaMPI49596.2019.00007
M3 - Conference contribution
AN - SCOPUS:85079287951
T3 - Proceedings of ExaMPI 2019: Workshop on Exascale MPI - Held in conjunction with SC 2019: The International Conference for High Performance Computing, Networking, Storage and Analysis
SP - 12
EP - 18
BT - Proceedings of ExaMPI 2019
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2019 IEEE/ACM Workshop on Exascale MPI, ExaMPI 2019
Y2 - 17 November 2019
ER -