A case study of MPI over long distance connections

Nageswara S.V. Rao; Neena Imam; Swen Boehm

doi:10.1109/SYSCON.2019.8836721

A case study of MPI over long distance connections

Nageswara S.V. Rao, Neena Imam, Swen Boehm

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP's loss recovery process.

Original language	English
Title of host publication	SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9781538683965
DOIs	https://doi.org/10.1109/SYSCON.2019.8836721
State	Published - Apr 2019
Event	13th Annual IEEE International Systems Conference, SysCon 2019 - Orlando, United States Duration: Apr 8 2019 → Apr 11 2019

Publication series

Name	SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings

Conference

Conference	13th Annual IEEE International Systems Conference, SysCon 2019
Country/Territory	United States
City	Orlando
Period	04/8/19 → 04/11/19

Funding

This work is funded by the Mathematics of Complex, Distributed, Interconnected Systems Program, Office of Advanced Computing Research, U.S. Department of Energy, and by Extreme Scale Systems Center, sponsored by U. S. Department of Defense, and performed at Oak Ridge National Laboratory managed by UT-Battelle, LLC for U.S. Department of Energy under Contract No. DE-AC05-00OR22725.

Funders	Funder number
Extreme Scale Systems Center
Office of Advanced Computing Research
U. S. Department of Defense
UT-Battelle	DE-AC05-00OR22725
U.S. Department of Defense
U.S. Department of Energy
Advanced Scientific Computing Research
Oak Ridge National Laboratory

Keywords

Execution time
MPI
Network measurements
Wide-area networks

Access to Document

10.1109/SYSCON.2019.8836721

Cite this

Rao, N. S. V., Imam, N., & Boehm, S. (2019). A case study of MPI over long distance connections. In SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings Article 8836721 (SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SYSCON.2019.8836721

@inproceedings{ca4edf86c1eb419f8c20ba7eb5347d84,

title = "A case study of MPI over long distance connections",

abstract = "Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP's loss recovery process.",

keywords = "Execution time, MPI, Network measurements, Wide-area networks",

author = "Rao, {Nageswara S.V.} and Neena Imam and Swen Boehm",

note = "Publisher Copyright: {\textcopyright} 2019 IEEE.; 13th Annual IEEE International Systems Conference, SysCon 2019 ; Conference date: 08-04-2019 Through 11-04-2019",

year = "2019",

month = apr,

doi = "10.1109/SYSCON.2019.8836721",

language = "English",

series = "SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings",

}

Rao, NSV, Imam, N & Boehm, S 2019, A case study of MPI over long distance connections. in SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings., 8836721, SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings, Institute of Electrical and Electronics Engineers Inc., 13th Annual IEEE International Systems Conference, SysCon 2019, Orlando, United States, 04/8/19. https://doi.org/10.1109/SYSCON.2019.8836721

A case study of MPI over long distance connections. / Rao, Nageswara S.V.; Imam, Neena; Boehm, Swen.
SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8836721 (SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - A case study of MPI over long distance connections

AU - Rao, Nageswara S.V.

AU - Imam, Neena

AU - Boehm, Swen

PY - 2019/4

Y1 - 2019/4

N2 - Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP's loss recovery process.

AB - Scientific workflows are increasingly being distributed across wide-area networks, and their code executions are expected to span across geographically dispersed computing systems. MPI has been extensively used to support communications for distributed computations, typically, over compute clusters and high-performance systems within a single facility. We present a case study of performance of MPI basic operations over long distance connections, wherein TCP is used for the underlying transport. We present measurements of execution times of MPI codes that utilize MPI Sendrecv operations over emulated 10Gbps connections with 0-366ms round-trip times, including the longest one spanning the globe. They demonstrate that basic MPI codes can be sustained over long distance connections under external packet loss rates up to 10%. They also highlight the qualitative effects of losses which manifest as increased execution times as a consequence of TCP's loss recovery process.

KW - Execution time

KW - MPI

KW - Network measurements

KW - Wide-area networks

UR - http://www.scopus.com/inward/record.url?scp=85073150685&partnerID=8YFLogxK

U2 - 10.1109/SYSCON.2019.8836721

DO - 10.1109/SYSCON.2019.8836721

M3 - Conference contribution

AN - SCOPUS:85073150685

T3 - SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings

BT - SysCon 2019 - 13th Annual IEEE International Systems Conference, Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 13th Annual IEEE International Systems Conference, SysCon 2019

Y2 - 8 April 2019 through 11 April 2019

ER -

A case study of MPI over long distance connections

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this