MRNet: A software-based multicast/reduction network for scalable tools

Philip C. Roth, Dorian C. Arnold, Barton P. Miller

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

135 Scopus citations

Abstract

We present MRNet, a software-based multicast/reduction network for building scalable performance and system administration tools. MRNet supports multiple simultaneous, asynchronous collective communication operations. MRNet is flexible, allowing tool builders to tailor its process network topology to suit their tool's requirements and the underlying system's capabilities. MRNet is extensible, allowing tool builders to incorporate custom data reductions to augment its collection of built-in reductions. We evaluated MRNet in a simple test tool and also integrated into an existing, real-world performance tool with up to 512 tool back-ends. In the real-world tool, we used MRNet not only for multicast and simple data reductions but also with custom histogram and clock skew detection reductions. In our experiments, the MRNet-based tools showed significantly better performance than the tools without MRNet for average message latency and throughput, overall tool start-up latency, and performance data processing throughput.

Original languageEnglish
Title of host publicationProceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003
DOIs
StatePublished - 2003
Externally publishedYes
Event2003 ACM/IEEE Conference on Supercomputing, SC 2003 - Phoenix, AZ, United States
Duration: Nov 15 2003Nov 21 2003

Publication series

NameProceedings of the 2003 ACM/IEEE Conference on Supercomputing, SC 2003

Conference

Conference2003 ACM/IEEE Conference on Supercomputing, SC 2003
Country/TerritoryUnited States
CityPhoenix, AZ
Period11/15/0311/21/03

Keywords

  • Scalability
  • aggregation
  • multicast
  • reduction
  • tools

Fingerprint

Dive into the research topics of 'MRNet: A software-based multicast/reduction network for scalable tools'. Together they form a unique fingerprint.

Cite this