Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI

Joshua Davis; Tao Gao; Sunita Chandrasekaran; Heike Jagode; Anthony Danalis; Jack Dongarra; Pavan Balaji; Michela Taufer

doi:10.3233/APC200053

Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI

Joshua Davis, Tao Gao, Sunita Chandrasekaran, Heike Jagode, Anthony Danalis, Jack Dongarra, Pavan Balaji, Michela Taufer

Computer Science and Mathematics Div

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

This paper presents a quantitative evaluation of the power usage over time in data-intensive applications that use MapReduce over MPI. We leverage the PAPI powercap tool to identify ideal conditions for execution of our mini-applications in terms of (1) dataset characteristics (e.g., unique words in datasets); (2) system characteristics (e.g., KNL and KNM); and (3) implementation of the MapReduce programming model (e.g., impact of various optimizations). Results illustrate the high power utilization and runtime costs of data management on HPC architectures.

Original language	English
Title of host publication	Parallel Computing
Subtitle of host publication	Technology Trends
Editors	Ian Foster, Gerhard R. Joubert, Ludek Kucera, Wolfgang E. Nagel, Frans Peters
Publisher	IOS Press BV
Pages	287-298
Number of pages	12
ISBN (Electronic)	9781643680705
DOIs	https://doi.org/10.3233/APC200053
State	Published - 2020

Publication series

Name	Advances in Parallel Computing
Volume	36
ISSN (Print)	0927-5452
ISSN (Electronic)	1879-808X

Funding

This work was supported by NSF CCF 1841758. This work was supported by NSF CCF 1841758

Keywords

Combiner optimizations
Data management
KNL
KNM
PAPI

Access to Document

10.3233/APC200053

Cite this

Davis, J., Gao, T., Chandrasekaran, S., Jagode, H., Danalis, A., Dongarra, J., Balaji, P., & Taufer, M. (2020). Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI. In I. Foster, G. R. Joubert, L. Kucera, W. E. Nagel, & F. Peters (Eds.), Parallel Computing: Technology Trends (pp. 287-298). (Advances in Parallel Computing; Vol. 36). IOS Press BV. https://doi.org/10.3233/APC200053

@inproceedings{4ca29bb298d14e94b51b5adb7c82ee99,

title = "Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI",

abstract = "This paper presents a quantitative evaluation of the power usage over time in data-intensive applications that use MapReduce over MPI. We leverage the PAPI powercap tool to identify ideal conditions for execution of our mini-applications in terms of (1) dataset characteristics (e.g., unique words in datasets); (2) system characteristics (e.g., KNL and KNM); and (3) implementation of the MapReduce programming model (e.g., impact of various optimizations). Results illustrate the high power utilization and runtime costs of data management on HPC architectures.",

keywords = "Combiner optimizations, Data management, KNL, KNM, PAPI",

author = "Joshua Davis and Tao Gao and Sunita Chandrasekaran and Heike Jagode and Anthony Danalis and Jack Dongarra and Pavan Balaji and Michela Taufer",

note = "Publisher Copyright: {\textcopyright} 2020 The authors and IOS Press.",

year = "2020",

doi = "10.3233/APC200053",

language = "English",

series = "Advances in Parallel Computing",

publisher = "IOS Press BV",

pages = "287--298",

editor = "Ian Foster and Joubert, {Gerhard R.} and Ludek Kucera and Nagel, {Wolfgang E.} and Frans Peters",

booktitle = "Parallel Computing",

}

Davis, J, Gao, T, Chandrasekaran, S, Jagode, H, Danalis, A, Dongarra, J, Balaji, P & Taufer, M 2020, Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI. in I Foster, GR Joubert, L Kucera, WE Nagel & F Peters (eds), Parallel Computing: Technology Trends. Advances in Parallel Computing, vol. 36, IOS Press BV, pp. 287-298. https://doi.org/10.3233/APC200053

Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI. / Davis, Joshua; Gao, Tao; Chandrasekaran, Sunita et al.
Parallel Computing: Technology Trends. ed. / Ian Foster; Gerhard R. Joubert; Ludek Kucera; Wolfgang E. Nagel; Frans Peters. IOS Press BV, 2020. p. 287-298 (Advances in Parallel Computing; Vol. 36).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI

AU - Davis, Joshua

AU - Gao, Tao

AU - Chandrasekaran, Sunita

AU - Jagode, Heike

AU - Danalis, Anthony

AU - Dongarra, Jack

AU - Balaji, Pavan

AU - Taufer, Michela

PY - 2020

Y1 - 2020

N2 - This paper presents a quantitative evaluation of the power usage over time in data-intensive applications that use MapReduce over MPI. We leverage the PAPI powercap tool to identify ideal conditions for execution of our mini-applications in terms of (1) dataset characteristics (e.g., unique words in datasets); (2) system characteristics (e.g., KNL and KNM); and (3) implementation of the MapReduce programming model (e.g., impact of various optimizations). Results illustrate the high power utilization and runtime costs of data management on HPC architectures.

AB - This paper presents a quantitative evaluation of the power usage over time in data-intensive applications that use MapReduce over MPI. We leverage the PAPI powercap tool to identify ideal conditions for execution of our mini-applications in terms of (1) dataset characteristics (e.g., unique words in datasets); (2) system characteristics (e.g., KNL and KNM); and (3) implementation of the MapReduce programming model (e.g., impact of various optimizations). Results illustrate the high power utilization and runtime costs of data management on HPC architectures.

KW - Combiner optimizations

KW - Data management

KW - KNL

KW - KNM

KW - PAPI

UR - http://www.scopus.com/inward/record.url?scp=85083067692&partnerID=8YFLogxK

U2 - 10.3233/APC200053

DO - 10.3233/APC200053

M3 - Conference contribution

AN - SCOPUS:85083067692

T3 - Advances in Parallel Computing

SP - 287

EP - 298

BT - Parallel Computing

A2 - Foster, Ian

A2 - Joubert, Gerhard R.

A2 - Kucera, Ludek

A2 - Nagel, Wolfgang E.

A2 - Peters, Frans

PB - IOS Press BV

ER -

Characterization of power usage and performance in data-intensive applications sing MapReduce over MPI

Abstract

Publication series

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this