Alea – Complex Job Scheduling Simulator

Dalibor Klusáček; Mehmet Soysal; Frédéric Suter

doi:10.1007/978-3-030-43222-5_19

Alea – Complex Job Scheduling Simulator

Dalibor Klusáček
, Mehmet Soysal
, Frédéric Suter

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

14 Scopus citations

Abstract

Using large computer systems such as HPC clusters up to their full potential can be hard. Many problems and inefficiencies relate to the interactions of user workloads and system-level policies. These policies enable various setup choices of the resource management system (RMS) as well as the applied scheduling policy. While expert’s assessment and well known best practices do their job when tuning the performance, there is usually plenty of room for further improvements, e.g., by considering more efficient system setups or even radically new scheduling policies. For such potentially damaging modifications it is very suitable to use some form of a simulator first, which allows for repeated evaluations of various setups in a fully controlled manner. This paper presents the latest improvements and advanced simulation capabilities of the Alea job scheduling simulator that has been actively developed for over 10 years now. We present both recently added advanced simulation capabilities as well as a set of real-life based case studies where Alea has been used to evaluate major modifications of real HPC and HTC systems.

Original language	English
Title of host publication	Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers
Editors	Roman Wyrzykowski, Konrad Karczewski, Ewa Deelman, Jack Dongarra
Publisher	Springer
Pages	217-229
Number of pages	13
ISBN (Print)	9783030432218
DOIs	https://doi.org/10.1007/978-3-030-43222-5_19
State	Published - 2020
Externally published	Yes
Event	13th International Conference on Parallel Processing and Applied Mathematics, PPAM 2019 - Bialystok, Poland Duration: Sep 8 2019 → Sep 11 2019

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	12044 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Conference

Conference	13th International Conference on Parallel Processing and Applied Mathematics, PPAM 2019
Country/Territory	Poland
City	Bialystok
Period	09/8/19 → 09/11/19

Funding

Acknowledgments. We acknowledge the support and computational resources provided by the MetaCentrum under the program LM2015042, and the support provided by the project Reg. No. CZ.02.1.01/0.0/0.0/16 013/0001797 co-funded by the Ministry of Education, Youth and Sports of the Czech Republic.

Keywords

Alea
HPC
HTC
Scheduling
Simulation

Access to Document

10.1007/978-3-030-43222-5_19

Cite this

Klusáček, D., Soysal, M., & Suter, F. (2020). Alea – Complex Job Scheduling Simulator. In R. Wyrzykowski, K. Karczewski, E. Deelman, & J. Dongarra (Eds.), Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers (pp. 217-229). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12044 LNCS). Springer. https://doi.org/10.1007/978-3-030-43222-5_19

Klusáček, Dalibor ; Soysal, Mehmet ; Suter, Frédéric. / Alea – Complex Job Scheduling Simulator. Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers. editor / Roman Wyrzykowski ; Konrad Karczewski ; Ewa Deelman ; Jack Dongarra. Springer, 2020. pp. 217-229 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{7041a1e15e674641aafdd8fae4322f43,

title = "Alea – Complex Job Scheduling Simulator",

abstract = "Using large computer systems such as HPC clusters up to their full potential can be hard. Many problems and inefficiencies relate to the interactions of user workloads and system-level policies. These policies enable various setup choices of the resource management system (RMS) as well as the applied scheduling policy. While expert{\textquoteright}s assessment and well known best practices do their job when tuning the performance, there is usually plenty of room for further improvements, e.g., by considering more efficient system setups or even radically new scheduling policies. For such potentially damaging modifications it is very suitable to use some form of a simulator first, which allows for repeated evaluations of various setups in a fully controlled manner. This paper presents the latest improvements and advanced simulation capabilities of the Alea job scheduling simulator that has been actively developed for over 10 years now. We present both recently added advanced simulation capabilities as well as a set of real-life based case studies where Alea has been used to evaluate major modifications of real HPC and HTC systems.",

keywords = "Alea, HPC, HTC, Scheduling, Simulation",

author = "Dalibor Klus{\'a}{\v c}ek and Mehmet Soysal and Fr{\'e}d{\'e}ric Suter",

note = "Publisher Copyright: {\textcopyright} 2020, Springer Nature Switzerland AG.; 13th International Conference on Parallel Processing and Applied Mathematics, PPAM 2019 ; Conference date: 08-09-2019 Through 11-09-2019",

year = "2020",

doi = "10.1007/978-3-030-43222-5\_19",

language = "English",

isbn = "9783030432218",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer",

pages = "217--229",

editor = "Roman Wyrzykowski and Konrad Karczewski and Ewa Deelman and Jack Dongarra",

booktitle = "Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers",

}

Klusáček, D, Soysal, M & Suter, F 2020, Alea – Complex Job Scheduling Simulator. in R Wyrzykowski, K Karczewski, E Deelman & J Dongarra (eds), Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 12044 LNCS, Springer, pp. 217-229, 13th International Conference on Parallel Processing and Applied Mathematics, PPAM 2019, Bialystok, Poland, 09/8/19. https://doi.org/10.1007/978-3-030-43222-5_19

Alea – Complex Job Scheduling Simulator. / Klusáček, Dalibor; Soysal, Mehmet; Suter, Frédéric.
Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers. ed. / Roman Wyrzykowski; Konrad Karczewski; Ewa Deelman; Jack Dongarra. Springer, 2020. p. 217-229 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 12044 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Alea – Complex Job Scheduling Simulator

AU - Klusáček, Dalibor

AU - Soysal, Mehmet

AU - Suter, Frédéric

PY - 2020

Y1 - 2020

N2 - Using large computer systems such as HPC clusters up to their full potential can be hard. Many problems and inefficiencies relate to the interactions of user workloads and system-level policies. These policies enable various setup choices of the resource management system (RMS) as well as the applied scheduling policy. While expert’s assessment and well known best practices do their job when tuning the performance, there is usually plenty of room for further improvements, e.g., by considering more efficient system setups or even radically new scheduling policies. For such potentially damaging modifications it is very suitable to use some form of a simulator first, which allows for repeated evaluations of various setups in a fully controlled manner. This paper presents the latest improvements and advanced simulation capabilities of the Alea job scheduling simulator that has been actively developed for over 10 years now. We present both recently added advanced simulation capabilities as well as a set of real-life based case studies where Alea has been used to evaluate major modifications of real HPC and HTC systems.

AB - Using large computer systems such as HPC clusters up to their full potential can be hard. Many problems and inefficiencies relate to the interactions of user workloads and system-level policies. These policies enable various setup choices of the resource management system (RMS) as well as the applied scheduling policy. While expert’s assessment and well known best practices do their job when tuning the performance, there is usually plenty of room for further improvements, e.g., by considering more efficient system setups or even radically new scheduling policies. For such potentially damaging modifications it is very suitable to use some form of a simulator first, which allows for repeated evaluations of various setups in a fully controlled manner. This paper presents the latest improvements and advanced simulation capabilities of the Alea job scheduling simulator that has been actively developed for over 10 years now. We present both recently added advanced simulation capabilities as well as a set of real-life based case studies where Alea has been used to evaluate major modifications of real HPC and HTC systems.

KW - Alea

KW - HPC

KW - HTC

KW - Scheduling

KW - Simulation

UR - https://www.scopus.com/pages/publications/85083974500

U2 - 10.1007/978-3-030-43222-5_19

DO - 10.1007/978-3-030-43222-5_19

M3 - Conference contribution

AN - SCOPUS:85083974500

SN - 9783030432218

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 217

EP - 229

BT - Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers

A2 - Wyrzykowski, Roman

A2 - Karczewski, Konrad

A2 - Deelman, Ewa

A2 - Dongarra, Jack

PB - Springer

T2 - 13th International Conference on Parallel Processing and Applied Mathematics, PPAM 2019

Y2 - 8 September 2019 through 11 September 2019

ER -

Klusáček D, Soysal M, Suter F. Alea – Complex Job Scheduling Simulator. In Wyrzykowski R, Karczewski K, Deelman E, Dongarra J, editors, Parallel Processing and Applied Mathematics - 13th International Conference, PPAM 2019, Revised Selected Papers. Springer. 2020. p. 217-229. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-43222-5_19

Alea – Complex Job Scheduling Simulator

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this