SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework

Peter Schwartz; Dali Wang; Fengming Yuan; Peter Thornton

doi:10.1109/WACCPD56842.2022.00010

SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework

Peter Schwartz, Dali Wang, Fengming Yuan, Peter Thornton

Environmental Sciences Division

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

4 Scopus citations

Abstract

Most high-end computers adopt hybrid architecture, porting a large-scale scientific code onto accelerators is necessary. The paper presents a generic method for porting large-scale scientific code onto accelerators using compiler directives within a modularized function unit test platform. We have implemented the method and designed a software tool (SPEL) to port the E3SM Land Model (ELM) onto the GPUs in the Summit computer. SPEL automatically generates GPU-ready test modules for all ELM functions, such as CanopyFlux, SoilTemperature, and EcosystemDynamics. SPEL breaks the ELM into a collection of standalone unit test programs for easy code verification and further performance improvement. We further optimize several ELM test modules with advanced techniques, including memory reduction, reconstructed parallel loops, and asynchronous GPU kernel launch. We hope our study will inspire new toolkit developments that expedite large-scale scientific code porting with compiler directives.

Original language	English
Title of host publication	Proceedings of WACCPD 2022
Subtitle of host publication	9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	43-51
Number of pages	9
ISBN (Electronic)	9781665490191
DOIs	https://doi.org/10.1109/WACCPD56842.2022.00010
State	Published - 2022
Event	9th Workshop on Accelerator Programming Using Directives, WACCPD 2022 - Dallas, United States Duration: Nov 13 2022 → Nov 18 2022

Publication series

Name	Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference	9th Workshop on Accelerator Programming Using Directives, WACCPD 2022
Country/Territory	United States
City	Dallas
Period	11/13/22 → 11/18/22

Funding

This research was supported as part of the Energy Exascale Earth System Model (E3SM) project, funded by the U.S. Department of Energy, Office of Science, Office of Biological and Environmental Research. This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725. * These authors contributed equally. † Corresponding author

Funders	Funder number
U.S. Department of Energy
Office of Science
Biological and Environmental Research	DE-AC05-00OR22725

Keywords

Compiler Directive
Earth System Model
Function Unit Testing
OpenACC

Access to Document

10.1109/WACCPD56842.2022.00010

Cite this

Schwartz, P., Wang, D., Yuan, F., & Thornton, P. (2022). SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework. In Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis (pp. 43-51). (Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/WACCPD56842.2022.00010

Schwartz, Peter ; Wang, Dali ; Yuan, Fengming et al. / SPEL : Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework. Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 43-51 (Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis).

@inproceedings{87921d9f60fe4df8a8dd5a365addf256,

title = "SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework",

abstract = "Most high-end computers adopt hybrid architecture, porting a large-scale scientific code onto accelerators is necessary. The paper presents a generic method for porting large-scale scientific code onto accelerators using compiler directives within a modularized function unit test platform. We have implemented the method and designed a software tool (SPEL) to port the E3SM Land Model (ELM) onto the GPUs in the Summit computer. SPEL automatically generates GPU-ready test modules for all ELM functions, such as CanopyFlux, SoilTemperature, and EcosystemDynamics. SPEL breaks the ELM into a collection of standalone unit test programs for easy code verification and further performance improvement. We further optimize several ELM test modules with advanced techniques, including memory reduction, reconstructed parallel loops, and asynchronous GPU kernel launch. We hope our study will inspire new toolkit developments that expedite large-scale scientific code porting with compiler directives.",

keywords = "Compiler Directive, Earth System Model, Function Unit Testing, OpenACC",

author = "Peter Schwartz and Dali Wang and Fengming Yuan and Peter Thornton",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 9th Workshop on Accelerator Programming Using Directives, WACCPD 2022 ; Conference date: 13-11-2022 Through 18-11-2022",

year = "2022",

doi = "10.1109/WACCPD56842.2022.00010",

language = "English",

series = "Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "43--51",

booktitle = "Proceedings of WACCPD 2022",

}

Schwartz, P, Wang, D, Yuan, F & Thornton, P 2022, SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework. in Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis. Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis, Institute of Electrical and Electronics Engineers Inc., pp. 43-51, 9th Workshop on Accelerator Programming Using Directives, WACCPD 2022, Dallas, United States, 11/13/22. https://doi.org/10.1109/WACCPD56842.2022.00010

SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework. / Schwartz, Peter; Wang, Dali; Yuan, Fengming et al.
Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc., 2022. p. 43-51 (Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - SPEL

T2 - 9th Workshop on Accelerator Programming Using Directives, WACCPD 2022

AU - Schwartz, Peter

AU - Wang, Dali

AU - Yuan, Fengming

AU - Thornton, Peter

PY - 2022

Y1 - 2022

N2 - Most high-end computers adopt hybrid architecture, porting a large-scale scientific code onto accelerators is necessary. The paper presents a generic method for porting large-scale scientific code onto accelerators using compiler directives within a modularized function unit test platform. We have implemented the method and designed a software tool (SPEL) to port the E3SM Land Model (ELM) onto the GPUs in the Summit computer. SPEL automatically generates GPU-ready test modules for all ELM functions, such as CanopyFlux, SoilTemperature, and EcosystemDynamics. SPEL breaks the ELM into a collection of standalone unit test programs for easy code verification and further performance improvement. We further optimize several ELM test modules with advanced techniques, including memory reduction, reconstructed parallel loops, and asynchronous GPU kernel launch. We hope our study will inspire new toolkit developments that expedite large-scale scientific code porting with compiler directives.

AB - Most high-end computers adopt hybrid architecture, porting a large-scale scientific code onto accelerators is necessary. The paper presents a generic method for porting large-scale scientific code onto accelerators using compiler directives within a modularized function unit test platform. We have implemented the method and designed a software tool (SPEL) to port the E3SM Land Model (ELM) onto the GPUs in the Summit computer. SPEL automatically generates GPU-ready test modules for all ELM functions, such as CanopyFlux, SoilTemperature, and EcosystemDynamics. SPEL breaks the ELM into a collection of standalone unit test programs for easy code verification and further performance improvement. We further optimize several ELM test modules with advanced techniques, including memory reduction, reconstructed parallel loops, and asynchronous GPU kernel launch. We hope our study will inspire new toolkit developments that expedite large-scale scientific code porting with compiler directives.

KW - Compiler Directive

KW - Earth System Model

KW - Function Unit Testing

KW - OpenACC

UR - http://www.scopus.com/inward/record.url?scp=85147957048&partnerID=8YFLogxK

U2 - 10.1109/WACCPD56842.2022.00010

DO - 10.1109/WACCPD56842.2022.00010

M3 - Conference contribution

AN - SCOPUS:85147957048

T3 - Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis

SP - 43

EP - 51

BT - Proceedings of WACCPD 2022

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 13 November 2022 through 18 November 2022

ER -

Schwartz P, Wang D, Yuan F, Thornton P. SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework. In Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis. Institute of Electrical and Electronics Engineers Inc. 2022. p. 43-51. (Proceedings of WACCPD 2022: 9th Workshop on Accelerator Programming Using Directives, Held in conjunction with SC 2022: The International Conference for High Performance Computing, Networking, Storage and Analysis). doi: 10.1109/WACCPD56842.2022.00010

SPEL: Software tool for Porting E3SM Land Model with OpenACC in a Function Unit Test Framework

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this