Abstract
Testing is one of the most important steps in software development-it ensures the quality of software. Continuous Integration (CI) is a widely used testing standard that can report software quality to the developer in a timely manner during development progress. Performance, especially scalability, is another key factor for High Performance Computing (HPC) applications. There are many existing profiling and performance tools for HPC applications, but none of these are integrated into CI tools. In this work, we propose BeeSwarm, an HPC container based parallel scaling performance system that can be easily applied to the current CI test environments. BeeSwarm is mainly designed for HPC application developers who need to monitor how their applications can scale on different compute resources. We demonstrate BeeSwarm using a multi-physics HPC application with Travis CI, GitLab CI and GitHub Actions while using ChameleonCloud and Google Compute Engine as the compute backends. Our results show that BeeSwarm can be used for scalability and performance testing of HPC applications.
Original language | English |
---|---|
Title of host publication | Proceedings - 2021 36th IEEE/ACM International Conference on Automated Software Engineering, ASE 2021 |
Publisher | Institute of Electrical and Electronics Engineers Inc. |
Pages | 1136-1140 |
Number of pages | 5 |
ISBN (Electronic) | 9781665403375 |
DOIs | |
State | Published - 2021 |
Event | 36th IEEE/ACM International Conference on Automated Software Engineering, ASE 2021 - Virtual, Online, Australia Duration: Nov 15 2021 → Nov 19 2021 |
Publication series
Name | Proceedings - 2021 36th IEEE/ACM International Conference on Automated Software Engineering, ASE 2021 |
---|
Conference
Conference | 36th IEEE/ACM International Conference on Automated Software Engineering, ASE 2021 |
---|---|
Country/Territory | Australia |
City | Virtual, Online |
Period | 11/15/21 → 11/19/21 |
Funding
This work was supported by the U.S. Department of Energy through the Los Alamos National Laboratory (LA-UR-21-28028). Los Alamos National Laboratory is operated by Triad National Security, LLC, for the National Nuclear Security Administration of U.S. Department of Energy (Contract No. 89233218CNA000001). Results presented in this paper were obtained using the Chameleon Cloud sponsored by the National Science Foundation.
Keywords
- Cloud computing
- Container
- Continuous integration
- High performance computing
- Scalability test