TY - GEN
T1 - Serverless Workflow Benchmarking with HSMFlow and WfBench
AU - Da Silva, Anderson Andrei
AU - Coleman, Tainã
AU - Da Silva, Rafael Ferreira
AU - Suter, Frédéric
AU - Rattihalli, Gourav
AU - Thurimella, Vijay
N1 - Publisher Copyright:
© 2025 Copyright held by the owner/author(s).
PY - 2025/12/14
Y1 - 2025/12/14
N2 - The convergence of edge computing, big data analytics, and artificial intelligence (AI) with traditional scientific calculations is increasingly being adopted in high-performance computing (HPC) workflows. Workflow management systems are crucial for managing and orchestrating these complex computational tasks. However, it is difficult to identify patterns within the growing population of HPC workflows. Moreover, serverless has emerged as a novel computing paradigm, offering dynamic resource allocation, quick response time, fine-grained resource management and auto-scaling. In this tutorial, we present a framework to evaluate serverless executions of HPC scientific workflows. Our approach integrates a widely used traditional HPC workflow generator with an HPC serverless workflow management system to create benchmark suites of scientific workflows with diverse characteristics.
AB - The convergence of edge computing, big data analytics, and artificial intelligence (AI) with traditional scientific calculations is increasingly being adopted in high-performance computing (HPC) workflows. Workflow management systems are crucial for managing and orchestrating these complex computational tasks. However, it is difficult to identify patterns within the growing population of HPC workflows. Moreover, serverless has emerged as a novel computing paradigm, offering dynamic resource allocation, quick response time, fine-grained resource management and auto-scaling. In this tutorial, we present a framework to evaluate serverless executions of HPC scientific workflows. Our approach integrates a widely used traditional HPC workflow generator with an HPC serverless workflow management system to create benchmark suites of scientific workflows with diverse characteristics.
UR - https://www.scopus.com/pages/publications/105026158430
U2 - 10.1145/3776592.3777488
DO - 10.1145/3776592.3777488
M3 - Conference contribution
AN - SCOPUS:105026158430
T3 - MIDDLEWARE Tutorials 2025 - Proceedings of the 2025 International Middleware Conference Tutorial Track, Part of Middleware 2025
SP - 3
EP - 6
BT - MIDDLEWARE Tutorials 2025 - Proceedings of the 2025 International Middleware Conference Tutorial Track, Part of Middleware 2025
PB - Association for Computing Machinery, Inc
T2 - 2025 International Middleware Conference Tutorial Track, Middleware Tutorials 2025
Y2 - 15 December 2025 through 19 December 2025
ER -