Platform Agnostic Streaming Data Application Performance Models

Clayton J. Faber, Tom Plano, Samatha Kodali, Zhili Xiao, Abhishek Dwaraki, Jeremy D. Buhler, Roger D. Chamberlain, Anthony M. Cabrera

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

The mapping of computational needs onto execution resources is, by and large, a manual task, and users are frequently guided simply by intuition and past experiences. We present a queueing theory based performance model for streaming data applications that takes steps towards a better understanding of resource mapping decisions, thereby assisting application developers to make good mapping choices. The performance model (and associated cost model) are agnostic to the specific properties of the compute resource and application, simply characterizing them by their achievable data throughput. We illustrate the model with a pair of applications, one chosen from the field of computational biology and the second is a classic machine learning problem.

Original languageEnglish
Title of host publicationProceedings of RSDHA 2021
Subtitle of host publicationRedefining Scalability for Diversely Heterogeneous Architectures, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages17-26
Number of pages10
ISBN (Electronic)9781665458771
DOIs
StatePublished - 2021
Event2021 IEEE/ACM Redefining Scalability for Diversely Heterogeneous Architectures, RSDHA 2021 - St. Louis, United States
Duration: Nov 19 2021 → …

Publication series

NameProceedings of RSDHA 2021: Redefining Scalability for Diversely Heterogeneous Architectures, Held in conjunction with SC 2021: The International Conference for High Performance Computing, Networking, Storage and Analysis

Conference

Conference2021 IEEE/ACM Redefining Scalability for Diversely Heterogeneous Architectures, RSDHA 2021
Country/TerritoryUnited States
CitySt. Louis
Period11/19/21 → …

Funding

This manuscript has been co-authored by UT-Battelle,LLC under Contract No. DE-AC05-00OR22725with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan. This research was supported in part by the following sources: National Science Foundation (NSF) under grant CNS-1763503, Defense Advanced Research Projects Agency (DARPA) Microsystems Technology Office (MTO) Domain-Specific System-on-Chip Program, and the US Department of Energy (DOE) Advanced Scientific Computing Research (ASCR) program.

FundersFunder number
UT-Battelle,LLCDE-AC05-00OR22725with
National Science FoundationCNS-1763503
U.S. Department of Energy
Defense Advanced Research Projects Agency
Advanced Scientific Computing Research

    Keywords

    • data transformation
    • fpga
    • gpu

    Fingerprint

    Dive into the research topics of 'Platform Agnostic Streaming Data Application Performance Models'. Together they form a unique fingerprint.

    Cite this