Asserting performance expectations

Jeffrey S. Vetter; Patrick H. Worley

doi:10.1109/SC.2002.10046

Asserting performance expectations

Jeffrey S. Vetter, Patrick H. Worley

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

25 Scopus citations

Abstract

Traditional techniques for performance analysis provide a means for extracting and analyzing raw performance information from applications. Users then compare this raw data to their performance expectations for application constructs. This comparison can be tedious for the scale of today's architectures and software systems. To address this situation, we present a methodology and prototype that allows users to assert performance expectations explicitly in their source code using performance assertions. As the application executes, each performance assertion in the application collects data implicitly to verify the assertion. By allowing the user to specify a performance expectation with individual code segments, the runtime system can jettison raw data for measurements that pass their expectation, while reacting to failures with a variety of responses. We present several compelling uses of performance assertions with our operational prototype, including raising a performance exception, validating a performance model, and adapting an algorithm empirically at runtime.

Original language	English
Title of host publication	Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002
Publisher	Association for Computing Machinery
ISBN (Electronic)	076951524X
DOIs	https://doi.org/10.1109/SC.2002.10046
State	Published - 2002
Externally published	Yes
Event	2002 IEEE/ACM Conference on Supercomputing, SC 2002 - Baltimore, United States Duration: Nov 16 2002 → Nov 22 2002

Publication series

Name	Proceedings of the International Conference on Supercomputing
Volume	2002-November

Conference

Conference	2002 IEEE/ACM Conference on Supercomputing, SC 2002
Country/Territory	United States
City	Baltimore
Period	11/16/02 → 11/22/02

Funding

The work of Dr. Vetter was performed under the auspices of the U.S. Department of Energy by the University of California, Lawrence Livermore National Laboratory under contract No. W-7405-Eng-48. The work of Dr. Worley was sponsored by the Office of Mathematical, Information, and Computational Sciences, Office of Science, U.S. Department of Energy sponsored this research under Contract No DE-AC05-00OR22725 with UT-Batelle, LLC. Accordingly, the U.S. Government retains a nonexclusive, royalty-free license to publish or reproduce the published form of this contribution, or allow others to do so, for U.S. Government purposes. This paper is available as LLNL Technical Report UCRL-JC-145028.

Funders	Funder number
U.S. Department of Energy
University of California
Office of Science	DE-AC05-00OR22725, UCRL-JC-145028
Lawrence Livermore National Laboratory	W-7405-Eng-48

Access to Document

10.1109/SC.2002.10046

Cite this

@inproceedings{cada7b45ecd44a95b4dd07a17a3dd79d,

title = "Asserting performance expectations",

abstract = "Traditional techniques for performance analysis provide a means for extracting and analyzing raw performance information from applications. Users then compare this raw data to their performance expectations for application constructs. This comparison can be tedious for the scale of today's architectures and software systems. To address this situation, we present a methodology and prototype that allows users to assert performance expectations explicitly in their source code using performance assertions. As the application executes, each performance assertion in the application collects data implicitly to verify the assertion. By allowing the user to specify a performance expectation with individual code segments, the runtime system can jettison raw data for measurements that pass their expectation, while reacting to failures with a variety of responses. We present several compelling uses of performance assertions with our operational prototype, including raising a performance exception, validating a performance model, and adapting an algorithm empirically at runtime.",

author = "Vetter, {Jeffrey S.} and Worley, {Patrick H.}",

note = "Publisher Copyright: {\textcopyright} 2002 IEEE.; 2002 IEEE/ACM Conference on Supercomputing, SC 2002 ; Conference date: 16-11-2002 Through 22-11-2002",

year = "2002",

doi = "10.1109/SC.2002.10046",

language = "English",

series = "Proceedings of the International Conference on Supercomputing",

publisher = "Association for Computing Machinery",

booktitle = "Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002",

}

Vetter, JS & Worley, PH 2002, Asserting performance expectations. in Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002. Proceedings of the International Conference on Supercomputing, vol. 2002-November, Association for Computing Machinery, 2002 IEEE/ACM Conference on Supercomputing, SC 2002, Baltimore, United States, 11/16/02. https://doi.org/10.1109/SC.2002.10046

TY - GEN

T1 - Asserting performance expectations

AU - Vetter, Jeffrey S.

AU - Worley, Patrick H.

PY - 2002

Y1 - 2002

N2 - Traditional techniques for performance analysis provide a means for extracting and analyzing raw performance information from applications. Users then compare this raw data to their performance expectations for application constructs. This comparison can be tedious for the scale of today's architectures and software systems. To address this situation, we present a methodology and prototype that allows users to assert performance expectations explicitly in their source code using performance assertions. As the application executes, each performance assertion in the application collects data implicitly to verify the assertion. By allowing the user to specify a performance expectation with individual code segments, the runtime system can jettison raw data for measurements that pass their expectation, while reacting to failures with a variety of responses. We present several compelling uses of performance assertions with our operational prototype, including raising a performance exception, validating a performance model, and adapting an algorithm empirically at runtime.

AB - Traditional techniques for performance analysis provide a means for extracting and analyzing raw performance information from applications. Users then compare this raw data to their performance expectations for application constructs. This comparison can be tedious for the scale of today's architectures and software systems. To address this situation, we present a methodology and prototype that allows users to assert performance expectations explicitly in their source code using performance assertions. As the application executes, each performance assertion in the application collects data implicitly to verify the assertion. By allowing the user to specify a performance expectation with individual code segments, the runtime system can jettison raw data for measurements that pass their expectation, while reacting to failures with a variety of responses. We present several compelling uses of performance assertions with our operational prototype, including raising a performance exception, validating a performance model, and adapting an algorithm empirically at runtime.

UR - http://www.scopus.com/inward/record.url?scp=38049154874&partnerID=8YFLogxK

U2 - 10.1109/SC.2002.10046

DO - 10.1109/SC.2002.10046

M3 - Conference contribution

AN - SCOPUS:38049154874

T3 - Proceedings of the International Conference on Supercomputing

BT - Proceedings of the IEEE/ACM SC 2002 Conference, SC 2002

PB - Association for Computing Machinery

T2 - 2002 IEEE/ACM Conference on Supercomputing, SC 2002

Y2 - 16 November 2002 through 22 November 2002

ER -

Asserting performance expectations

Abstract

Publication series

Conference

Funding

Access to Document

Other files and links

Fingerprint

Cite this