MAPredict: Static Analysis Driven Memory Access Prediction Framework for Modern CPUs

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

2 Scopus citations

Abstract

Application memory access patterns are crucial in deciding how much traffic is served by the cache and forwarded to the dynamic random-access memory (DRAM). However, predicting such memory traffic is difficult because of the interplay of prefetchers, compilers, parallel execution, and innovations in manufacturer-specific micro-architectures. This research introduced MAPredict, a static analysis-driven framework that addresses these challenges to predict last-level cache (LLC)-DRAM traffic. By exploring and analyzing the behavior of modern Intel processors, MAPredict formulates cache-aware analytical models. MAPredict invokes these models to predict LLC-DRAM traffic by combining the application model, machine model, and user-provided hints to capture dynamic information. MAPredict successfully predicts LLC-DRAM traffic for different regular access patterns and provides the means to combine static and empirical observations for irregular access patterns. Evaluating 130 workloads from six applications on recent Intel micro-architectures, MAPredict yielded an average accuracy of 99% for streaming, 91% for strided, and 92% for stencil patterns. By coupling static and empirical methods, up to 97% average accuracy was obtained for random access patterns on different micro-architectures.

Original languageEnglish
Title of host publicationHigh Performance Computing - 37th International Conference, ISC High Performance 2022, Proceedings
EditorsAna-Lucia Varbanescu, Abhinav Bhatele, Piotr Luszczek, Baboulin Marc
PublisherSpringer Science and Business Media Deutschland GmbH
Pages233-255
Number of pages23
ISBN (Print)9783031073113
DOIs
StatePublished - 2022
Event37th International Conference on High Performance Computing, ISC High Performance 2022 - Hamburg, Germany
Duration: May 29 2022Jun 2 2022

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume13289 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference37th International Conference on High Performance Computing, ISC High Performance 2022
Country/TerritoryGermany
CityHamburg
Period05/29/2206/2/22

Funding

This research used resources of the Experimental Computing Laboratory at Oak Ridge National Laboratory, which are supported by the US Department of Energy’s Office of Science under contract no. DE-AC05-00OR22725. This research was supported by (1) the US Department of Defense, Brisbane: Productive Programming Systems in the Era of Extremely Heterogeneous and Ephemeral Computer Architectures and (2) DOE Office of Science, Office of Advanced Scientific Computing Research, Scientific Discovery through Advanced Computing (SciDAC) program.

FundersFunder number
U.S. Department of Defense
U.S. Department of Energy
Office of ScienceDE-AC05-00OR22725
Advanced Scientific Computing Research

    Fingerprint

    Dive into the research topics of 'MAPredict: Static Analysis Driven Memory Access Prediction Framework for Modern CPUs'. Together they form a unique fingerprint.

    Cite this