Evaluating the Performance of Integer Sum Reduction on an Intel GPU

Zheming Jin; Jeffrey Vetter

doi:10.1109/IPDPSW52791.2021.00099

Evaluating the Performance of Integer Sum Reduction on an Intel GPU

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Sum reduction is a primitive operation in parallel computing while SYCL is a promising heterogeneous programming language. In this paper, we describe the SYCL implementations of integer sum reduction using atomic functions, shared local memory, vectorized memory accesses, and parameterized workload sizes. Evaluating the reduction kernels shows that we can achieve 1.4X speedup over the open-source implementations of sum reduction for a sufficiently large number of integers on an Intel integrated GPU.

Original language	English
Title of host publication	2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	652-655
Number of pages	4
ISBN (Electronic)	9781665435772
DOIs	https://doi.org/10.1109/IPDPSW52791.2021.00099
State	Published - Jun 2021
Event	2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - Virtual, Portland, United States Duration: May 17 2021 → …

Publication series

Name	2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021

Conference

Conference	2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021
Country/Territory	United States
City	Virtual, Portland
Period	05/17/21 → …

Funding

ACKNOWLEDGMENT We sincerely appreciate the reviewers’ constructive criticism. This research was supported by the US Department of Energy Advanced Scientific Computing Research program under Contract No. DE-AC05-00OR22725. The results presented were obtained using the Intel DevCloud. This manuscript has been authored by UT-Battelle, LLC, under contract DE-AC05-00OR22725 with the US Department of Energy (DOE). The US government retains and the publisher, by accepting the article for publication, acknowledges that the US government retains a nonexclusive, paid-up, irrevocable, worldwide license to publish or reproduce the published form of this manuscript, or allow others to do so, for US government purposes. DOE will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan (http://energy.gov/downloads/doe-public-access-plan).

Keywords

GPU
Reduction
SYCL

Access to Document

10.1109/IPDPSW52791.2021.00099

Cite this

Jin, Z., & Vetter, J. (2021). Evaluating the Performance of Integer Sum Reduction on an Intel GPU. In 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021 (pp. 652-655). Article 9460583 (2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IPDPSW52791.2021.00099

Jin, Zheming ; Vetter, Jeffrey. / Evaluating the Performance of Integer Sum Reduction on an Intel GPU. 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021. Institute of Electrical and Electronics Engineers Inc., 2021. pp. 652-655 (2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021).

@inproceedings{3d143686424e400394b5e0730cd56f1e,

title = "Evaluating the Performance of Integer Sum Reduction on an Intel GPU",

abstract = "Sum reduction is a primitive operation in parallel computing while SYCL is a promising heterogeneous programming language. In this paper, we describe the SYCL implementations of integer sum reduction using atomic functions, shared local memory, vectorized memory accesses, and parameterized workload sizes. Evaluating the reduction kernels shows that we can achieve 1.4X speedup over the open-source implementations of sum reduction for a sufficiently large number of integers on an Intel integrated GPU.",

keywords = "GPU, Reduction, SYCL",

author = "Zheming Jin and Jeffrey Vetter",

note = "Publisher Copyright: {\textcopyright} 2021 IEEE.; 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 ; Conference date: 17-05-2021",

year = "2021",

month = jun,

doi = "10.1109/IPDPSW52791.2021.00099",

language = "English",

series = "2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "652--655",

booktitle = "2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021",

}

Jin, Z & Vetter, J 2021, Evaluating the Performance of Integer Sum Reduction on an Intel GPU. in 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021., 9460583, 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021, Institute of Electrical and Electronics Engineers Inc., pp. 652-655, 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021, Virtual, Portland, United States, 05/17/21. https://doi.org/10.1109/IPDPSW52791.2021.00099

Evaluating the Performance of Integer Sum Reduction on an Intel GPU. / Jin, Zheming; Vetter, Jeffrey.
2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021. Institute of Electrical and Electronics Engineers Inc., 2021. p. 652-655 9460583 (2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - Evaluating the Performance of Integer Sum Reduction on an Intel GPU

AU - Jin, Zheming

AU - Vetter, Jeffrey

PY - 2021/6

Y1 - 2021/6

N2 - Sum reduction is a primitive operation in parallel computing while SYCL is a promising heterogeneous programming language. In this paper, we describe the SYCL implementations of integer sum reduction using atomic functions, shared local memory, vectorized memory accesses, and parameterized workload sizes. Evaluating the reduction kernels shows that we can achieve 1.4X speedup over the open-source implementations of sum reduction for a sufficiently large number of integers on an Intel integrated GPU.

AB - Sum reduction is a primitive operation in parallel computing while SYCL is a promising heterogeneous programming language. In this paper, we describe the SYCL implementations of integer sum reduction using atomic functions, shared local memory, vectorized memory accesses, and parameterized workload sizes. Evaluating the reduction kernels shows that we can achieve 1.4X speedup over the open-source implementations of sum reduction for a sufficiently large number of integers on an Intel integrated GPU.

KW - GPU

KW - Reduction

KW - SYCL

UR - http://www.scopus.com/inward/record.url?scp=85114444710&partnerID=8YFLogxK

U2 - 10.1109/IPDPSW52791.2021.00099

DO - 10.1109/IPDPSW52791.2021.00099

M3 - Conference contribution

AN - SCOPUS:85114444710

T3 - 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021

SP - 652

EP - 655

BT - 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021

Y2 - 17 May 2021

ER -

Jin Z, Vetter J. Evaluating the Performance of Integer Sum Reduction on an Intel GPU. In 2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021. Institute of Electrical and Electronics Engineers Inc. 2021. p. 652-655. 9460583. (2021 IEEE International Parallel and Distributed Processing Symposium Workshops, IPDPSW 2021 - In conjunction with IEEE IPDPS 2021). doi: 10.1109/IPDPSW52791.2021.00099

Evaluating the Performance of Integer Sum Reduction on an Intel GPU

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this