i-NVMe: Isolated NVMe over TCP for a Containerized Environment

Seongho Lee; Ikjun Yeom; Younghoon Kim

doi:10.1109/INFOCOM53939.2023.10228889

i-NVMe: Isolated NVMe over TCP for a Containerized Environment

Seongho Lee, Ikjun Yeom, Younghoon Kim

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

Abstract

Non-Volatile Memory Express (NVMe) over TCP is an efficient technology for accessing remote Solid State Drives (SSDs); however, it may cause a serious interference issue when used in a containerized environment. In this study, we propose a CPU isolation scheme for NVMe over TCP in such an environment. The proposed scheme measures the CPU usage of the NVMe over TCP worker, charges it to containers in proportion to their NVMe traffic, and schedules containers to ensure isolated sharing of the CPU. However, because the worker runs with a higher priority than normal containers, it may not be possible to achieve CPU isolation with container scheduling alone. To solve this problem, we also control the CPU usage of the worker by throttling NVMe over TCP traffic. The proposed scheme is implemented on a real testbed for evaluation. We perform extensive experiments with various workloads and demonstrate that the scheme can provide CPU isolation even in the presence of excessive NVMe traffic.

Original language	English
Title of host publication	INFOCOM 2023 - IEEE Conference on Computer Communications
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9798350334142
DOIs	https://doi.org/10.1109/INFOCOM53939.2023.10228889
State	Published - 2023
Externally published	Yes
Event	42nd IEEE International Conference on Computer Communications, INFOCOM 2023 - Hybrid, New York City, United States Duration: May 17 2023 → May 20 2023

Publication series

Name	Proceedings - IEEE INFOCOM
Volume	2023-May
ISSN (Print)	0743-166X

Conference

Conference	42nd IEEE International Conference on Computer Communications, INFOCOM 2023
Country/Territory	United States
City	Hybrid, New York City
Period	05/17/23 → 05/20/23

Funding

ACKNOWLEDGMENT This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT). (NRF-2020R1A2C2009809, NRF-2021R1C1C1009778.) We would like to thank the anonymous reviewers for their insightful comments and suggestions.

Keywords

File and storage system
Resource management
Scheduling

Access to Document

10.1109/INFOCOM53939.2023.10228889

Cite this

@inproceedings{7d62456e02384e939aa43221eb10d222,

title = "i-NVMe: Isolated NVMe over TCP for a Containerized Environment",

abstract = "Non-Volatile Memory Express (NVMe) over TCP is an efficient technology for accessing remote Solid State Drives (SSDs); however, it may cause a serious interference issue when used in a containerized environment. In this study, we propose a CPU isolation scheme for NVMe over TCP in such an environment. The proposed scheme measures the CPU usage of the NVMe over TCP worker, charges it to containers in proportion to their NVMe traffic, and schedules containers to ensure isolated sharing of the CPU. However, because the worker runs with a higher priority than normal containers, it may not be possible to achieve CPU isolation with container scheduling alone. To solve this problem, we also control the CPU usage of the worker by throttling NVMe over TCP traffic. The proposed scheme is implemented on a real testbed for evaluation. We perform extensive experiments with various workloads and demonstrate that the scheme can provide CPU isolation even in the presence of excessive NVMe traffic.",

keywords = "File and storage system, Resource management, Scheduling",

author = "Seongho Lee and Ikjun Yeom and Younghoon Kim",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 42nd IEEE International Conference on Computer Communications, INFOCOM 2023 ; Conference date: 17-05-2023 Through 20-05-2023",

year = "2023",

doi = "10.1109/INFOCOM53939.2023.10228889",

language = "English",

series = "Proceedings - IEEE INFOCOM",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

booktitle = "INFOCOM 2023 - IEEE Conference on Computer Communications",

}

Lee, S, Yeom, I & Kim, Y 2023, i-NVMe: Isolated NVMe over TCP for a Containerized Environment. in INFOCOM 2023 - IEEE Conference on Computer Communications. Proceedings - IEEE INFOCOM, vol. 2023-May, Institute of Electrical and Electronics Engineers Inc., 42nd IEEE International Conference on Computer Communications, INFOCOM 2023, Hybrid, New York City, United States, 05/17/23. https://doi.org/10.1109/INFOCOM53939.2023.10228889

i-NVMe: Isolated NVMe over TCP for a Containerized Environment. / Lee, Seongho; Yeom, Ikjun; Kim, Younghoon.
INFOCOM 2023 - IEEE Conference on Computer Communications. Institute of Electrical and Electronics Engineers Inc., 2023. (Proceedings - IEEE INFOCOM; Vol. 2023-May).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - i-NVMe

T2 - 42nd IEEE International Conference on Computer Communications, INFOCOM 2023

AU - Lee, Seongho

AU - Yeom, Ikjun

AU - Kim, Younghoon

PY - 2023

Y1 - 2023

N2 - Non-Volatile Memory Express (NVMe) over TCP is an efficient technology for accessing remote Solid State Drives (SSDs); however, it may cause a serious interference issue when used in a containerized environment. In this study, we propose a CPU isolation scheme for NVMe over TCP in such an environment. The proposed scheme measures the CPU usage of the NVMe over TCP worker, charges it to containers in proportion to their NVMe traffic, and schedules containers to ensure isolated sharing of the CPU. However, because the worker runs with a higher priority than normal containers, it may not be possible to achieve CPU isolation with container scheduling alone. To solve this problem, we also control the CPU usage of the worker by throttling NVMe over TCP traffic. The proposed scheme is implemented on a real testbed for evaluation. We perform extensive experiments with various workloads and demonstrate that the scheme can provide CPU isolation even in the presence of excessive NVMe traffic.

AB - Non-Volatile Memory Express (NVMe) over TCP is an efficient technology for accessing remote Solid State Drives (SSDs); however, it may cause a serious interference issue when used in a containerized environment. In this study, we propose a CPU isolation scheme for NVMe over TCP in such an environment. The proposed scheme measures the CPU usage of the NVMe over TCP worker, charges it to containers in proportion to their NVMe traffic, and schedules containers to ensure isolated sharing of the CPU. However, because the worker runs with a higher priority than normal containers, it may not be possible to achieve CPU isolation with container scheduling alone. To solve this problem, we also control the CPU usage of the worker by throttling NVMe over TCP traffic. The proposed scheme is implemented on a real testbed for evaluation. We perform extensive experiments with various workloads and demonstrate that the scheme can provide CPU isolation even in the presence of excessive NVMe traffic.

KW - File and storage system

KW - Resource management

KW - Scheduling

UR - https://www.scopus.com/pages/publications/85171611133

U2 - 10.1109/INFOCOM53939.2023.10228889

DO - 10.1109/INFOCOM53939.2023.10228889

M3 - Conference contribution

AN - SCOPUS:85171611133

T3 - Proceedings - IEEE INFOCOM

BT - INFOCOM 2023 - IEEE Conference on Computer Communications

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 17 May 2023 through 20 May 2023

ER -

i-NVMe: Isolated NVMe over TCP for a Containerized Environment

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this