OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration

Yeohyeon Park; Junhyeok Park; Awais Khan; Junghwan Park; Chang Gyu Lee; Woosuk Chung; Youngjae Kim

doi:10.1109/MASCOTS59514.2023.10387663

OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration

Yeohyeon Park
, Junhyeok Park
, Awais Khan
, Junghwan Park
, Chang Gyu Lee
, Woosuk Chung
, Youngjae Kim

Technology Integration

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

2 Scopus citations

Abstract

In this paper, we propose OctoKV, an innovative network-based key-value storage system. OctoKV addresses the repetitive address translation overhead associated with traditional key-value stores running on file systems on the client side. To mitigate this overhead, we implemented the key-value store on the server side using NVMe-oF and a user-level NVMe driver. In particular, we employed fine-grained resource monitoring and load balancing based on heuristics to optimize I/O performance. OctoKV is deployed on a Linux cluster with Intel SPDK. The extensive evaluation shows that OctoKV achieves lower I/O response times in comparison to traditional approaches where key-value stores run on the client side. Also, the proposed load balancing strategies efficiently enhance I/O response times by equally distributing the workload from overloaded cores to other cores.

Original language	English
Title of host publication	Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023
Publisher	IEEE Computer Society
ISBN (Electronic)	9798350319484
DOIs	https://doi.org/10.1109/MASCOTS59514.2023.10387663
State	Published - 2023
Event	31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023 - Stony Brook, United States Duration: Oct 16 2023 → Oct 18 2023

Publication series

Name	Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS
ISSN (Print)	1526-7539

Conference

Conference	31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023
Country/Territory	United States
City	Stony Brook
Period	10/16/23 → 10/18/23

Funding

We thank the anonymous reviewers of our paper for their invaluable comments on improving the paper. This work was funded in part by the Institute of Information Communications Technology Planning Evaluation (IITP) grants funded by the Korea government (MSIT) (No. 2020-0-00104), in part by the National Research Foundation of Korea (NRF) grant funded by the Korean government (MSIT) (No. NRF-2021R1A2C2014386), and in part by SK hynix research grant. This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.

Keywords

High Performance I/O
I/O Scheduling
Key-Value Store
Storage System

Access to Document

10.1109/MASCOTS59514.2023.10387663

Cite this

Park, Y., Park, J., Khan, A., Park, J., Lee, C. G., Chung, W., & Kim, Y. (2023). OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration. In Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023 (Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS). IEEE Computer Society. https://doi.org/10.1109/MASCOTS59514.2023.10387663

Park, Yeohyeon ; Park, Junhyeok ; Khan, Awais et al. / OCTOKV : An Agile Network-Based Key-Value Storage System with Robust Load Orchestration. Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023. IEEE Computer Society, 2023. (Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS).

@inproceedings{a51ae358701047488d5b8f330b483f1b,

title = "OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration",

abstract = "In this paper, we propose OctoKV, an innovative network-based key-value storage system. OctoKV addresses the repetitive address translation overhead associated with traditional key-value stores running on file systems on the client side. To mitigate this overhead, we implemented the key-value store on the server side using NVMe-oF and a user-level NVMe driver. In particular, we employed fine-grained resource monitoring and load balancing based on heuristics to optimize I/O performance. OctoKV is deployed on a Linux cluster with Intel SPDK. The extensive evaluation shows that OctoKV achieves lower I/O response times in comparison to traditional approaches where key-value stores run on the client side. Also, the proposed load balancing strategies efficiently enhance I/O response times by equally distributing the workload from overloaded cores to other cores.",

keywords = "High Performance I/O, I/O Scheduling, Key-Value Store, Storage System",

author = "Yeohyeon Park and Junhyeok Park and Awais Khan and Junghwan Park and Lee, \{Chang Gyu\} and Woosuk Chung and Youngjae Kim",

note = "Publisher Copyright: {\textcopyright} 2023 IEEE.; 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023 ; Conference date: 16-10-2023 Through 18-10-2023",

year = "2023",

doi = "10.1109/MASCOTS59514.2023.10387663",

language = "English",

series = "Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS",

publisher = "IEEE Computer Society",

booktitle = "Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023",

}

Park, Y, Park, J, Khan, A, Park, J, Lee, CG, Chung, W & Kim, Y 2023, OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration. in Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023. Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS, IEEE Computer Society, 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023, Stony Brook, United States, 10/16/23. https://doi.org/10.1109/MASCOTS59514.2023.10387663

OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration. / Park, Yeohyeon; Park, Junhyeok; Khan, Awais et al.
Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023. IEEE Computer Society, 2023. (Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - OCTOKV

T2 - 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023

AU - Park, Yeohyeon

AU - Park, Junhyeok

AU - Khan, Awais

AU - Park, Junghwan

AU - Lee, Chang Gyu

AU - Chung, Woosuk

AU - Kim, Youngjae

PY - 2023

Y1 - 2023

N2 - In this paper, we propose OctoKV, an innovative network-based key-value storage system. OctoKV addresses the repetitive address translation overhead associated with traditional key-value stores running on file systems on the client side. To mitigate this overhead, we implemented the key-value store on the server side using NVMe-oF and a user-level NVMe driver. In particular, we employed fine-grained resource monitoring and load balancing based on heuristics to optimize I/O performance. OctoKV is deployed on a Linux cluster with Intel SPDK. The extensive evaluation shows that OctoKV achieves lower I/O response times in comparison to traditional approaches where key-value stores run on the client side. Also, the proposed load balancing strategies efficiently enhance I/O response times by equally distributing the workload from overloaded cores to other cores.

AB - In this paper, we propose OctoKV, an innovative network-based key-value storage system. OctoKV addresses the repetitive address translation overhead associated with traditional key-value stores running on file systems on the client side. To mitigate this overhead, we implemented the key-value store on the server side using NVMe-oF and a user-level NVMe driver. In particular, we employed fine-grained resource monitoring and load balancing based on heuristics to optimize I/O performance. OctoKV is deployed on a Linux cluster with Intel SPDK. The extensive evaluation shows that OctoKV achieves lower I/O response times in comparison to traditional approaches where key-value stores run on the client side. Also, the proposed load balancing strategies efficiently enhance I/O response times by equally distributing the workload from overloaded cores to other cores.

KW - High Performance I/O

KW - I/O Scheduling

KW - Key-Value Store

KW - Storage System

UR - https://www.scopus.com/pages/publications/85184520017

U2 - 10.1109/MASCOTS59514.2023.10387663

DO - 10.1109/MASCOTS59514.2023.10387663

M3 - Conference contribution

AN - SCOPUS:85184520017

T3 - Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS

BT - Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023

PB - IEEE Computer Society

Y2 - 16 October 2023 through 18 October 2023

ER -

Park Y, Park J, Khan A, Park J, Lee CG, Chung W et al. OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration. In Proceedings - 2023 31st International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems, MASCOTS 2023. IEEE Computer Society. 2023. (Proceedings - IEEE Computer Society's Annual International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunications Systems, MASCOTS). doi: 10.1109/MASCOTS59514.2023.10387663

OCTOKV: An Agile Network-Based Key-Value Storage System with Robust Load Orchestration

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this