DENOVA: Deduplication Extended NOVA File System

Hyungjoon Kwon; Yonghyeon Cho; Awais Khan; Yeohyeon Park; Youngjae Kim

doi:10.1109/IPDPS53621.2022.00134

DENOVA: Deduplication Extended NOVA File System

Hyungjoon Kwon, Yonghyeon Cho, Awais Khan, Yeohyeon Park, Youngjae Kim

Technology Integration

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

9 Scopus citations

Abstract

This paper shows mathematically and experimentally that inline deduplication is not suitable for file systems on ultra-low latency Intel Optane DC PM devices in terms of performance, and proposes DeNova, an offline deduplication specially designed for log-structured NVM file systems such as NOVA. DeNova offers high-performance and low-latency I/O processing and executes deduplication in the background without interfering with foreground I/Os. DeNova employs DRAM-free persistent deduplication metadata, favoring CPU cache line, and ensures failure consistency on any system failure. We implement DeNova in the NOVA file system. Evaluation with DeNova confirms a negligible performance drop of baseline NOVA of less than 1%, while gaining high storage space savings. Extensive experiments show DeNova is failure consistent in all failure scenario cases.

Original language	English
Title of host publication	Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	1360-1371
Number of pages	12
ISBN (Electronic)	9781665481069
DOIs	https://doi.org/10.1109/IPDPS53621.2022.00134
State	Published - 2022
Event	36th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022 - Virtual, Online, France Duration: May 30 2022 → Jun 3 2022

Publication series

Name	Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022

Conference

Conference	36th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022
Country/Territory	France
City	Virtual, Online
Period	05/30/22 → 06/3/22

Funding

We thank the reviewers for their constructive comments that helped improve the paper. This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIT)(No. NRF-2021R1A2C2014386). This work was also supported by, and used the resources of, the Oak Ridge Leadership Computing Facility, located in the National Center for Computational Sciences at ORNL, which is managed by UT Battelle, LLC for the U.S. DOE (under the contract No. DE-AC05-00OR22725).

Keywords

Consistency
Deduplication
File System
Non-Volatile Memory

Access to Document

10.1109/IPDPS53621.2022.00134

Cite this

Kwon, H., Cho, Y., Khan, A., Park, Y., & Kim, Y. (2022). DENOVA: Deduplication Extended NOVA File System. In Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022 (pp. 1360-1371). (Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/IPDPS53621.2022.00134

Kwon, Hyungjoon ; Cho, Yonghyeon ; Khan, Awais et al. / DENOVA : Deduplication Extended NOVA File System. Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. pp. 1360-1371 (Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022).

@inproceedings{c7b208907560469c993e68fd6f6e88b3,

title = "DENOVA: Deduplication Extended NOVA File System",

abstract = "This paper shows mathematically and experimentally that inline deduplication is not suitable for file systems on ultra-low latency Intel Optane DC PM devices in terms of performance, and proposes DeNova, an offline deduplication specially designed for log-structured NVM file systems such as NOVA. DeNova offers high-performance and low-latency I/O processing and executes deduplication in the background without interfering with foreground I/Os. DeNova employs DRAM-free persistent deduplication metadata, favoring CPU cache line, and ensures failure consistency on any system failure. We implement DeNova in the NOVA file system. Evaluation with DeNova confirms a negligible performance drop of baseline NOVA of less than 1%, while gaining high storage space savings. Extensive experiments show DeNova is failure consistent in all failure scenario cases.",

keywords = "Consistency, Deduplication, File System, Non-Volatile Memory",

author = "Hyungjoon Kwon and Yonghyeon Cho and Awais Khan and Yeohyeon Park and Youngjae Kim",

note = "Publisher Copyright: {\textcopyright} 2022 IEEE.; 36th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022 ; Conference date: 30-05-2022 Through 03-06-2022",

year = "2022",

doi = "10.1109/IPDPS53621.2022.00134",

language = "English",

series = "Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

pages = "1360--1371",

booktitle = "Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022",

}

Kwon, H, Cho, Y, Khan, A, Park, Y & Kim, Y 2022, DENOVA: Deduplication Extended NOVA File System. in Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022. Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022, Institute of Electrical and Electronics Engineers Inc., pp. 1360-1371, 36th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022, Virtual, Online, France, 05/30/22. https://doi.org/10.1109/IPDPS53621.2022.00134

DENOVA: Deduplication Extended NOVA File System. / Kwon, Hyungjoon; Cho, Yonghyeon; Khan, Awais et al.
Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022. Institute of Electrical and Electronics Engineers Inc., 2022. p. 1360-1371 (Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution › peer-review

TY - GEN

T1 - DENOVA

T2 - 36th IEEE International Parallel and Distributed Processing Symposium, IPDPS 2022

AU - Kwon, Hyungjoon

AU - Cho, Yonghyeon

AU - Khan, Awais

AU - Park, Yeohyeon

AU - Kim, Youngjae

PY - 2022

Y1 - 2022

N2 - This paper shows mathematically and experimentally that inline deduplication is not suitable for file systems on ultra-low latency Intel Optane DC PM devices in terms of performance, and proposes DeNova, an offline deduplication specially designed for log-structured NVM file systems such as NOVA. DeNova offers high-performance and low-latency I/O processing and executes deduplication in the background without interfering with foreground I/Os. DeNova employs DRAM-free persistent deduplication metadata, favoring CPU cache line, and ensures failure consistency on any system failure. We implement DeNova in the NOVA file system. Evaluation with DeNova confirms a negligible performance drop of baseline NOVA of less than 1%, while gaining high storage space savings. Extensive experiments show DeNova is failure consistent in all failure scenario cases.

AB - This paper shows mathematically and experimentally that inline deduplication is not suitable for file systems on ultra-low latency Intel Optane DC PM devices in terms of performance, and proposes DeNova, an offline deduplication specially designed for log-structured NVM file systems such as NOVA. DeNova offers high-performance and low-latency I/O processing and executes deduplication in the background without interfering with foreground I/Os. DeNova employs DRAM-free persistent deduplication metadata, favoring CPU cache line, and ensures failure consistency on any system failure. We implement DeNova in the NOVA file system. Evaluation with DeNova confirms a negligible performance drop of baseline NOVA of less than 1%, while gaining high storage space savings. Extensive experiments show DeNova is failure consistent in all failure scenario cases.

KW - Consistency

KW - Deduplication

KW - File System

KW - Non-Volatile Memory

UR - http://www.scopus.com/inward/record.url?scp=85136325583&partnerID=8YFLogxK

U2 - 10.1109/IPDPS53621.2022.00134

DO - 10.1109/IPDPS53621.2022.00134

M3 - Conference contribution

AN - SCOPUS:85136325583

T3 - Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022

SP - 1360

EP - 1371

BT - Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022

PB - Institute of Electrical and Electronics Engineers Inc.

Y2 - 30 May 2022 through 3 June 2022

ER -

Kwon H, Cho Y, Khan A, Park Y, Kim Y. DENOVA: Deduplication Extended NOVA File System. In Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022. Institute of Electrical and Electronics Engineers Inc. 2022. p. 1360-1371. (Proceedings - 2022 IEEE 36th International Parallel and Distributed Processing Symposium, IPDPS 2022). doi: 10.1109/IPDPS53621.2022.00134

DENOVA: Deduplication Extended NOVA File System

Abstract

Publication series

Conference

Funding

Keywords

Access to Document

Other files and links

Fingerprint

Cite this