TY - GEN
T1 - Benchmarking SSD-based lustre file system configurations
AU - Mohr, Rick
AU - Peltz, Paul
PY - 2014
Y1 - 2014
N2 - Due to recent development efforts, ZFS on Linux is now a viable alternative to the traditional ldiskfs backend used for production Lustre file systems. Certain ZFS features, such as copy-on-write, make it even more appealing for systems utilizing SSD storage. To compare the relative benefits of ZFS and ldiskfs for SSD-based Lustre file systems, a sys-tematic bottom-up benchmarking effort was undertaken uti-lizing Beacon, a Cray CS300-ACTM Cluster located at the University of Tennessee's Application Acceleration Center of Excellence (AACE). The Beacon cluster contains I/O nodes confogured with Intel SSD drives to be deployed as a Lustre file system. Benchmark tests were run at all layers (SSD block device, RAID, ldiskfs/ZFS, Lustre) to measure per-formance as well as scaling behavior. We discuss the bench-mark methodology used for performance testing and present results from a subset of these benchmarks. Anomalous I/O behavior discovered during the course of the benchmarking is also discussed.
AB - Due to recent development efforts, ZFS on Linux is now a viable alternative to the traditional ldiskfs backend used for production Lustre file systems. Certain ZFS features, such as copy-on-write, make it even more appealing for systems utilizing SSD storage. To compare the relative benefits of ZFS and ldiskfs for SSD-based Lustre file systems, a sys-tematic bottom-up benchmarking effort was undertaken uti-lizing Beacon, a Cray CS300-ACTM Cluster located at the University of Tennessee's Application Acceleration Center of Excellence (AACE). The Beacon cluster contains I/O nodes confogured with Intel SSD drives to be deployed as a Lustre file system. Benchmark tests were run at all layers (SSD block device, RAID, ldiskfs/ZFS, Lustre) to measure per-formance as well as scaling behavior. We discuss the bench-mark methodology used for performance testing and present results from a subset of these benchmarks. Anomalous I/O behavior discovered during the course of the benchmarking is also discussed.
KW - Benchmarking
KW - Lustre
KW - RAID
KW - ZFS
UR - http://www.scopus.com/inward/record.url?scp=84905472345&partnerID=8YFLogxK
U2 - 10.1145/2616498.2616544
DO - 10.1145/2616498.2616544
M3 - Conference contribution
AN - SCOPUS:84905472345
SN - 9781450328937
T3 - ACM International Conference Proceeding Series
BT - Proceedings of the XSEDE 2014 Conference
PB - Association for Computing Machinery
T2 - 2014 Annual Conference on Extreme Science and Engineering Discovery Environment, XSEDE 2014
Y2 - 13 July 2014 through 18 July 2014
ER -