TY - GEN
T1 - Efficient zero-copy noncontiguous I/O for Globus on InfiniBand
AU - Yu, Weikuan
AU - Tian, Yuan
AU - Vetter, Jeffrey S.
PY - 2010
Y1 - 2010
N2 - Noncontiguous I/O access is one of the main access patterns in parallel and distributed applications. An I/O architecture EXIO enables Globus, a popular runtime environment for distributed computing, on RDMA networks such as InfiniBand. In this paper, we investigate the benefits of InfiniBand zero-copy RDMA to noncontiguous I/O on Globus. Our experimental results demonstrate that, by enabling zero-copy RDMA on InfiniBand, EXIO significantly improves the performance of Globus noncontiguous I/O. Compared to the packing and unpacking, zero-copy RDMA improve the bandwidth by up to 2.7 times. Compared to both IPoIB and 10GigE, it increases the bandwidth by more than three times. While achieving efficient noncontiguous I/O, RDMA-based noncontiguous I/O on InfiniBand also leads to dramatical reduction of CPU utilization on Globus clients and servers.
AB - Noncontiguous I/O access is one of the main access patterns in parallel and distributed applications. An I/O architecture EXIO enables Globus, a popular runtime environment for distributed computing, on RDMA networks such as InfiniBand. In this paper, we investigate the benefits of InfiniBand zero-copy RDMA to noncontiguous I/O on Globus. Our experimental results demonstrate that, by enabling zero-copy RDMA on InfiniBand, EXIO significantly improves the performance of Globus noncontiguous I/O. Compared to the packing and unpacking, zero-copy RDMA improve the bandwidth by up to 2.7 times. Compared to both IPoIB and 10GigE, it increases the bandwidth by more than three times. While achieving efficient noncontiguous I/O, RDMA-based noncontiguous I/O on InfiniBand also leads to dramatical reduction of CPU utilization on Globus clients and servers.
UR - http://www.scopus.com/inward/record.url?scp=78649847930&partnerID=8YFLogxK
U2 - 10.1109/ICPPW.2010.56
DO - 10.1109/ICPPW.2010.56
M3 - Conference contribution
AN - SCOPUS:78649847930
SN - 9780769541570
T3 - Proceedings of the International Conference on Parallel Processing Workshops
SP - 362
EP - 368
BT - Proceedings - 2010 39th International Conference on Parallel Processing Workshops, ICPPW 2010
T2 - 2010 39th International Conference on Parallel Processing Workshops, ICPPW 2010
Y2 - 13 September 2010 through 16 September 2010
ER -