Profiling transport performance for big data transfer over dedicated channels

Daqing Yun, Chase Q. Wu, Nageswara S.V. Rao, Bradley W. Settlemyer, Josh Lothian, Rajkumar Kettimuthu, Venkatram Vishwanath

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

11 Scopus citations

Abstract

The transfer of big data is increasingly supported by dedicated channels in high-performance networks. Transport protocols play a critical role in maximizing the link utilization of such high-speed connections. We propose a Transport Profile Generator (TPG) to characterize and enhance the end-to-end throughput performance of transport protocols. TPG automates the tuning of various transport-related parameters including socket options and protocol-specific configurations, and supports multiple data streams and multiple NIC-to-NIC connections. To instantiate the design of TPG, we use UDT as an example in the implementation and conduct extensive experiments of big data transfer over high-speed network channels to illustrate how existing transport protocols benefit from TPG in optimizing their performance.

Original languageEnglish
Title of host publication2015 International Conference on Computing, Networking and Communications, ICNC 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages858-862
Number of pages5
ISBN (Electronic)9781479969593
DOIs
StatePublished - Mar 26 2015
Event2015 International Conference on Computing, Networking and Communications, ICNC 2015 - Garden Grove, United States
Duration: Feb 16 2015Feb 19 2015

Publication series

Name2015 International Conference on Computing, Networking and Communications, ICNC 2015

Conference

Conference2015 International Conference on Computing, Networking and Communications, ICNC 2015
Country/TerritoryUnited States
CityGarden Grove
Period02/16/1502/19/15

Keywords

  • Transport profiling
  • big data transfer
  • high-performance networks

Fingerprint

Dive into the research topics of 'Profiling transport performance for big data transfer over dedicated channels'. Together they form a unique fingerprint.

Cite this