An Integrated High-Performance Transport Solution for Big Data Transfer over Wide-Area Networks

Document Type

Conference Proceeding

Publication Date

1-22-2019

Abstract

Transport control plays an important role in the performance of large-scale scientific applications involving transfer of large data sets, online computational steering, and interactive visualization. In general, large-scale scientific applications require high bandwidths to move big data across wide-area networks. One of the primary challenges is to explore and compose a set of feasible route options with multiple constraints. Another challenge essentially arises from the randomness inherent in wide-area networks, particularly the Internet. This randomness must be explicitly accounted for to achieve both goodput maximization and stabilization over the constructed routes by suitably adjusting the source rate in response to both network and host dynamics. Unfortunately, the widely deployed Transmission Control Protocol is inadequate for such tasks due to its performance limitations. We conduct rigorous analytical study of the design and performance of transport solutions, and develop an integrated transport solution in a systematical way to overcome the limitations of current transport methods. The superior and robust performance of the proposed transport solution is extensively evaluated in an experimental environment in comparison with existing transport methods.

Identifier

85062482298 (Scopus)

ISBN

[9781538666142]

Publication Title

Proceedings 20th International Conference on High Performance Computing and Communications 16th International Conference on Smart City and 4th International Conference on Data Science and Systems Hpcc Smartcity Dss 2018

External Full Text Location

https://doi.org/10.1109/HPCC/SmartCity/DSS.2018.00270

First Page

1661

Last Page

1668

Grant

61402328

Fund Ref

National Natural Science Foundation of China

This document is currently not available here.

Share

COinS