Stochastic approximation- based transport profiling for big data movement over dedicated connections

Document Type

Syllabus

Publication Date

3-2-2018

Abstract

High-performance networks featuring advance bandwidth reservation have been developed and deployed to support big data transfer in extreme-scale scientific applications. The performance of such big data transfer largely depends on the transport protocols being used. For a given protocol in a given network environment, different parameter settings may lead to different performance, and oftentimes the default settings do not yield the best performance. It is, however, impractical to conduct an exhaustive search in the large parameter space of transport protocols for a set of suitable parameter values. This chapter proposes a stochastic approximation-based transport profiler, namely FastProf, to quickly determine the optimal operational zone of a protocol over dedicated connections. The proposed method is evaluated using both emulations based on real-life measurements and experiments over physical connections. The results show that FastProf significantly reduces the profiling overhead while achieving a comparable level of transport performance with the exhaustive search-based approach.

Identifier

85049702709 (Scopus)

ISBN

[1522550453, 9781522550457, 9781522550464]

Publication Title

Stochastic Methods for Estimation and Problem Solving in Engineering

External Full Text Location

https://doi.org/10.4018/978-1-5225-5045-7.ch005

First Page

113

Last Page

138

This document is currently not available here.

Share

COinS