Bandwidth Scheduling for Big Data Transfer with Deadline Constraint between Data Centers

Document Type

Conference Proceeding

Publication Date

7-2-2018

Abstract

An increasing number of applications in scientific and other domains have moved or are in active transition to clouds, and the demand for the movement of big data between geographically distributed cloud-based data centers is rapidly growing. Many modern backbone networks leverage logically centralized controllers based on software-defined networking (SDN) to provide advance bandwidth reservation for data transfer requests. How to fully utilize the bandwidth resources of the links connecting data centers with guaranteed QoS for each user request is an important problem for cloud service providers. Most existing work focuses on bandwidth scheduling for a single request for data transfer or multiple requests using the same service model. In this work, we construct rigorous cost models to quantify user satisfaction degree and formulate a generic problem of bandwidth scheduling for multiple deadline-constrained data transfer requests of different types to maximize the request scheduling success ratio while minimizing the data transfer completion time of each request. We prove this problem to be NP-complete and design a heuristic solution. Extensive simulation results show that our scheduling scheme significantly outperforms existing methods in terms of user satisfaction degree and scheduling success ratio.

Identifier

85063325293 (Scopus)

ISBN

[9781728101941]

Publication Title

Proceedings of Indis 2018 Innovating the Network for Data Intensive Science Held in Conjunction with Sc 2018 the International Conference for High Performance Computing Networking Storage and Analysis

External Full Text Location

https://doi.org/10.1109/INDIS.2018.00009

First Page

55

Last Page

63

Grant

2017YFB1400301

Fund Ref

Northwest University

This document is currently not available here.

Share

COinS