Toward Managing HPC Burst Buffers Effectively: Draining Strategy to Regulate Bursty I/O Behavior

Document Type

Conference Proceeding

Publication Date

11-13-2017

Abstract

HPC (high-performance computing) applications usually show bursty I/O behaviors. In order to expedite the applications, permanent storage systems are usually provisioned to serve such I/O bursts. Approaching the era of exascale computing, non-volatile RAM is introduced as burst buffers, to absorb the bursty bulk data and relax the I/O provisioning requirement of the permanent storage systems. However, without judiciously draining the burst buffers, I/O bursts are passed down to the underlying storage systems, which causes severe I/O contention issues.In order to minimize the I/O provisioning requirement and resolve the issues caused by I/O bursts, we propose a proactive draining scheme to manage the draining process of distributed node-local burst buffers. In addition, we develop an I/O provisioning model to predict the minimized I/O provisioning requirement for permanent storage systems. Evaluation results show that applying the proactive draining scheme largely relaxes the I/O provisioning requirement while preserving the I/O performance of underlying storage systems.

Identifier

85040533106 (Scopus)

ISBN

[9781538627631]

Publication Title

Proceedings 25th IEEE International Symposium on Modeling Analysis and Simulation of Computer and Telecommunication Systems Mascots 2017

External Full Text Location

https://doi.org/10.1109/MASCOTS.2017.35

First Page

87

Last Page

98

Grant

CCF-1547804

Fund Ref

National Science Foundation

This document is currently not available here.

Share

COinS