Adaptive Prediction of Resources and Workloads for Cloud Computing Systems with Attention-based and Hybrid LSTM
Document Type
Conference Proceeding
Publication Date
1-1-2022
Abstract
Currently, cloud computing service providers face big challenges in predicting large-scale workload and resource usage time series. Due to the difficulty in capturing nonlinear features, traditional forecasting methods usually fail to achieve high performance in predicting resource usage and workload sequences. Much noise implicit in the original sequences of resources and workloads is another reason for their low performance. To address these problems, this work proposes a hybrid prediction model named SABG that integrates an adaptive Savitzky-Golay (SG) filter, Attention mechanism, Bidirectional and Grid versions of Long and Short Term Memory (LSTM) networks. SABG adopts an adaptive SG filter in the data pre-processing to eliminate noise and extreme points in the original time series. It uses bidirectional and grid LSTM networks to capture bidirectional features and dimension ones, respectively. Then, it utilizes an attention mechanism to explore importance of different data dimensions. SABG aims to predict resource usage and workloads in highly variable traces in cloud computing systems. Extensive experimental results demonstrate that SABG achieves higher-accuracy prediction than several benchmark prediction approaches with datasets from Google cluster traces.
Identifier
85142670109 (Scopus)
ISBN
[9781665452588]
Publication Title
Conference Proceedings IEEE International Conference on Systems Man and Cybernetics
External Full Text Location
https://doi.org/10.1109/SMC53654.2022.9945419
ISSN
1062922X
First Page
550
Last Page
555
Volume
2022-October
Grant
62073005
Fund Ref
National Natural Science Foundation of China
Recommended Citation
Bi, Jing; Ma, Haisen; Yuan, Haitao; Xu, Kangyuan; and Zhou, Meng Chu, "Adaptive Prediction of Resources and Workloads for Cloud Computing Systems with Attention-based and Hybrid LSTM" (2022). Faculty Publications. 3462.
https://digitalcommons.njit.edu/fac_pubs/3462