Data-Enhanced Prediction with Decomposition and Amplitude-Aware Permutation Entropy in Distributed Computing Systems

Document Type

Conference Proceeding

Publication Date

1-1-2024

Abstract

In recent years, distributed computing has wit-nessed widespread applications across numerous organizations. Predicting workload and computing resource data can facilitate proactive service operation management, leading to substantial improvements in quality of service and cost efficiency. However, these data often exhibit non-linearity, high volatility, and inter-dependencies across different categories, presenting challenges for accurate forecasting. Consequently, there is a critical need to develop a method that thoroughly and comprehensively analyzes all available data to forecast future trends effectively. This work proposes a novel integrated data-enhanced prediction model named SVI for achieving high-accuracy workload prediction in distributed computing systems. SVI employs the Savitzky-Golay filter and variational mode decomposition for feature processing, whose features are subsequently utilized by Informer for multivariate joint analysis of the enhanced data, achieving high-precision prediction. Ablation and comparative experiments with advanced prediction models are conducted on the Google cluster trace and other typical datasets. Realistic data-driven results indicate that SVI improves the prediction accuracy by 35.4% compared to the original Informer, with each module contributing to the performance enhancement. Furthermore, compared with Autoformer, SVI enhances the prediction accuracy of workload, CPU, and memory by 62.5%, 65.6%, and 69.1 %, respectively.

Identifier

85217828005 (Scopus)

ISBN

[9781665410205]

Publication Title

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

External Full Text Location

https://doi.org/10.1109/SMC54092.2024.10831197

ISSN

1062922X

First Page

617

Last Page

622

Grant

4232049

Fund Ref

Natural Science Foundation of Beijing Municipality

This document is currently not available here.

Share

COinS