A Supervised Learning and Control Method to Improve Particle Swarm Optimization Algorithms
Document Type
Article
Publication Date
7-1-2017
Abstract
This paper presents an adaptive particle swarm optimization with supervised learning and control (APSO-SLC) for the parameter settings and diversity maintenance of particle swarm optimization (PSO) to adaptively choose parameters, while improving its exploration competence. Although PSO is a powerful optimization method, it faces such issues as difficult parameter setting and premature convergence. Inspired by supervised learning and predictive control strategies from machine learning and control fields, we propose APSO-SLC that employs several strategies to address these issues. First, we treat PSO with its optimization problem as a system to be controlled and model it as a dynamic quadratic programming model with box constraints. Its parameters are estimated by the recursive least squares with a dynamic forgetting factor to enhance better parameter setting and weaken worse ones. Its optimal parameters are calculated by this model to feed back to PSO. Second, a progress vector is proposed to monitor the progress rate for judging whether premature convergence happens. By studying the reason of premature convergence, this work proposes the strategies of back diffusion and new attractor learning to extend swam diversity, and speed up the convergence. Experiments are performed on many benchmark functions to compare APSO-SLC with the state-of-the-art PSOs. The results show that it is simple to program and understand, and can provide excellent and consistent performance.
Identifier
85027721650 (Scopus)
Publication Title
IEEE Transactions on Systems Man and Cybernetics Systems
External Full Text Location
https://doi.org/10.1109/TSMC.2016.2560128
e-ISSN
21682232
ISSN
21682216
First Page
1135
Last Page
1148
Issue
7
Volume
47
Grant
61170305
Fund Ref
National Natural Science Foundation of China
Recommended Citation
Dong, Wenyong and Zhou, Meng Chu, "A Supervised Learning and Control Method to Improve Particle Swarm Optimization Algorithms" (2017). Faculty Publications. 9482.
https://digitalcommons.njit.edu/fac_pubs/9482
