Information Exchange Particle Swarm Optimization for Multitasking
CHENG Meiying1, QIAN Qian2, NI Zhiwei3, ZHU Xuhui3
1.Business School, Huzhou University, Huzhou 313000; 2.School of Teacher Education, Huzhou University, Huzhou 313000; 3.Key Laboratory of Process Optimization and Intelligent Decision-Making of Ministry of Education, School of Management, Hefei University of Technology, Hefei 230009
Abstract Different from the existing cloud platform and parallel computer, the implicit parallelism of particle swarm optimization(PSO) is fully exploited in this paper. Two information exchange strategies, within-task information transfer and between-task information transfer, are involved. Moreover, factorial rank, scalar fitness and skill factor are introduced into PSO for multitasking. In each iteration, the most appropriate individuals are used to solve the most suitable task, and information exchange PSO for multitasking(IEPSOM) is proposed. Multitasking function optimization problems, multitasking multiple constraints Engineering design cases and multitasking key evaluation system constructing problems are involved to verify the performance of IEPSOM. Experimental results reveal that in IEPSOM multitasking environment, information transfer enhances the solutions quality and speeds up the convergence.
Fund:Supported by Training Program of Major Research Plan of National Natural Science Foundation of China(No.91546108), National Natural Science Foundation of China(No.71701061), Annual Research Topics of Educational Science Planning of Zhejiang Province(No.2019SCG036), Science and Technology planning project of Huzhou(No.2018YZ11), Natural Science foundation of Huzhou University(No.2018XJKJ51,2018XJKJ56)
Corresponding Authors:
(CHENG yinmei(Corresponding author), Ph.D., lecturer. Her research interests include swarm intelligent algorithm and data mining.)
About author:: (QIAN Qian, master, lecturer. His research interests include evolutionary computation.)(NI Zhiwei, Ph.D., professor. His research interests include data mining, machine lear-ning and artificial intelligence.)(ZHU Xuhui, Ph.D., lecturer. His research interests include intelligent computation and machine learning.)
[1] CARUANA R. Multitask Learning. Journal of Machine Learning, 1997, 28(1): 41-75. [2] DZUBAK C M. Multitasking: The Good, the Bad, and the Unknown. The Journal of the Association for the Tutoring Profession, 2008, 1(2): 1-12. [3] DEREK K. Multitasking′s Big Advantage. Modern Machine Shop, 2013, 86(5): 78-83. [4] 魏艳.基于LBM的两相流数值模拟及其并行算法的实现.硕士学位论文.哈尔滨:哈尔滨工业大学, 2010. (WEI Y. Parallel Two-Phase Flow Simulations and Its Implications Using the Lattice Boltzmann Method. Master Dissertation. Harbin, China: Harbin Institute of Technology, 2010.) [5] ONG Y S, GUPTA A. Evolutionary Multitasking: A Computer Science View of Cognitive Multitasking. Cognitive Computation, 2016,8(2): 125-142. [6] GUPTA A, ONG Y S, FENG L. Multifactorial Evolution: Towards Evolutionary Multitasking. IEEE Transactions on Evolutionary Computation, 2016, 20(3): 343-357. [7] GUPTA A, MANDZIUK J, ONG Y S. Evolutionary Multitasking in Bi-level Optimization. Complex and Intelligent Systems, 2015, 1(1/2/3/4): 83-95. [8] GUPTA A, ONG Y S, FENG L, et al. Multiojective Multifactorial Optimization in Evolutionary Multitasking. IEEE Transactions on Cybernetics, 2016, 47(7): 1652-1665. [9] DA B S, GUPTA A,ONG Y S. Curbing Negative Influences Online for Seamless Transfer Evolutionary Optimization. IEEE Transactions on Cybernetics, 2018. DOI: 10.1109/TCYB.2018.2864345. [10] GUPTA A, ONG Y S. Genetic Transfer or Population Diversification? Deciphering the Secret Ingredients of Evolutionary Multitask Optimization[C/OL]. [2018-09-25]. https://arxiv.org/ftp/arxiv/papers/1607/1607.05390.pdf. [11] GUPTA A, ONG Y S, DA B S, et al. Landscape Synergy in Evolutionary Multitasking // Proc of the IEEE Congress on Evolutionary Computation. Washington, USA: IEEE, 2016: 3076-3083. [12] GUPTA A, ONG Y S, DA B S, et al. Measuring Complementarity between Function Landscapes in Evolutionary Multitasking // Proc of the IEEE Congress on Evolutionary Computation. Washington, USA: IEEE, 2016: 24-29. [13] DA B S, GUPTA A, ONG Y S, et al. The Boon of Gene-Culture Interaction for Effective Evolutionary Multitasking // Proc of the Australasian Conference on Artificial Life and Computational Inte-lligence. Berlin, Germany: Springer, 2016: 54-65. [14] YOGATAMA D, MANN G. Efficient Transfer Learning Method for Automatic Hyper Parameter Tuning // Proc of the 17th International Conference on Artificial Intelligence and Statistics. Berlin, Germany: Springer, 2014: 1077-1085. [15] KENNEDY J, EBERHART R. Particle Swarm Optimization // Proc of the International Conference on Neural Networks. Berlin, Germany: Springer, 1995: 1942-1948. [16] CHENG M Y, GUPTA A, ONG Y S, et al. Coevolutionary Multitasking for Concurrent Global Optimization: With Case Studies in Complex Engineering Design. Engineering Applications of Artificial Intelligence, 2017, 64: 13-24. [17] 程美英,钱乾,倪志伟,等.多任务处理协同进化粒子群算法.模式识别与人工智能, 2018, 31(4): 322-334. (CHENG M Y, QIAN Q, NI Z W, et al. Co-evolutionary Particle Swarm Optimization for Multitasking. Pattern Recognition and Artificial Intelligence, 2018, 31(4): 322－334.) [18] 程美英,钱乾,倪志伟,等.基于虚拟多任务二元粒子群算法和分形维数的雾霾天气预测方法.系统科学与数学, 2018, 38(5): 623-637. (CHENG M Y, QIAN Q, NI Z W, et al. Virtual Multitasking Binary Particle Swarm Optimization and Fractal Dimension for Haze Forecast. Journal of Systems Science and Mathematical Sciences, 2018, 38(5): 623-637.) [19] NOLLE L. On a Hill-Climbing Algorithm with Adaptive Step Size: Toweards a Control Parameter-Less Black-Box Optimization Algorithm // REUSCH B, ed. Computational Intelligence, Theory and Applications. Berlin, Germany: Springer, 2006: 587-595. [20] LIAO T J, SOCHA K, MONTES M A, et al. Ant Colony Optimization for Mixed-Variable Optimization Problem. IEEE Transactions on Evolutionary Computation, 2014, 18(4): 503-518. [21] 林丹,李敏强,寇纪松.基于遗传算法求解约束优化问题的一种算法.软件学报, 2001, 12(4): 628-632. (LIN D, LI M Q, KOU J S. A GA-Based Method for Solving Constrained Optimization Problems. Journal of Software, 2001, 12(4): 628-632.) [22] GUO C X, HU J S, YE B, et al. Swarm Intelligence for Mixedvariable Design Optimization. Journal of Zhejiang University(Sci- ence A), 2004, 5(7): 851-860. [23] SCHMIDT H, THIERAUF G. A Combined Heuristic Optimization Technique. Advances in Engineering Software, 2005, 36(1): 11-19. [24] LONG W, LIANG X M, HUANG Y F, et al. A Hybrid Differential Evolution Augmented Lagrangian Method for Constrained Nume-rical and Engineering Optimization. Computer-Aided Design, 2013, 45(12): 1562-1574. [25] YANG X S, HUYCK C, MEHMET K, et al. True Global Optimality of the Pressure Vessel Design Problem: A Benchmark for Bio-inspired Optimization Algorithms. International Journal of Bio-inspired Computation, 2013, 5(6): 329-335. [26] LEANDRO D S C. Gaussian Quantum-Behaved Particle Swarm Optimization Approaches for Constrained Engineering Design Problems. Expert Systems with Applications, 2010,37(2): 1676-1683.
2019, Vol. 32 
