Control and Decision Theory in the Metaverse: A Survey
HUANG Jie1,2
1. College of Electrical Engineering and Automation, Fuzhou University, Fuzhou 350108; 2. 5G+ Industrial Internet Institute, Fuzhou University, Fuzhou 350108
Abstract：The concept of Metaverse is widely concerned by scholars from all walks of life. Firstly, the relevant concepts of Metaverse are analyzed and introduced, and it is distinguished from similar concepts such as virtual world and digital twins. The development process of Metaverse and the necessary technologies for its establishment are combed and expounded. Assumptions for the construction levels of Metaverse in the future are put forward, and various technical support for each construction level is provided. Then, from the perspective of control science and engineering subject, the development process of control and decision theory is elaborated, and the development and application of control and decision theory in the context of Metaverse, combined with cloud computing, artificial intelligence 2.0, industrial Metaverse, blockchain and other technologies are introduced. Finally, the key challenges and openness in the theory of control and decision-making as well as the construction of Metaverse are discussed and predicted, providing inspiration and reference for future research and industrial application related to the Metaverse.
黄捷. 元宇宙下的控制与决策综述[J]. 模式识别与人工智能, 2023, 36(2): 143-159.
HUANG Jie. Control and Decision Theory in the Metaverse: A Survey. Pattern Recognition and Artificial Intelligence, 2023, 36(2): 143-159.
[1] STEPHENSON N. Snow Crash. New York, USA: Bantam Books, 1992. [2] TAMAI M, INABA M, HOSOI K, et al. Constructing Situated Lear-ning Platform for Japanese Language and Culture in 3D Metaverse // Proc of the 2nd International Conference on Culture and Computing. Washington USA: IEEE, 2011: 189-190. [3] 董浩宇. “元宇宙”特性、概念与商业影响研究——兼论元宇宙中的营销传播应用. 现代广告, 2022(8): 4-12. (DONG H Y. Influence of "Meteverse"-and the Discussion on the Application of Marketing Communication in the "Meteverse". Modern Advertising, 2022(8): 4-12.) [4] O'BRIEN M, CHAN K. EXPLAINER: What Is the Metaverse and How Will It Work?[R/OL]. [2022-11-20]. Techxplore.com/news/2023-01-metaverse.html. [5] 王文喜,周芳,万月亮,等.元宇宙技术综述.工程科学学报, 2022, 44(4): 744-756. (WANG W X, ZHOU F, WAN Y L, et al. A Survey of Metaverse Technology. Chinese Journal of Engineering, 2022, 44(4): 744-756.) [6] 王儒西. 向安玲. 2020-2021年元宇宙发展研究报告[R/OL]. [2022-11-20]. http://cbdio.com/BigData/2021-09/22/content_6166594.htm. (WANG R X, XIANG A L. Research Report on the Development of the Metaverse from 2020 to 2021[R/OL]. [2022-11-20]. http://cbdio.com/BigData/2021-09/22/content_6166594.htm [7] 翟崑. 元宇宙与数字时代的国家战略创新. 人民论坛, 2022(7): 26-29. (ZHAI K.National Strategic Innovation in the Metaverse and the Digital Age. People's Tribune, 2022(7): 26-29.) [8] 简圣宇. 娱乐数字化:元宇宙创构的动力、风险及前景.深圳大学学报(人文社会科学版), 2022, 39(3): 33-43. (JIAN S Y.Entertainment Digitization: Driving Force, Risks and Prospects for the Creation of Metaverse. Journal of Shenzhen University(Humanities and Social Sciences), 2022, 39(3): 33-43.) [9] LEE L H, BRAUD T, ZHOU P Y, et al. All One Needs to Know about Metaverse: A Complete Survey on Technological Singularity, Virtual Ecosystem, and Research Agenda. Journal of Latex Class Files, 2021, 14(8). DOI: 10.13140/RG.2.2.11200.0512418. [10] MOZUMDER M A I, SHEERAZ M M, ATHAR A, et al. Overview: Technology Roadmap of the Future Trend of Metaverse Based on IoT, Blockchain, AI Technique, and Medical Domain Metaverse Activity // Proc of the 24th International Conference on Advanced Communication Technology. Washington USA: IEEE, 2022: 256-261. [11] ZHANG Z Y, MO Z B, CHEN Y T, et al.Reinforcement Learning Behavioral Control for Nonlinear Autonomous System. IEEE/CAA Journal of Automatica Sinica, 2022, 9(9): 1561-1573. [12] YANG H J, JU S, XIA Y Q, et al. Predictive Cloud Control for Networked Multiagent Systems with Quantized Signals Under DoS Attacks. IEEE Transactions on Systems, Man and Cybernetics(Systems), 2021, 51(2): 1345-1353. [13] 龚才春. 中国元宇宙发展白皮书.北京:北京信息产业协会, 2022. (GONG C C.White Paper on the Development of China's Meta-Universe. Beijing China: Beijing Information Industry Association, 2022.) [14] 中国传媒大学媒体融合与传播国家重点实验室新媒体研究院.2022元宇宙研究报告:多元视角[R/OL]. [2022-11-20]. http://www.199it.com/archives/1379414.html. (New Media Research Institute of State Key Laboratory of Media Convergence and Communication, Communication University of China. 2022 Metaverse Research Report: Multiple Perspectives[R/OL]. [2022-11-20]. http://www.199it.com/archives/1379414.html [15] 清华大学新闻与传播学院新媒体研究中心.元宇宙发展研究报告2.0版[R/OL]. [2022-11-20]. http://zhuanlan.zhihu.com/p/461738621. (New Media Research Center, School of Journalism and Communication, Tsinghua University. Metaverse Development Research Report Version 2.0[R/OL]. [2022-11-20]. http://zhuanlan.zhihu.com/p/461738621 [16] NING H S, WANG H, LIN Y J, et al. A Survey on Metaverse: the State-of-the-Art, Technologies, Applications, and Challenges [C/OL].[2022-11-20]. https://arxiv.org/ftp/arxiv/papers/2111/2111.09673.pdf. [17] WANG Y T, SU Z, ZHANG N, et al. A Survey on Metaverse: Fundamentals, Security, and Privacy. IEEE Communications Surveys and Tutorials, 2023, 25(1): 319-352. [18] MYSTAKIDIS S.Metaverse. Encyclopedia, 2022, 2(1): 486-497. [19] LIM W Y B, XIONG Z H, NIYATO D, et al. Realizing the Metaverse with Edge Intelligence: A Match Made in Heaven. IEEE Wireless Communication, 2022. DOI: 10.1109/Mwc.018.2011716. [20] 雪球网. 元宇宙的概述[R/OL]. [2022-11-20].https://xueqiu.com/7144441836/202186945. (XUEQIU. An Overview of the Metaverse[R/OL].[2022-11-20]. https://xueqiu.com/7144441836/202186945.) [21] XI N N, CHEN J, GAMA F, et al. The Challenges of Entering the Metaverse: An Experiment on the Effect of Extended Reality on Workload. Information Systems Frontiers, 2022. DOI: 10.1007/s10796-022-10244-x. [22] BUDDHIRAJU K M, EETI L N, TIWARI K K.A Web-Based Virtual Laboratory for Satellite Image Processing and Analysis. The International Archives of Photogrammetry Remote Sensing and Spatial Information Sciences, 2018, 42(1): 9-13. [23] 王飞跃,刘德荣,熊刚,等.复杂系统的平行控制理论及应用.复杂系统与复杂性科学, 2012, 9(3): 1-12. (WANG F Y, LIU D R, XIONG G, et al. Parallel Control Theory of Complex Systems and Applications. Complex Systems and Complexity Science, 2012, 9(3): 1-12.) [24] 张嗣瀛,高立群.现代控制理论, 北京:清华大学出版社, 2006. (ZHANG S Y, GAO L Q. Modern Control Theory. Beijing, China: Tsinghua University Press, 2006.) [25] WALTZ M D, FU K S.A Heuristic Approach to Reinforcement Learning Control Systems. IEEE Transactions on Automatic Control, 1965, 10(4): 390-398. [26] 夏元清. 云控制系统及其面临的挑战.自动化学报, 2016, 42(1): 1-12. (XIA Y Q.Cloud Control Systems and Their Challenges. Acta Automatica Sinica, 2016, 42(1): 1-12.) [27] ZHAN Y F, XIA Y Q, VASILAKOS A V.Future Directions of Networked Control Systems: A Combination of Cloud Control and Fog Control Approach. Computer Networks(The International Journal of Computer and Telecommunications Networking), 2019, 161: 235-248. [28] HEGAZY T, HEFEEDA M.Industrial Automation as a Cloud Ser-vice. IEEE Transactions on Parallel and Distributed Systems, 2015, 26(10): 2750-2763. [29] 夏元清,高润泽,林敏,等.绿色能源互补智能电厂云控制系统研究.自动化学报, 2020, 46(9): 1844-1868. (XIA Y Q, GAO R Z, LIN M, et al. Green Energy Complementary Based on Intelligent Power Plant Cloud Control System. Acta Automatica Sinica, 2020, 46(9): 1844-1868.) [30] ZHANG X M, HAN Q L, GE X H, et al. Networked Control Systems: A Survey of Trends and Techniques. IEEE/CAA Journal of Automatica Sinica, 2020, 7(1): 1-17. [31] GIVEHCHI O, IMTIAZ J, TRSEK H, et al. Control-as-a-Service from the Cloud: A Case Study for Using Virtualized PLCs // Proc of the 10th IEEE Workshop on Factory Communication Systems. Washington USA: IEEE, 2014. DOI: 10.1109/WFCS.2014.6837587. [32] SATYANARAYANAN M.The Emergence of Edge Computing. Computer, 2017, 50(1): 30-39. [33] MONOSTORI L, KÁDÁR B, BAUERNHANSL T, et al. Cyber-Physical Systems in Manufacturing. CIRP Annals, 2016, 65(2): 621-641. [34] 夏元清,闫策,王笑京,等.智能交通信息物理融合云控制系统.自动化学报, 2019, 45(1): 132-142. (XIA Y Q, YAN C, WANG X J, et al. Intelligent Transportation Cyber-Physical Cloud Control Systems. Acta Automatica Sinica, 2019, 45(1): 132-142.) [35] 黄捷,李帮银,陈宇韬,等.基于区块链的群机器人数据完整性与隐私性保护.无人系统技术, 2022, 5(4): 96-108. (HUANG J, LI B Y, CHEN Y T, et al. Blockchain-Based Data Integrity and Privacy Protection for Swarm Robotics. Unmanned Systems Technology, 2022, 5(4): 96-108.) [36] 孙彦棨,张正道.基于区块链的工业控制系统数据完整性保护.计算机集成制造系统, 2022, 28(9): 2909-2917. (SUN Y Q, ZHANG Z D.Industrial Control System Data Integrity Protection Based on Blockchain. Computer Integrated Manufactu-ring Systems, 2022, 28(9): 2909-2917.) [37] BODKHE U, TANWAR S, PAREKH K, et al. Blockchain for Industry 4.0: A Comprehensive Review. IEEE Access, 2020, 8: 79764-79800. [38] 王启河. 区块链技术研究综述.现代信息科技, 2022, 6(8): 66-71. (WANG Q H.Overview of Blockchain Technology Research. Modern Information Technology, 2022, 6(8): 66-71.) [39] YAQOOB I, SALAH K, JAYARAMAN R, et al. Blockchain for Healthcare Data Management: Opportunities, Challenges, and Future Recommendations. Neural Computing and Applications, 2022, 34(14): 11475-11490. [40] DESHPANDE A, STEWART K, LEPETIT L, et al. Distributed Ledger Technologies/Blockchain: Challenges, Opportunities and the Prospects for Standards. London UK: British Standards Institution, 2017. [41] PUTHAL D, MALIK N, MOHANTY S P, et al. The Blockchain as a Decentralized Security Framework. IEEE Consumer Electro-nics Magazine, 2018, 7(2): 18-21. [42] CHENG X, CHEN F L, XIE D, et al. Design of a Secure Medical Data Sharing Scheme Based on Blockchain. Journal of Medical Systems, 2020, 44. DOI: 10.1007/s10916-019-1468-1. [43] LIU Z, YANG D S, WEN D, et al. Cyber-Physical-Social Systems for Command and Control. IEEE Intelligent Systems, 2011, 26(4): 92-96. [44] 王飞跃,魏庆来.智能控制:从学习控制到平行控制.控制理论与应用, 2018, 35(7): 939-948. (WANG F Y, WEI Q L.Intelligent Control: From Learning Control to Parallel Control. Control Theory and Applications, 2018, 35(7): 939-948.) [45] HAHANOV V, MISHCHENKO O, SOKLAKOVA T, et al. Cyber-Social Computing // KHARCHENKO V, KONDRATENKO Y, KACPRZYK J, eds. Green IT Engineering: Social, Business and Industrial Applications. Berlin Germany: Springer, 2019: 489-515. [46] LU H, ZHU Y F, YUAN Y, et al. Social Signal-Driven Know-ledge Automation: A Focus on Social Transportation. IEEE Transactions on Computational Social Systems, 2021, 8(3): 737-753. [47] 王飞跃. 平行控制与数字孪生:经典控制理论的回顾与重铸.智能科学与技术学报, 2020, 2(3): 293-300. (WANG F Y.Parallel Control and Digital Twins: Control Theory Revisited and Reshaped. Chinese Journal of Intelligent Science and Technology, 20, 2(3): 293-300.) [48] 王飞跃,慕云五,马海宽,等.从牛顿系统到默顿系统——系统工程的过去、现在和未来.管理学家(实践版), 2013(10): 10-11. (WANG F Y, MU Y W, MA H K, et al. From Newtonian Systems to Mertonian Systems: The past, Present and Future of Systems Engineering. China Management Magazine, 2013(10): 10-11.) [49] 李亚玲,杨林瑶,葛俊,等.博弈5.0:基于平行系统和机器博弈的社会认知平行博弈.智能科学与技术学报, 2021, 3(4): 507-520. (LI Y L, YANG L Y, GE J, et al. Game 5.0: Social Cognition Parallel Game Based on the Parallel Systems and Machine Game. Chinese Journal of Intelligent Science and Technology, 2021, 3(4): 507-520.) [50] 王拥军,王飞跃,王戈,等. 平行医院:从医院信息管理系统到智慧医院操作系统.自动化学报, 2021, 47(11): 2585-2599. (WANG Y J, WANG F Y, WANG G, et al. Parallel Hospital: From Hospital Information System(HIS) to Hospital Smart Opera-ting System(HSOS). Acta Automatica Sinica, 2021, 47(11): 2585-2599.) [51] 张晓东,许丹丹,王良,等.基于复杂系统理论的平行城市模型架构与计算方法.指挥与控制学报, 2021, 7(1): 28-37. (ZHANG X D, XU D D, WANG L, et al. Model Architecture and Urban Computing for Parallel Cities Based on Complex Adaptive Systems. Journal of Command and Control, 2021, 7(1): 28-37.) [52] 王飞跃,张梅,孟祥冰,等. 平行眼:基于ACP的智能眼科诊疗.模式识别与人工智能, 2018, 31(6): 495-504. (WANG F Y, ZHANG M, MENG X B, et al. Parallel Eyes: An ACP-Based Smart Ophthalmic Diagnosis and Treatment. Pattern Recognition and Artificial Intelligence, 2018, 31(6): 495-504.) [53] KRAUSE J, RUXTON G D, KRAUSE S.Swarm Intelligence in Animals and Humans. Trends in Ecology and Evolution, 2010, 25(1): 28-34. [54] LI W, WU W J, WANG H M,et al. Crowd Intelligence in AI 2.0 Era. Frontiers of Information Technology and Electronic Enginee-ring, 2017, 18(1): 15-43. [55] 邢立宁,陈英武.基于知识的智能优化引导方法研究进展. 自动化学报, 2011, 37(11): 1285-1289. (XING L N, CHEN Y W.Research Progress on Intelligent Optimization Guidance Approaches Using Knowledge. Acta Automatica Sinica, 2011, 37(11): 1285-1289.) [56] JUNG J J.Computational Collective Intelligence with Big Data: Challenges and Opportunities. Future Generation Computer Systems, 2017, 66: 87-88. [57] XIAO M J, WU J, HUANG L S, et al. Online Task Assignment for Crowdsensing in Predictable Mobile Social Networks. IEEE Transactions on Mobile Computing, 2017, 16(8): 2306-2320. [58] GUO B, CHEN H H, YU Z W, et al. TaskMe: Toward a Dynamic and Quality-Enhanced Incentive Mechanism for Mobile Crowd Sensing. International Journal of Human-Computer Studies, 2017, 102: 14-26. [59] SARABADANI A, HALFAKER A, TARABORELLI D.Building Automated Vandalism Detection Tools for Wikidata // Proc of the 26th International Conference on World Wide Web Companion. New York USA: ACM, 2017: 1647-1654. [60] CHEN X J, JIA S B, XIANG Y.A Review: Knowledge Reasoning over Knowledge Graph. Expert Systems with Applications, 2020, 141. DOI: 10.1016/j.eswa.2019.112948. [61] LEE O J, JUNG J E.Sequence Clustering-Based Automated Rule Generation for Adaptive Complex Event Processing. Future Gene-ration Computer Systems, 2017, 66: 100-109. [62] BOBEK S, NALEPA G J.Uncertain Context Data Management in Dynamic Mobile Environments. Future Generation Computer Systems, 2017, 66: 110-124. [63] KARL W, ARTHUR G.Ethereum Eclipse Attacks[R/OL]. [2022-04-20].https://www.research-collection.ethz.ch/bitstream/handle/20.500.11850/121310/eth-49728-01.pdf. [64] HELLEBRANDT L, HOMOLIAK I, MALINKA K, et al. Increa-sing Trust in Tor Node List Using Blockchain // Proc of the IEEE International Conference on Blockchain and Cryptocurrency. Washington USA: IEEE, 2019: 29-32. [65] JEON H J, YOUN H C, KO S M, et al. Blockchain and AI Meet in the Metaverse // FERNÁNDEZ-CARAMÉS T M, FRAGA-LAMAS P. Advances in the Convergence of Blockchain and Artificial Intelligence. London UK: IntechOpen, 2021. DOI: 10.5772/intechopen.99114.
2023, Vol. 36 
