模式识别与人工智能
Sunday, Apr. 13, 2025 Home      About Journal      Editorial Board      Instructions      Ethics Statement      Contact Us                   中文
Pattern Recognition and Artificial Intelligence  2023, Vol. 36 Issue (11): 1041-1058    DOI: 10.16451/j.cnki.issn1003-6059.202311007
Current Issue| Next Issue| Archive| Adv Search |
Construction of Roadside Multi-source Data Space Consistency Dataset and Research on Evaluation Methods
CHEN Zhiwei1, ZHANG Haolin1, YAN Yuchen1, CHEN Shitao1
1. National Key Laboratory of Human-Machine Hybrid Augmented Intelligence, National Engineering Research Center of Visual Information and Applications, Institute of Artificial Intelligence and Robotics, Xi'an Jiaotong University, Xi'an 710049

Download: PDF (6855 KB)   HTML (1 KB) 
Export: BibTeX | EndNote (RIS)      
Abstract  

The spatial consistency of multi-source sensing data is established as the foundation for the fusion of roadside multi-modal data, playing a crucial role in vehicle-to-infrastructure and roadside intelligence. However, existing roadside multi-modal datasets predominantly focus on recognition tasks such as object detection, lacking various spatial transformation information between multi-source sensors. This deficiency hinders the research into the spatial consistency problem of multi-source data at the roadside. Therefore, a dataset specifically designed for the study of the spatial consistency problem in roadside multi-source data is constructed in this paper-InfraCalib(https://github.com/chenzhiwei888/InfraCalib-Dataset). The dataset comprises over 230,000 frames of images and point cloud data, collected by two roadside smart mobile devices, covering diverse changes in scenes, modalities, lighting, device spatial positions and sensor postures. By matching feature key point pairs to correlate multi-modal data, a perspective-n-point(PnP) problem is constructed, and the extrinsic parameter matrix is solved using the minimum reprojection error method, serving as an approximate ground truth label. Finally, an experimental analysis of the classic feature matching algorithm is conducted on the InfraCalib dataset, and the discussion revolves around the quantitative evaluation indicators for the calibration of external parameters in multi-source sensors.

Key wordsMulti-source Data Spatial Consistency      Vehicle-to-Infrastructure      Spatial Transformation      Minimum Reprojection Error      Evaluation Indicator     
Received: 10 October 2023     
ZTFLH: TP181  
Fund:

National Key Research & Development Program of China(No.2022YFB2502900), National Natural Science Foundation of China(No.62088102)

Corresponding Authors: CHEN Shitao, Ph.D.,assistant professor. His research interests include autonomous driving.   
About author:: CHEN Zhiwei, master student.His research interests include intelligent transportation. ZHANG Haolin, Ph.D. candidate. His research interests include autonomous driving and vehicle-to-infrastructure. YAN Yuchen, Ph.D. candidate. His research interests include multi-sensors calibration and perception.
Service
E-mail this article
Add to my bookshelf
Add to citation manager
E-mail Alert
RSS
Articles by authors
CHEN Zhiwei
ZHANG Haolin
YAN Yuchen
CHEN Shitao
Cite this article:   
CHEN Zhiwei,ZHANG Haolin,YAN Yuchen等. Construction of Roadside Multi-source Data Space Consistency Dataset and Research on Evaluation Methods[J]. Pattern Recognition and Artificial Intelligence, 2023, 36(11): 1041-1058.
URL:  
http://manu46.magtech.com.cn/Jweb_prai/EN/10.16451/j.cnki.issn1003-6059.202311007      OR     http://manu46.magtech.com.cn/Jweb_prai/EN/Y2023/V36/I11/1041
Copyright © 2010 Editorial Office of Pattern Recognition and Artificial Intelligence
Address: No.350 Shushanhu Road, Hefei, Anhui Province, P.R. China Tel: 0551-65591176 Fax:0551-65591176 Email: bjb@iim.ac.cn
Supported by Beijing Magtech  Email:support@magtech.com.cn