Image Mosaicing Algorithm for Dynamic Scenes Using Multi-Scaled PHOG Feature and Optimal Seam
ZOU Li-Hui1,2, CHEN Jie1, ZHANG Juan1, LU Jing-Hua1
1.Key Laboratory of Complex System Intelligent Control and Decision of Minstry of Education,School of Automation,Beijing Institute of Technology,Beijing 100081 2.School of Computer and Communication Engineering,University of Science and Technology Beijing,Beijing 100083
Abstract Aiming at the problems of registration error and synthetic movement ghost which are caused by moving objects in image mosaicing, a mosaicing algorithm for dynamic scene using multi-scale pyramid histogram of oriented gradients (PHOG) and optimal seam is proposed. Firstly, a new feature, multi-scaled PHOG, is generated by introducing PHOG to multi-scale space corner detections. The feature is used to align images for avoiding the local impact caused by moving objects in image registration. Then, an optimal seam, guaranteeing the minimum difference in geometry and gray value, is searched by graph cut algorithm through constructing an energy function to remove the movement ghost. The experimental results show that the proposed algorithm is efficient in dealing with the problems of image mosaicing with moving objects, and the mosaicing results are satisfactory with high precision.
[1] Navneet A B,Bartoli A,Dalal N,et al.From Video Sequences to Motion Panoramas // Proc of the IEEE Workshop on Motion and Video Computing.Orlando,USA,2002: 201-207 [2] Mller B,Posch S.Detection and Tracking of Moving Objects for Mosaic Image Generation // Proc of the 23rd DAGM-Symposium on Pattern Recognition.Munich,Germany,2001: 208-215 [3] Hsu C T,Tsan Y C.Mosaics of Video Sequences with Moving Objects.Signal Processing: Image Communication,2004,19(1): 81-98 [4] Peleg S,Rousso B,Rav-Acha A,et al.Mosaicing on Adaptive Manifolds.IEEE Trans on Pattern Analysis and Machine Intelligence,2000,22(10): 1144-1154 [5] Zou Lihui,Chen Jie,Zhang Juan,et al.An Image Mosaicing Approach for Video Sequences Based on Space-Time Manifolds // Proc of the 29th Chinese Control Conference.Beijing,China,2010: 3003-3006 (in Chinese) (邹丽晖,陈 杰,张 娟,等.一种基于时空域流形的视频序列图像拼接算法//第29届中国控制会议论文集.北京,2010: 3003-3006) [6] Uyttendaele M,Eden A,Szeliski R.Eliminating Ghosting and Exposure Artifacts in Image Mosaics // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Hawaii,USA,2001: 509-516 [7] Fang Xianyong,Zhang Mingmin,Pan Zhigeng,et al.Research of Image Mosaic Based on Graph Cut.Journal of Image and Graphics,2007,12(12): 2050-2056 (in Chinese) (方贤勇,张明敏,潘志庚,等.基于图切割的图像拼接技术研究.中国图象图形学报,2007,12(12): 2050-2056) [8] Qin Lei,Gao Wen.Image Matching Based on a Local Invariant Descriptor // Proc of the IEEE International Conference on Image Processing.Genova,Italy,2005: 377-380 [9] Lowe D G.Distinctive Image Features from Scale-Invariant Keypoints.International Journal of Computer Vision,2004,60(2): 91-110 [10] Bosch A,Zisserman A,Munoz X.Representing Shape with a Spatial Pyramid Kernel // Proc of the 6th ACM International Conference on Image and Video Retrieval.Amsterdam,Netherlands,2007: 401-408 [11] Chen Jie,Zou Lihui,Zhang Juan,et al.The Comparison and Application of Corner Detection Algorithms.Journal of Multimedia,2009,4(6): 435-441 [12] Mikolajczyk K,Schmid C.Scale Affine Invariant Interest Point Detectors.International Journal of Computer Vision,2004,60(1): 63-86 [13] Lazebnik S,Schmid C,Ponce J.Beyond Bags of Features: Spatial Pyramid Matching for Recognizing Natural Scene Categories // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.New York,USA,2006: 2169-2178 [14] Fischler M A,Bolles R C.Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography.Communications of the ACM,1981,24(6): 381-395 [15] Boykov Y,Veksler O,Zabih R.Fast Approximate Energy Minimization via Graph Cuts.IEEE Trans on Pattern Analysis and Machine Intelligence,2001,23(21): 1222-1239 [16] Gracias N,Mahoor M,Negahdaripour S,et al.Fast Image Blending Using Watersheds and Graph Cuts.Image and Vision Computing,2009,27(5): 597-607
2012, Vol. 25 
