Abstract：A disparities assisted streetscape video inpainting method is proposed. Occlusions in the video are detected and the positional relationship between target region and reference region is built according to the disparities. A camera motion associated filling order as well as a progressive repairing strategy is applied in the proposed method. Because the disparity is a kind of pixel-wise positional relationship between images, the effectiveness of the proposed method is not related with the complexity of the scenes. Furthermore, the experimental results show that the proposed method has the capability to remove occlusions with lager area.
[1] Bertalmio M,Sapiro G,Caselles V,et al.Image Inpainting // Proc of the 27th Annual Conference on Computer Graphics and Interactive Techniques.Louisiana,USA,2000: 417-424 [2] Chan T,Shen Jianhong.Image Processing and Analysis: Variational,PDE,Wavelet,and Stochastic Methods.Philadelphia,USA: SIAM Publisher,2005 [3] Xiao Zhiyun,Zhang Wenxia.Wavelet-Domain Fast Inpainting Algorithm for Texture Image.Chinese Journal of Scientific Instrument,2008,29(7): 1422-1425(in Chinese) (肖志云,张文霞.小波域的纹理图像快速修复算法串.仪器仪表学报,2008,29(7): 1422-1425) [4] Efros A A,Freeman W T.Image Quilting for Texture Synthesis and Transfer // Proc of the 28th Annual Conference on Computer Graphics and Interactive Techniques.Los Angeles,USA,2001: 341-346 [5] Criminisi A,Pérez P,Toyama K.Region Filling and Object Removal by Exemplar-Based Image Inpainting.IEEE Trans on Image Processing,2004,13(9): 1200–1212 [6] Xu Zongben,Sun Jian.Image Inpainting by Patch Propagation Using Patch Sparsity.IEEE Trans on Image Processing,2010,19(5): 1153-1165 [7] Wang Quan,Wang Zhaoxia,Chang C S,et al.Multilayer Image Inpainting Approach Based on Neural Networks // Proc of the 5th International Conference on Natural Computation.Tianjian,China,2009: 459-462 [8] Zhang Yunjun,Xiao Jiangjian,Shah M.Motion Layer Based Object Removal in Videos // Proc of the 7th IEEE Workshops on Application of Computer Vision.Breckenridge,USA,2005: 516-521 [9] Korah T,Rasmussen C.Spatiotemporal Inpainting for Recovering Texture Maps of Occluded Building Facades.IEEE Trans on Image Processing,2007,16(9): 2262-2271 [10] Whyte O,Sivic J,Zisserman A [EB/OL].[2010-11-01].http://www.Di.ens.fr/sierra/pdfs/bmvc09.pdf [11] Amirshahi H,Kondo S,Ito K,et al.An Image Completion Algorithm Using Occlusion-Free Images from Internet Photo Sharing Sites.IEICE Trans on Fundamentals of Electronics,Communications and Computer Sciences,2008,91(10): 2918-2927 [12] Liu Chunxiao,Peng Qunsheng,Yang Yingzhen,et al.Optimization of Perspective Distortion for Image Completion Based on the Large Displacement View.Acta Electronica Sinica,2009,37(z1): 112-117(in Chinese) (刘春晓,彭群生,杨颖振,等.利用大位移视图修复单幅图像的透视畸变优化算法.电子学报,2009,37(z1): 112-117) [13] Hosokawa T,Jarusirisawad S,Saito H.Online Video Synthesis for Removing Occluding Objects Using Multiple Uncalibrated Cameras via Plane Sweep Algorithm // Proc of the 3rd ACM/IEEE International Conference on Distributed Smart Cameras.Como,Italy,2009: 1-8 [14] Ogale A S,Aloimonos Y.A Roadmap to the Integration of Early Visual Modules.International Journal of Computer Vision,2007,72(1): 9-25 [15] Loop C,Zhang Zhengyou.Computing Rectifying Homographies for Stereo Vision // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Fort Collins,USA,1999: 125-131 [16] Fusiello A,Trucco E,Verri A.A Compact Algorithm for Rectification of Stereo Pairs.Machine Vision and Applications,2000,12(1): 6-22 [17] Otsu N.A Threshold Selection Method from Gray-Level Histograms.IEEE Trans on Systems,Man and Cybernetics,1979,9(1): 62-66 [18] Jia Yunde.Machine Vision.Beijing,China: Science Press,2000 (in Chinese) (贾云得.机器视觉.北京:科学出版社,2000)
2012, Vol. 25 
