Survey of Local Feature Extraction on Range Images
GUO Yu-Lan1,2, LU Min1, TAN Zhi-Guo1, WAN Jian-Wei1
1.College of Electronic Science and Engineering,National University of Defense Technology,Changsha 410073 2.School of Computer Science and Software Engineering,The University of Western Australia,Perth 6009
Abstract Three dimensional (3D) object recognition is a hot research topic in computer vision. Local feature extraction is a key stage for 3D object recognition with the presence of occlusion and clutter. Firstly, range images and their representations are described. The differential geometric attributes are introduced, including the surface normal, the curvature and the shape index. Then, the local feature detection methods are classified into fixed scale method and adaptive scale method. And the local feature description methods are classified into depth value based, point spatial distribution based and geometric attributes distribution based methods. These methods with their merits and demerits are described. Finally, the existing methods are summarized and several challenges and future research directions are pointed out.
[1] Gordon G.Face Recognition Based on Depth and Curvature Features // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Champaign,USA,1992: 108-110 [2] Medioni G,Waupotitsch R.Face Recognition and Modeling in 3D // Proc of the IEEE International Workshop on Analysis and Modeling of Faces and Gestures.Nice,France,2003: 232-233 [3] Bowyer K W,Chang K,Flynn P.A Survey of Approaches and Challenges in 3D and Multi-Modal 3D+2D Face Recognition.Computer Vision and Image Understanding,2006,101(1): 1-15 [4] Scheenstra A,Ruifrok A,Veltkamp R.A Survey of 3D Face Recognition Methods // Proc of the 5th International Conference on Audio-and Video-Based Biometric Person Authentication.Hilton Rye Town,USA,2005: 891-899 [5] Mian A S,Bennamoun M,Owens R.An Efficient Multimodal 2D-3D Hybrid Approach to Automatic Face Recognition.IEEE Trans on Pattern Analysis and Machine Intelligence,2007,29(11): 1927-1943 [6] Mian A S.Representations and Matching Techniques for 3D Free-form Object and Face Recognition.Ph.D Dissertation.Perth,Australia: University of Western Australia,2006 [7] Abate A F,Nappi M,Riccio D,et al.2D and 3D Face Recognition: A Survey.Pattern Recognition Letters,2007,28(14): 1885-1906 [8] Chen H,Bhanu B.Human Ear Recognition in 3D.IEEE Trans on Pattern Analysis and Machine Intelligence,2007,29(4): 718-737 [9] Gao B,Zhang S.A Survey of 3D Head Model Retrieval // Proc of the 2nd International Conference on Intelligent Computation Technology and Automation.Changsha,China,2009: 515-519 [10] Mian A S,Bennamoun M,Owens R.Automatic Correspondence for 3D Modeling: An Extensive Review.International Journal of Shape Modeling,2005,11(2): 253-291 [11] Liu Daxue.A Research on LADAR-Vision Fusion and Its Application in Cross-Country Autonomous Navigation Vehicle.Ph.D Dissertation.Changsha,China: National University of Defense Technology,2009 (in Chinese) (刘大学.用于越野自主导航车的激光雷达与视觉融合方法研究.博士学位论文.长沙:国防科学技术大学,2009) [12] Guo Yulan,Lu Min,Tan Zhiguo,et al.A Novel Method for Ladar Target Orientation Estimation.Chinese Journal of Lasers,2011,38(4): 1-0414002-7 (in Chinese) (郭裕兰,鲁 敏,谭志国,等.一种新的激光雷达目标姿态估计算法.中国激光,2011,38(4): 1-0414002-7) [13] Grnwall C,Gustafsson F,Millnert M.Ground Target Recognition Using Rectangle Estimation.IEEE Trans on Image Processing,2006,15(11): 3401-3409 [14] Vasile A N,Marino R M.Pose-Independent Automatic Target Detection and Recognition Using 3D Laser Radar Imagery.Lincoln Laboratory Journal,2005,15(1): 61-78 [15] Besl P J,Jain R C.Three-Dimensional Object Recognition.Computer Survey,1985,17(1): 75-145 [16] Brady J P,Nandhakumar N,Aggarwal J K.Recent Progress in the Recognition of Objects from Range Data.Image Vision Computing,1989,7(4): 295-307 [17] Campbell R J,Flynn P J.A Survey of Free-Form Object Representation and Recognition Techniques.Computer Vision and Image Understanding,2001,81(2): 166-210 [18] Mian A S,Bennamoun M,Owens R.Automated 3D Model-Based Free-Form Object Recognition.Sensor Review,2004,24(2): 206-215 [19] Wei Yongchao,Su Xianyu.3D Object Recognition Based on Vector Angle.Acta Photonica Sinica,2009,38(7): 1862-1866 (in Chinese) (魏永超,苏显渝.基于矢量夹角的三维物体识别.光子学报,2009,38(7): 1862-1866) [20] Osada R,Funkhouser T,Chazelle B,et al.Shape Distributions.ACM Trans on Graphics,2002,21(4): 807-832 [21] Mamic G,Bennamoun M.Representation and Recognition of 3D Free-Form Objects.Digital Signal Processing,2002,12(1): 47-76 [22] Mian A S,Bennamoun M,Owens R.3D Model Based Object Recognition and Segmentation in Cluttered Scenes.IEEE Trans on Pattern Analysis and Machine Intelligence,2006,28(10): 1584-1601 [23] Mian A S,Bennamoun M,Owens R.On the Repeatability and Quality of Keypoints for Local Feature-Based 3D Object Retrieval from Cluttered Scenes.International Journal of Computer Vision,2010,89(2): 348-361 [24] Chen H,Bhanu B.3D Free-Form Object Recognition in Range Images Using Local Surface Patches.Pattern Recognition Letters,2007,28(10): 1252-1262 [25] Lo T W,Siebert J P.Local Feature Extraction and Matching on Range Images: 2.5D SIFT.Computer Vision and Image Understanding,2009,113(12): 1235-1250 [26] Bayramoglu N,Alatan A.Shape Index SIFT: Range Image Recognition Using Local Features // Proc of the 20th International Conference on Pattern Recognition.Istanbul,Turkey,2010: 352-355 [27] Wang Yueming,Pan Gang,Wu Zhaohui.A Survey of 3D Face Recognition.Journal of Computer-Aided Design Computer Graphics,2008,20(7): 819-829(in Chinese) (王跃明,潘 纲,吴朝晖.三维人脸识别研究综述.计算机辅助设计与图形学学报,2008,20(7): 819-829) [28] Li Shifei.Research on Three Dimensions Object Recognition from Range Images.Ph.D Dissertation.Changsha,China: National University of Defense Technology,2010 (in Chinese) (李世飞.基于深度图像的三维目标识别技术研究.博士学位论文.长沙:国防科学技术大学,2010) [29] Koenderink J,Doorn A.Surface Shape and Curvature Scales.Image and Vision Computing,1992,10(8): 557-565 [30] Funkhouser T,Shilane P.Partial Matching of 3D Shapes with Priority-Driven Search // Proc of the 4th Eurographics Symposium on Geometry Processing.Cagliari,Italy,2006: 131-142 [31] Lowe D.Distinctive Image Features from Scale Invariant Key Points.International Journal of Computer Vision,2004,60(2): 91-110 [32] Frome A,Huber D,Kolluri R,et al.Recognizing Objects in Range Data Using Regional Point Descriptors // Proc of the 8th European Conference on Computer Vision.Prague,Czech,2004: 224-237 [33] Johnson A E,Hebert M.Using Spin Images for Efficient Object Recognition in Cluttered 3D Scenes.IEEE Trans on Pattern Analysis and Machine Intelligence,1999,21(5): 433-449 [34] Shilane P,Funkhouser T.Selecting Distinctive 3D Shape Descriptors for Similarity Retrieval // Proc of the IEEE International Conference on Shape Modeling and Applications.Matsushima,Japan,2006: 18-25 [35] Hoffman D,Singh M.Salience of Visual Parts.Cognition,1997,63(1): 29-78 [36] Frintrop S,Nuchter A,Surmann H,et al.Saliency-Based Object Recognition in 3D Data // Proc of the IEEE/RSJ International Conference on Intelligent Robots and Systems.Sendal,Japan,2004: 2167-2172 [37] Thirion J P.Extremal Points: Definition and Application to 3D Image Registration // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Seattle,USA,1994: 587-592 [38] Thirion J P.New Feature Points Based on Geometric Invariants for 3D Image Registration.International Journal of Computer Vision,1996,18(2): 121-137 [39] Yamany S M,Bialy A,Farag A.Surface Point Signature(SPS): A New Representation Scheme for Object Registration and Recognition // Proc of the SPIE Conference on Intelligence Robots and Computer Vision.Boston,USA,1999: 1-7 [40] Mian A S,Bennamoun M,Owens R.A Novel Representation and Feature Matching Algorithm for Automatic Pairwise Registration of Range Images.International Journal of Computer Vision,2006,66(1): 19-40 [41] Akagunduz E,Ulusoy I.3D Object Representation Using Transform and Scale Invariant 3D Features // Proc of the 11th IEEE International Conference on Computer Vision.Rio de Janeiro,Brazil,2007: 1-8 [42] Akagunduz E,Ulusoy I.3D Face Detection Using Transform Invariant Features.Electronic Letters,2010,46(13): 905-907 [43] Castellani U,Cristani M,Fantoni S,et al.Sparse Points Matching by Combining 3D Mesh Saliency with Statistical Descriptors.Computer Graphics Forum,2008,27(2): 643-652 [44] Li X,Guskov I.Multi-Scale Features for Approximate Alignment of Point-Based Surfaces // Proc of the 3rd Eurographics Symposium on Geometry Processing.Vienna,Austria,2005: 217-226 [45] Novatnack J,Nishino K,Shokoufandeh A.Extracting 3D Shape Features in Discrete Scale Space // Proc of the 3rd International Symposium on 3D Data Processing,Visualization and Transmission.Chapel Hill,USA,2006: 946-953 [46] Harris C,Stephens M.A Combined Corner and Edge Detector // Proc of the 4th Alvey Vision Conference.Manchester,UK,1988: 147-151 [47] Zou G,Hua J,Lai Z,et al.Intrinsic Geometric Scale Space by Shape Diffusion.IEEE Trans on Visualization and Computer Graphics,2009,15(6): 1193-1201 [48] Ho H T,Gibbins D.Multi-Scale Feature Extraction for 3D Surface Registration Using Local Shape Variation // Proc of the 23rd International Conference on Image and Vision Computing.Christchurch,New Zealand,2008: 1-6 [49] Pauly M,Keiser P,Gross M.Multi-Scale Feature Extraction on Point-Sampled Surface.Computer Graphics Forum,2003,22(3): 281-289 [50] Chua C S,Ray J.Point Signatures: A New Representation for 3D Object Recognition.International Journal of Computer Vision,1997,25(1): 63-85 [51] Salvi J,Matabosch C,Fofi D.A Review of Recent Range Image Registration Methods with Accuracy Evaluation.Image and Vision Computing,2007,25(5): 578-596 [52] Masuda T.Multiple Range Image Registration by Matching Local Log-Polar Range Images // Proc of the 7th Asian Conference on Computer Vision.Hyderabad,India,2006: 948-957 [53] Assfalg J,DAmico G,Bimbo A D,et al.3D Content-Based Retrieval with Spin Images // Proc of the IEEE International Conference on Multimedia and Expo.Taipei,China,2004: 771-774 [54] Dinh H Q,Kropac S.Multi-Resolution Spin-Images // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.New York,USA,2006: 863-870 [55] Zhong Y.Intrinsic Shape Signatures: A Shape Descriptor for 3D Object Recognition // Proc of the 12th IEEE International Conference on Computer Vision.Kyoto,Japan,2009: 689-696 [56] Stein F,Medioni G.Structural Indexing: Efficient 3D Object Recognition.IEEE Trans on Pattern Analysis and Machine Intelligence,1992,14(2): 125-145 [57] Dorai C,Jain A K.COSMOS: A Representation Scheme for 3D Free-Form Objects.IEEE Trans on Pattern Analysis and Matching Intelligence,1997,19(10): 1115-1130 [58] Hetzel G,Leibe B,Levi P,et al.3D Object Recognition from Range Images Using Local Feature Histograms // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Kauai,USA,2001: 394-399 [59] Zha H B,Nagata T,Kumamaru K.Determining Salient Feature Points of 3D Curved Surfaces from Range Images // Proc of the International Conference on Industrial Electronics,Control and Instrumentation.Kobe,Japan,1991: 1318-1323 [60] Shan Y,Matei B,Sawhney H S,et al.Linear Model Hashing and Batch RANSAC for Rapid and Accurate Object Recognition // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington,USA,2004: 121-128 [61] Johnson A.Surface Landmark Selection and Matching in Natural Terrain // Proc of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Hilton Head Island,USA,2000: 413-420
2012, Vol. 25 
