Kinship Verification Based on Deep Convolutional Neural Network End-to-End Model
HU Zhengping1, GUO Zengjie1, WANG Meng1, SUN Degang2, REN Dawei1
1.Hebei Key Laboratory of Information Transmission and Signal Processing, School of Information Science and Engineering, Yanshan University, Qinghuangdao 066004 2.School of Electronic Information Engineering, Shandong Huayu University of Technology, Dezhou 253000
Abstract An algorithm based on deep convolutional neural network end-to-end model is proposed to solve the problem of kinship verification with facial image. Firstly, a deep convolutional neural network model is constructed. It consists of convolutional layers, fully connected layer and soft-max classification layer.The implicit features of parent-child images can be extracted by convolution layers. Then, the extracted latent features can be mapped into two-class classification problem of kin verification by fully connected layer, and the kinship relationship of samples can be directly determined by the soft-max classifier. Then, the paired tag training data are inputted into the network to be iterated and parameters of the deep network model are optimized until the loss curve is stable. Finally, the input image pairs are classified by the trained parameters, and the final accuracy is obtained by statistics. The experimental results on the KinFaceW-I database and KinFaceW-II dataset demonstrate the proposed convolutional neural network end-to-end model outperforms other kinship verification algorithms.
Fund:Supported by National Natural Science Foundation of China(No.61071199), Natural Science Foundation of Hebei Province(No.F2016203422)
About author:: (HU Zhengping(Corresponding author), Ph.D., professor. His research interests include pattern recognition and its applications.)(GUO Zengjie, master student. His research interests include image processing and pattern recognition.)(WANG Meng, Ph.D. candidate. Her research interests include pattern recognition.)(SUN Degang, master student. His research interests include software engineering.)(REN Dawei, master, senior engineer. His research interests include pattern recognition and information processing.)
[1] FANG R G, TANG K D, SNAVELY N, et al. Towards Computational Models of Kinship Verification // Proc of the 17th IEEE International Conference on Image Processing. Washington, USA: IEEE, 2010: 1577-1580. [2] ALIREZAZADEH P, FATHI A, ABDALI-MOHAMMADI F. A Genetic Algorithm Based Feature Selection for Kinship Verification. IEEE Signal Processing Letters, 2015, 22(12): 2459-2463. [3] YAN H B, LU J W, ZHOU X Z. Prototype-Based Discriminative Feature Learning for Kinship Verification. IEEE Transactions on Cybernetics, 2015, 45(11): 2535-2545. [4] LIU Q F, PUTHENPUTHUSSERY A, LIU C J. Inheritable Fisher Vector Feature for Kinship Verification // Proc of the 7th IEEE International Conference on Biometrics Theory, Applications and Systems. Washington, USA: IEEE, 2015. DOI: 10.1109/BTAS.2015.7358768. [5] DIBEKLIOGLU H, SALAH A A, GEVERS T. Like Father, Like Son: Facial Expression Dynamics for Kinship Verification // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2013: 1497-1504. [6] GUO G D, WANG X L. Kinship Measurement on Salient Facial Features. IEEE Transactions on Instrumentation & Measurement, 2012, 61(8): 2322-2325. [7] ZHOU X Z, LU J W, HU J L, et al. Gabor-Based Gradient Orientation Pyramid for Kinship Verification under Uncontrolled Environments // Proc of the 20th ACM International Conference on Multimedia. New York, USA: ACM, 2012: 725-728. [8] ZHOU X Z, HU J L, LU J W, et al. Kinship Verification from Facial Images under Uncontrolled Conditions // Proc of the 19th ACM International Conference on Multimedia. New York, USA: ACM, 2011: 953-956. [9] QIN X Q, TAN X Y, CHEN S C. Mixed Bi-subject Kinship Verification via Multi-view Multi-task Learning. Neurocomputing, 2016, 214: 350-357. [10] ZHOU X Z, SHANG Y Y, YAN H B, et al. Ensemble Similarity Learning for Kinship Verification from Facial Images in the Wild. Information Fusion, 2016, 32(12): 40-48. [11] ZHOU X Z, YAN H B, SHANG Y Y. Kinship Verification from Facial Images by Scalable Similarity Fusion. Neurocomputing, 2016, 197: 136-142. [12] LU J W, ZHOU X Z, TAN Y P, et al. Neighborhood Repulsed Metric Learning for Kinship Verification. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 36(2): 331-345. [13] XU M, SHANG Y Y. Kinship Verification Using Facial Images by Robust Similarity Learning[J/OL]. [2017-10-25]. https://www.hindawi.com/journals/mpe/2016/4072323. [14] YAN H B, LU J W, DENG W H, et al. Discriminative Multime-tric Learning for Kinship Verification. IEEE Transactions on Information Forensics and Security, 2014, 9(7): 1169-1178. [15] WANG M Y, LI Z C, SHU X B, et al. Deep Kinship Verification // Proc of the 17th IEEE International Workshop on Multimedia Signal Processing. Washington, USA: IEEE, 2015. DOI: 10.1109/MMSP.2005.7340820. [16] ZHANG K H, HUANG Y Z, SONG C F, et al. Kinship Verification with Deep Convolutional Neural Networks[C/OL]. [2017-10-25]. http://www.bmva.org/bmvc/2015/papers/paper148/paper148.pdf. [17] CHENG K Y, ZHAN Y Z, QI M. AL-DDCNN: A Distributed Crossing Semantic Gap Learning for Person Re-identification. Concurrency and Computation: Practice and Experience, 2017. DOI: 10.1002/cpe.3766. [18] CHENG K Y, XU F J, TAO F, et al. Data-Driven Pedestrian Re-identification Based on Hierarchical Semantic Representation. Concurrency and Computation: Practice and Experience, 2017, 9(12): 1-15. [19] CHOPRA S, HADSELL R, LECUN Y. Learning a Similarity Me-tric Discriminatively, with Application to Face Verification // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2005: 539-546. [20] BROMLEY J, GUYON I, LECUN Y. Signature Verification Using a "Siamese" Time Delay Neural Network // Proc of the 6th International Conference on Neural Information Processing System. San Francisco, USA: Morgan Kaufmann, 1994: 737-744. [21] ZAGORUYKO S, KOMODAKIS N. Learning to Compare Image Patches via Convolutional Neural Networks // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2005: 4353-4361. [22] YI D, LEI Z, LIAO S C, et al. Learning Face Representation from Scratch[J/OL]. [2017-10-25]. https://arxiv.org/pdf/1411.7923.pdf. [23] SZEGEDY C, LIU W, JIA Y Q, et al. Going Deeper with Convolutions[C/OL]. [2017-10-25]. https://arxiv.org/pdf/1409.4842.pdf. [24] SIMONYAN K, ZISSERMAN A. Very Deep Convolutional Networks for Large-Scale Image Recognition[C/OL]. [2017-10-25]. https://arxiv.org/pdf/1409.1556.pdf. [25] GLOROT X, BENGIO Y. Understanding the Difficulty of Training Deep Feedforward Neural Networks // Proc of the 13th International Conference on Artificial Intelligence and Statistics. New York, USA: ACM, 2010: 249-256. [26] QIN X Q, TAN X Y, CHEN S C. Tri-subject Kinship Verification: Understanding the Core of a Family. IEEE Transactions on Multimedia, 2015, 17(10): 1855-1867. [27] ZHANG J, SHAN S G, KAN M, et al. Coarse-to-Fine Auto-Encoder Networks(CFAN) for Real-Time Face Alignment // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2014: 1-16. [28] LU J W, HU J L, LIONG V E. The FG 2015 Kinship Verification in the Wild Evaluation // Proc of the IEEE International Confe-rence and Workshops on Automatic Face and Gesture Recognition. Washington, USA: IEEE, 2015. DOI: 10.1109/FG.2015.7163159.
2018, Vol. 31 
