人脸画像合成研究的综述与对比分析

doi:10.16451/j.cnki.issn1003-6059.201801004

摘要
图/表
参考文献(0)
相关文章 (4)

全文: PDF (1811 KB) HTML (1 KB)
输出: BibTeX | EndNote (RIS)

摘要

人脸画像合成通常是在给定一些训练画像-照片的前提下,将一张输入的人脸照片转换为画像的过程.目前并没有一个系统性的实验对比分析揭示当前此过程面临的挑战以及可能的解决思路.文中对具有代表性的各类方法进行综合深入对比与分析.人脸画像合成方法归纳为2类:数据驱动类方法(即基于样本的方法)和模型驱动类方法.数据驱动方法由3类方法组成:基于子空间学习的方法、基于稀疏表示的方法和基于贝叶斯推断的方法.模型驱动方法直接学习照片到画像的映射关系.文中给出一些之前文献中并未发现的有意义的结论和展望.

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	王楠楠
	李洁
	高新波

关键词 ：人脸画像, 模型驱动, 数据驱动

Abstract：

Face sketch synthesis refers to generating a sketch from an input face photo with some face sketch-photo pairs as the training set. An experimental study on the existing methods is nontrivial. The comprehensive review and the comparative study on representative face sketch synthesis methods are conducted. These methods are grouped into two categories: data-driven methods, also known as exemplar-based methods, and model-driven methods. Generally, data-driven face sketch synthesis consists of three sub-categories: subspace learning-based methods, sparse representation-based methods and Bayesian inference-based methods. Model-driven methods explicitly learn the mapping from face photos to face sketches. Some previously unknown conclusions are drawn as well.

Key words： Face Sketch Model Driven Data Driven

收稿日期: 2017-09-17

基金资助:

国家自然科学基金项目(No.61772402,61671339,61501339,61432014)、中国科协青年人才托举工程(No.2016QNRC001)资助

作者简介: 王楠楠(通讯作者),博士,副教授,主要研究方向为计算机视觉、模式识别、机器学习.E-mail:nnwang@xidian.edu.cn. 李洁,博士,教授,主要研究方向为模式识别、计算机视觉.E-mail:leejie@mail.xidian.edu.cn.高新波,博士,教授,主要研究方向为多媒体分析、机器学习、计算机视觉.E-mail:xbgao@mail.xidian.edu.cn.

引用本文:

王楠楠, 李洁, 高新波. 人脸画像合成研究的综述与对比分析[J]. 模式识别与人工智能, 2018, 31(1): 37-48. WANG Nannan, LI Jie, GAO Xinbo. A Review and Comparison Study on Face Sketch Synthesis. , 2018, 31(1): 37-48.

链接本文:

http://manu46.magtech.com.cn/Jweb_prai/CN/10.16451/j.cnki.issn1003-6059.201801004 或 http://manu46.magtech.com.cn/Jweb_prai/CN/Y2018/V31/I1/37

[1] 高新波,王楠楠,彭春蕾,等.基于三元空间融合的人脸图像模式识别.模式识别与人工智能, 2015, 28(9): 811-821.
(GAO X B, WANG N N, PENG C L, et al. Facial Image Pattern Recognition Based on Triple Space. Pattern Recognition and Artificial Intelligence, 2015, 28(9): 811-821.)
[2] 陈洪,郑南宁,徐迎庆,等.基于样本学习的人像线条画生成系统.软件学报, 2003, 14(2): 202-208.
(CHEN H, ZHENG N N, XU Y Q, et al. An Example-Based Facial Sketch Generation System. Journal of Software, 2003, 14(2): 202-208.)
[3] LI Y Z, KOBATAKE H. Extraction of Facial Sketch Based on Morphological Processing // Proc of the IEEE International Conference on Image Processing. Washington, USA: IEEE, 1997: 316-319.
[4] KOSHIMIZU H, TOMINAGA M, FUJIWARA T, et al. On KANSEI Facial Image Processing for Computerized Facial Caricaturing System PICASSO // Proc of the IEEE International Conference on Systems, Man, and Cybernetics. Washington, USA: IEEE, 1999: 294-299.
[5] TANG X O, WANG X G. Face Photo Recognition Using Sketches // Proc of the International Conference on Image Processing. Washington, USA: IEEE, 2002: 257-260.
[6] ROWEIS S T, SAUL L K. Nonlinear Dimensionality Reduction by Locally Linear Embedding. Science, 2000, 290(5500): 2323-2326.
[7] LIU Q S, TANG X O, JIN H L, et al. A Nonlinear Approach for Face Sketch Synthesis and Recognition // Proc of the IEEE Confe-rence on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2005: 1005-1010.
[8] GAO X B, WANG N N, TAO D C, et al. Face Sketch-Photo Synthesis and Retrieval Using Sparse Representation. IEEE Transactions on Circuits Systems for Video Technology, 2012, 22(8): 1213-1226.
[9] WANG N N, ZHU M R, LI J, et al. Data-Driven vs. Model-Dri-ven: Fast Face Sketch Synthesis. Neurocomputing, 2017, 257: 214-221.
[10] WANG X G, TANG X O. Face Photo-Sketch Synthesis and Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2009, 31(11): 1955-1967.
[11] ZHANG L L, LIN L, WU X, et al. End-to-End Photo-Sketch Generation via Fully Convolutional Representation Learning // Proc of the 5th ACM International Conference on Multimedia Retrieval. New York, USA: ACM, 2015: 627-634.
[12] WANG N N, TAO D C, GAO X B, et al. A Comprehensive Survey to Face Hallucination. International Journal of Computer Vision, 2014, 106(1): 9-30.
[13] 高新波,王楠楠.异质人脸图像合成 // 张长水,杨强,著.机器学习及其应用2013.北京:清华大学出版社, 2013: 77-91.
(GAO X B, WANG N N. Heterogeneous Facial Image Synthesis // ZHANG C S, YANG Q, eds. Machine Learning and Its Applications 2013. Beijing, China: Tsinghua University Press, 2013: 77-91.)
[14] WANG N N, ZHA W J, LI J, et al. Back Projection: An Effective Postprocessing Method for GAN-Based Face Sketch Synthesis. Pa-ttern Recognition Letters, 2017. DOI: 10.1016/j.patrec.2017.06.012.
[15] TANG X O, WANG X G. Face Sketch Synthesis and Recognition // Proc of the 9th IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2003: 687-694.
[16] TANG X O, WANG X G. Face Sketch Recognition. IEEE Transactions on Circuit Systems for Video Technology, 2004, 14(1): 50-57.
[17] WANG N N, GAO X B, LI J. Random Sampling for Fast Face Sketch Synthesis[C/OL]. [2017-10-23]. https://arxiv.org/pdf/1701.01911.pdf.
[18] DONOHO D L. For Most Large Underdetermined Systems of Linear Equations the Minimal l₁-norm Solution Is Also the Sparsest Solution. Communications on Pure and Applied Mathematics, 2006, 59(6): 797-826.
[19] CHANG L, ZHOU M Q, HAN Y J, et al. Face Sketch Synthesis via Sparse Representation // Proc of the 20th International Confe-rence on Pattern Recognition. Washington, USA: IEEE, 2010: 2146-2149.
[20] WANG N N, LI J, TAO D C, et al. Heterogeneous Image Transformation. Pattern Recognition Letters, 2013, 34(1): 77-84.
[21] LIU C, SHUM H Y, FREEMAN W. Face Hallucination: Theory and Practice. International Journal of Computer Vision, 2007, 75(1): 115-134.
[22] ZHANG S C, GAO X B, WANG N N, et al. Face Sketch Synthesis via Sparse Representation-Based Greedy Search. IEEE Transactions on Image Processing, 2015, 24(8): 2466-2477.
[23] ZHANG S C, GAO X B, WANG N N, et al. Robust Face Sketch Style Synthesis. IEEE Transactions on Image Processing, 2016, 25(1): 220-232.
[24] ZHANG S C, GAO X B, WANG N N, et al. Face Sketch Synthesis from a Single Photo-Sketch Pair. IEEE Transactions on Circuits and Systems for Video Technology, 2017, 27(2): 275-287.
[25] GAO X B, ZHONG J J, LI J, et al. Face Sketch Synthesis Algorithm Based on E-HMM and Selective Ensemble. IEEE Transac-tions on Circuit Systems for Video Technology, 2008, 18(4): 487-496.
[26] RABINER L R. A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition. Proceedings of the IEEE, 1989, 77(2): 257-286.
[27] NEFIAN A V, HAYES M. Face Recognition Using an Embedded HMM // Proc of the IEEE International Conference on Audio- and Video-Based Biometric Person Authentication. Washington, USA: IEEE, 1999: 19-24.
[28] GAO X B, ZHONG J J, TAO D C, et al. Local Face Sketch Synthesis Learning. Neurocomputing, 2008, 71(10/11/12): 1921-1930.
[29] YEDIDIA J S, FREEMAN W T, WEISS Y. Generalized Belief Propagation // DIETTERICH T G, BECKER S, GHAGRAMANI Z, eds. Advances in Neural Information Processing Systems 14. Cambridge, USA: The MIT Press, 2001: 689-695.
[30] EFROS A A, FREEMAN W T. Image Quilting for Texture Synthesis and Transfer // Proc of the 28th Annual Conference on Compu-ter Graphics and Interactive Techniques. New York, USA: ACM, 2001: 341-346.
[31] ZHANG W, WANG X G, TANG X O. Lighting and Pose Robust Face Sketch Synthesis // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2010: 420-433.
[32] LOWE D G. Distinctive Image Features from Scale-Invariant Keypoints. International Journal of Computer Vision, 2004, 60(2): 91-110.
[33] ZHOU H, KUANG Z H, WONG K K. Markov Weight Fields for Face Sketch Synthesis // Proc of the IEEE Conference on Compu-ter Vision and Pattern Recognition. Washington, USA: IEEE, 2012: 1091-1097.
[34] PENG C L, GAO X B, WANG N N, et al. Graphical Representation for Heterogeneous Face Recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(2): 301-312.
[35] WANG N N, TAO D C, GAO X B, et al. Transductive Face Sketch-Photo Synthesis. IEEE Transactions on Neural Networks and Learning Systems, 2013, 24(9): 1364-1376.
[36] PENG C L, GAO X B, WANG N N, et al. Multiple Representations-Based Face Sketch-Photo Synthesis. IEEE Transactions on Neural Networks and Learning Systems, 2016, 27(11): 2201-2215.
[37] ZHU M R, WANG N N, GAO X B, et al. Deep Graphical Feature Learning for Face Sketch Synthesis // Proc of the 26th Internatio-nal Joint Conference on Artificial Intelligence. New York, USA: ACM, 2017: 3574-3580.
[38] SIMONYAN K, ZISSERMAN A. Very Deep Convolutional Networks for Large-Scale Image Recognition[C/OL]. [2017-10-23]. https://arxiv.org/pdf/1409.1556.pdf.
[39] PENG C L, GAO X B, WANG N N, et al. Superpixel-Based Face Sketch-Photo Synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 2017, 27(2): 288-299.
[40] WANG N N, GAO X B, SUN L Y, et al. Bayesian Face Sketch Synthesis. IEEE Transactions on Image Processing, 2017, 26(3): 1264-1274.
[41] WANG N N, GAO X B, SUN L Y, et al. Anchored Neighborhood Index for Face Sketch Synthesis. IEEE Transactions on Circuits and Systems for Video Technology, 2017. DOI: 10.1109/TCSVT.2017.2709465.
[42] GOODFELLOW I J, POUGER-ABADIE J, MIRZA M, et al. Gen-erative Adversarial Nets[C/OL]. [2017-10-23]. https://arxiv.org/pdf/1406.2661v1.pdf.
[43] ISOLA P, ZHU J Y, ZHOU T H, et al. Image-to-Image Translation with Conditional Adversarial Networks[C/OL]. [2017-10-23]. https://arxiv.org/pdf/1611.07004v1.pdf.
[44] WANG N N, ZHA W J, LI J, et al. Back Projection: An Effective Postprocessing Method for GAN-Based Face Sketch Synthesis. Pa-ttern Recognition Letters, 2017. DOI: 10.1016/j.patrec.2017.06.012.
[45] PHILLIPS P J, MOON H, RIZVI S A, et al. The FERET Evaluation Methodology for Face Recognition Algorithms. IEEE Transac-
tions on Pattern Analysis and Machine Intelligence, 2000, 22(10): 1090-1104.
[46] WANG Z, BOVIK A C, SHEIKH H R, et al. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
[47] WANG N N, GAO X B, LI J, et al. Evaluation on Synthesized Face Sketches. Neurocomputing, 2016, 214: 991-1000.
[48] CHEN I F, LIAO H M, KO M, et al. A New LDA-Based Face Recognition System Which Can Solve the Small Sample Size Pro-blem. Pattern Recognition, 2000, 33(10): 1713-1726.