多特征融合的图像质量评价方法

doi:10.16451/j.cnki.issn1003-6059.201907011

摘要
图/表
参考文献(0)
相关文章 (15)

全文: PDF (737 KB) HTML (1 KB)
输出: BibTeX | EndNote (RIS)

摘要

为了规避图像质量评价中的视觉特征和池化策略难以选取和解释的问题,在提取参考图像和失真图像的多种底层特征的基础上,采用机器学习的方法自动预测真实图像质量,提出多特征融合的图像质量评价方法.针对参考图像和失真图像分别提取相位一致性、梯度、视觉显著性、对比度特征,计算4种特征的相似度图,提取相似度图的均值和方差特征,最后采用支持向量回归评价文中方法.在LIVE、CSIQ、TID2008和TID2013图像库上的实验表明,文中方法的主客观一致性较好.

	服务

	把本文推荐给朋友
	加入我的书架
	加入引用管理器
	E-mail Alert
	RSS
	作者相关文章
	贾惠珍
	王同罕
	傅鹏

关键词 ：底层特征相似度图, 统计特征, 池化, 支持向量机

Abstract：

To avoid the difficulties in choosing and explaining the visual features and pooling strategies in image quality assessment, a reference images quality assessment method based on multi-feature fusion is proposed. Various underlying features of reference and distorted images are extracted,and a machine learning method is applied to predict the quality of real images. Firstly, phase congruency, gradient, visual saliency and contrast of reference and distorted images are extracted. Then similarity maps of four features are calculated, respectively. The mean and variance characteristics of these similarity maps are extracted. Finally, the assessment model is learned by support vector regression. The experimental results on four benchmark databases demonstrate a high coherence between subjective and objective assessment by the proposed method.

Key words： Low-level Feature Similarity Map Statistical Features Pooling Support Vector Machine

收稿日期: 2018-11-28

ZTFLH:

TN 911.73

基金资助:

国家自然科学基金项目(No.61762004)、江西省教育厅科学技术研究项目(No. GJJ170455)、东华理工大学江西省放射性地学大数据技术工程实验室开放基金项目(No.JELRGBDT201702)、东华理工大学博士启动基金项目(No.DHBK2016119,DHBK2016120)资助

作者简介: 贾惠珍(通讯作者),博士,讲师,主要研究方向为图像处理、模式识别.E-mail:hzjianlg@126.com.王同罕,博士,讲师,主要研究方向为图像处理、模式识别.E-mail:thwang_seu@163.com.傅鹏,博士,讲师,主要研究方向为图像处理、模式识别.E-mail:fupeng@njust.edu.cn.

引用本文:

贾惠珍,王同罕,傅鹏. 多特征融合的图像质量评价方法[J]. 模式识别与人工智能, 2019, 32(7): 669-675. JIA Huizhen, WANG Tonghan, FU Peng. Multi-feature Fusion Based Image Quality Assessment Method. , 2019, 32(7): 669-675.

链接本文:

http://manu46.magtech.com.cn/Jweb_prai/CN/10.16451/j.cnki.issn1003-6059.201907011 或 http://manu46.magtech.com.cn/Jweb_prai/CN/Y2019/V32/I7/669

[1] WANG Z, BOVIK A C. Modern Image Quality Assessment. San Rafael, USA: Morgan & Claypool, 2006.
[2] WANG Z, BOVIK A C, LU L G. Why Is Image Quality Assessment so Difficult // Proc of the IEEE International Conference on Acoustics, Speech, and Signal Processing. Washington, USA: IEEE, 2002, IV: 3313-3316.
[3] WANG Z, BOVIK A C, SHEIKH H R, et al. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600-612.
[4] WANG Z, SIMONCELLI E P, BOVIK A C. Multiscale Structural Similarity for Image Quality Assessment // Proc of the IEEE Confe-rence Record of the 37th Asilomar Conference on Signals, Systems and Computers. Washington, USA: IEEE, 2003, II: 9-12.
[5] CHEN G H, YANG C L, XIE S L, et al. Gradient-Based Structural Similarity for Image Quality Assessment // Proc of the International Conference on Image Processing. Washington, USA: IEEE, 2006: 2929-2932.
[6] WANG Z, SIMONCELLI E P. Translation Insensitive Image Similarity in Complex Wavelet Domain // Proc of the IEEE International Conference on Acoustics, Speech, and Signal Processing. Washington, USA: IEEE, 2005, II: 573-576.
[7] LI C F, BOVIK A C. Three-Component Weighted Structural Similarity Index. Proc of SPIE, 2009, 7242. DOI: 10.1117/12.811821.
[8] WANG Z, LI Q. Information Content Weighting for Perceptual Image Quality Assessment. IEEE Transactions on Image Process, 2011, 20(5): 1185-1198.
[9] DAMERA-VENKATA N, KITE T D, GEISLER W S, et al. Image Quality Assessment Based on a Degradation Model. IEEE Transactions on Image Processing, 2000, 9(4): 636-650.
[10] CHANDLER D M, HEMAMI S S. VSNR: A Wavelet-Based Vi-sual Signal-to-Noise Ratio for Natural Images. IEEE Transactions on
Image Processing, 2007, 16(9): 2284-2298.
[11] SHEIKH H R, BOVIK A C, VECIANA D. An Information Fidelity Criterion for Image Quality Assessment Using Natural Scene Statistics. IEEE Transactions on Image Process, 2005, 14(12): 2117-2128.
[12] SHEIKH H R, BOVIK A C. Image Information and Visual Quality. IEEE Transactions on Image Process, 2006, 15(2): 430-444.
[13] LARSON E C, CHANDLER D M. Most Apparent Distortion: Full-Reference Image Quality Assessment and the Role of Strategy. Journal of Electronic Imaging, 2010, 19(1). DOI: 10.1117/1.3267105.
[14] ZHANG L, ZHANG L, MOU X Q, et al. FSIM: A Feature Similarity Index for Image Quality Assessment. IEEE Transactions on Image Processing, 2011, 20(8): 2378-2386.
[15] ZHANG L, SHEN Y, LI H Y. VSI: A Visual Saliency-Induced Index for Perceptual Image Quality Assessment. IEEE Transactions on Image Processing, 2014, 23(10): 4270-4281.
[16] LIU A M, LIN W S, NARWARIA M. Image Quality Assessment Based on Gradient Similarity. IEEE Transactions on Image Proce-ssing, 2012, 21(4): 1500-1512.
[17] XUE W F, ZHANG L, MOU X Q, et al. Gradient Magnitude Si-milarity Deviation: A Highly Efficient Perceptual Image Quality Index. IEEE Transactions on Image Processing, 2014, 23(2): 684-695.
[18] WANG T H, ZHANG L, JIA H Z, et al. Multiscale Contrast Similarity Deviation: An Effective and Efficient Index for Perceptual Image Quality Assessment. Signal Processing: Image Communication, 2016, 45: 1-9.
[19] PONOMARENKO N, IEREMEIEV O, LUKIN V, et al. Color Image Database TID2013: Peculiarities and Preliminary Results // Proc of the European Workshop on Visual Information Processing. Washington, USA: IEEE, 2013: 106-111.
[20] JEFFREY L. A Visual Discrimination Model for Imaging System Design and Evaluation // PELI E, ed. Visual Models for Target Detection and Recognition. Singapore, Singapore: World Scientific, 1995: 207-220.
[21] SAFRANEK R J, JOHNSTON J D. A Perceptually Tuned Sub-band Image Coder with Imaging Dependent Quantization and Post-Quantization Data Compression // Proc of the IEEE Conference on Acoustics, Speech, and Signal Processing. Washington, USA: IEEE, 1989: 1945-1948.
[22] HOU X D, ZHANG L Q. Saliency Detection: A Spectral Residual Approach // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2007. DOI: 10.1109/CVPR.2007.383267.
[23] KOVESI P. Image Features from Phase Congruency. Journal of Computer Vision, 1999, 1(3): 1-26.
[24] 贾惠珍,孙权森,王同罕.结合感知特征和自然场景统计的无参考图像质量评价.中国图象图形学报, 2014, 19(6): 859-867.
(JIA H Z, SUN Q S, WANG T H. Blind Image Quality Assessment Based on Perceptual Features and Natural Scene Statistics. Journal of Image and Graphics, 2014, 19(6): 859-867.)
[25] 吴帅,徐勇,赵东宁.基于深度卷积网络的目标检测综述.模式识别与人工智能, 2018, 31(4): 335-346.
(WU S, XU Y, ZHAO D N. Survey of Object Detection Based on Deep Convolutional Network. Pattern Recognition and Artificial Intelligence, 2018, 31(4): 335-346.)
[26] NGUYEN A, KIM J, OH H, et al. Deep Visual Saliency on Stere-oscopic Images. IEEE Transactions on Image Processing, 2019, 28(4): 1939-1953.
[27] BASAK D, PAL S, PATRANABIS D C. Support Vector Regression. Neural Information Processing, 2007, 11(10): 203-224.
[28] WANG T H, ZHANG L, JIA H Z. An Effective General-Purpose NR-IQA Model Using Natural Scene Statistics(NSS) of the Luminance Relative Order. Signal Processing(Image Communication), 2019, 71: 100-109.
[29] BREIMAN L. Random Forests. Machine Learning, 2001, 45(1): 5-32.
[30] TOMANDL D, SCHOBER A. A Modified General Regression Neural Network(MGRNN) with New, Efficient Training Algorithms as a Robust ′Black Box′-Tool for Data Analysis. Neural Networks, 2001, 14(8): 1023-1034.