Abstract Aiming at the problems of high noise and color distortion in Retinex-Net algorithm, a low-light image enhancement algorithm based on improved Retinex-Net is proposed grounded on the decomposition-enhancement framework of Retinex-Net. Firstly, a decomposition network composed of shallow upper and lower sampling structure is designed to decompose the input image into reflection component and illumination component. In this process, the denoising loss is added to suppress the noise generated during the decomposition process. Secondly, the attention mechanism module and color loss are introduced into the enhancement network to enhance the brightness of the illumination component and meanwhile reduce the image color distortion. Finally, the reflection component and the enhanced illumination component are fused into the normal illumination image to output. The experimental results show that the proposed algorithm improves the image brightness effectively with the noise of enhanced image reduced.
Fund:National Natural Science Foundation of China(No.62076075)
Corresponding Authors:
HU Xiao, Ph.D., professor. His research interests include computer vision, artificial intelligence and intelligent video analysis.
About author:: OU Jiamin, master student. Her research interests include computer vision and image processing. YANG Jiaxin, master student. His research interests include deep learning and salient object detection.
[1] HU X, MA P R, MAI Z H, et al. Face Hallucination from Low Quality Images Using Definition-Scalable Inference. Pattern Reco-gnition, 2019, 94: 110-121. [2] 陈 琴,朱 磊,后云龙,等.基于深度中心邻域金字塔结构的显著目标检测.模式识别与人工智能, 2020, 33(6): 496-506. (CHEN Q, ZHU L, HOU Y L, et al. Salient Object Detection Based on Deep Center-Surround Pyramid. Pattern Recognition and Artificial Intelligence, 2020, 33(6): 496-506.) [3] 杨兴明,范楼苗.基于区域特征融合网络的群组行为识别.模式识别与人工智能, 2019, 32(12): 1116-1121. (YANG X M, FAN L M. Group Activity Recognition Based on Regional Feature Fusion Network. Pattern Recognition and Artificial Intelligence, 2019, 32(12): 1116-1121.) [4] CHENG H D, SHI X J. A Simple and Effective Histogram Equalization Approach to Image Enhancement. Digital Signal Processing, 2004, 14(2): 158-170. [5] ABDULLAH-AI-WADUD M, KABIR M H, DEWAN M A A, et al. A Dynamic Histogram Equalization for Image Contrast Enhancement. IEEE Transactions on Consumer Electronics, 2007, 53(2): 593-600. [6] LAND E H. The Retinex Theory of Color Vision. Scientific American, 1977, 237(6): 108-128. [7] JOBSON D J, RAHMAN Z, WOODELL G A. Properties and Performance of a Center/Surround Retinex. IEEE Transactions on Image Processing, 1997, 6(3): 451-462. [8] JOBSON D J, RAHMAN Z, WOODELL G A. A Multiscale Retinex for Bridging the Gap between Color Images and the Human Observation of Scenes. IEEE Transactions on Image Processing, 1997, 6(7): 965-976. [9] WANG S H, ZHENG J, HU H M, et al. Naturalness Preserved Enhancement Algorithm for Non-uniform Illumination Images. IEEE Transactions on Image Processing, 2013, 22(9): 3538-3548. [10] FU X Y, ZENG D L, HUANG Y, et al. A Weighted Variational Model for Simultaneous Reflectance and Illumination Estimation // Proc of the IEEE Conference on Computer Vision and Pattern Re-cognition. Washington, USA: IEEE, 2016: 2782-2790. [11] GUO X J, LI Y, LING H B. LIME: Low-Light Image Enhancement via Illumination Map Estimation. IEEE Transactions on Image Processing, 2017, 26(2): 982-993. [12] FUKUSHIMA K. Neocognitron: A Self-organizing Neural Network Model for a Mechanism of Pattern Recognition Unaffected by Shift in Position. Biological Cybernetics, 1980, 36: 193-202. [13] LORE K G, AKINTAYO A, SARKAR S. LLNet: A Deep Autoencoder Approach to Natural Low-Light Image Enhancement. Pattern Recognition, 2017, 61: 650-662. [14] LÜ F F, LU F, WU J H, LIM C S. MBLLEN: Low-Light Image/Video Enhancement Using CNNs[C/OL]. [2020-05-11]. http://www.bmva.org/bmvc/2018/contents/papers/0700.pdf. [15] ZHANG Y, DI X G, ZHANG B, et al. Self-supervised Image Enhancement Network: Training with Low Light Images Only[C/OL]. [2020-05-11]. https://arxiv.org/pdf/2002.11300.pdf. [16] WEI C, WANG W J, YANG W H, et al. Deep Retinex Decomposition for Low-Light Enhancement [C/OL]. [2020-05-11]. https: //arxiv.org/pdf/1808.04560.pdf. [17] ZHANG Y H, ZHANG J W, GUO X J. Kindling the Darkness: A Practical Low-Light Image Enhancer // Proc of the 27th ACM International Conference on Multimedia. New York, USA: ACM, 2019: 1632-1640. [18] AI S, KWON J. Extreme Low-Light Image Enhancement for Surveillance Cameras Using Attention U-Net. Sensors, 2020, 20(2): 495-505. [19] IGNATOV A, KOBYSHEV N, TIMOFTE R, et al. DSLR-Quality Photos on Mobile Devices with Deep Convolutional Networks // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2017: 3297-3305. [20] TIKHONOV A N, ARSENIN V Y. Solutions of Ill-Posed Pro-blems. SIAM Review, 1979, 21(2): 266-267. [21] ZHAO H, GALLO O, FROSIO I, et al. Loss Functions for Image Restoration with Neural Networks. IEEE Transactions on Computational Imaging, 2017, 3(1): 47-57. [22] RUDIN L I, OSHER S, FATEMI E. Nonlinear Total Variation Based Noise Removal Algorithms. Physica D(Nonlinear Phenomena), 1992, 60(1/2/3/4): 259-268. [23] PARK S, YU S, MOON B, et al. Low-Light Image Enhancement Using Variational Optimization-Based Retinex Model. IEEE Tran-sactions on Consumer Electronics, 2017, 63(2): 178-184. [24] WANG W J, WEI C, YANG W H, et al. GLADNet: Low-Light Enhancement Network with Global Awareness // Proc of the 13th IEEE International Conference on Automatic Face and Gesture Recognition. Washington, USA: IEEE, 2018: 751-755. [25] JIANG Y F, GONG X Y, LIU D, et al. EnlightenGAN: Deep Light Enhancement without Paired Supervision[C/OL]. [2020-05-11]. https://arxiv.org/pdf/1906.06972v1.pdf. [26] WANG Z, BOVIK A C, SHEIKH H R, et al. Image Quality Assessment: From Error Visibility to Structural Similarity. IEEE Transactions on Image Processing, 2004, 13(4): 600-612. [27] MITTAL A, SOUNDARARAJAN R, BOVIK A C. Making a "Com-pletely Blind" Image Quality Analyzer. IEEE Signal Processing Letters, 2013, 20(3): 209-212. [28] WANG Z, BOVIK A C. A Universal Image Quality Index. IEEE Signal Process, 2002, 9(3): 81-84. [29] VENKATANATH N, PRANEETH D, MARUTHI C B, et al. Blind Image Quality Evaluation Using Perception Based Features // Proc of the 21st National Conference on Communications. Washington, USA: IEEE, 2015. DOI: 10.1109/NCC.2015.7084843. [30] ZHANG L, ZHANG L, MOU X Q, et al. A Comprehensive Evaluation of Full Reference Image Quality Assessment Algorithms // Proc of the 19th IEEE International Conference on Image Proce- ssing. Washington, USA: IEEE, 2012: 1477-1480. [31] WANG Z, BOVIK A C, LU L G. Why Is Image Quality Asse-ssment so Difficult // Proc of the IEEE International Conference on Acoustics, Speech, and Signal Processing. Washington, USA: IEEE, 2002, IV: 3313-3316.
2021, Vol. 34 
