Abstract The performance of image super-resolution reconstruction networks is improved by deepening the depth.However,deepening the network makes the number of parameters increase rapidly,and thus it is hard to train the network and store the memory.To reduce the scale of the deep network and keep its reconstruction performance as much as possible,a concise recursive multi-scale convolutional network is proposed for super-resolution reconstruction based on the concepts of recursion and multi-scale.Firstly,the multi-scale module is employed to extract the features of the image with different scales.Then,the network is deepened by the recursive operation without increasing the number of network parameters.Finally,the outputs of each recursive operation are fused as the input for the reconstruction part.Experimental results show that the network parameters of the proposed method are fewer than those of some existing super-resolution methods with better reconstruction results.
Corresponding Authors:
ZHAO Jianwei,Ph.D,professor.Her research interests include intelligent computing and image processing.
About author:: GAO Qingqing,master student.Her research interests include intelligent computing and image processing;ZHOU Zhenghua,Ph.D,associate profe-ssor.His research interests include intelligent computing and image processing.
[1] SHI W Z,CABALLERO J,LEDIG C,et al.Cardiac Image Super-Resolution with Global Correspondence Using Multi-atlas PatchMatch//Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention.Berlin,Germany:Springer,2013:9-16. [2] YILDIRIM D,GÜNGÖR O.A Novel Image Fusion Method Using IKONOS Satellite Images.Journal of Geodesy and Geoinformation,2012,1(1):27-34. [3] ZHANG L,WU X L.An Edge-Guided Image Interpolation Algorithm via Directional Filtering and Data Fusion.IEEE Transactions on Image Processing,2006,15(8):2226-2238. [4] ZHANG K B,GAO X B,TAO D C,et al.Single Image Super-Re-solution with Non-local Means and Steering Kernel Regression.IEEE Transactions on Image Processing,2012,21(11):4544-4556. [5] DONG C,LOY C C,HE K M,et al.Learning a Deep Convolutio-nal Network for Image Super-Resolution//Proc of the European Conference on Computer Vision.Berlin,Germany:Springer,2014:184-199. [6] KIM J,LEE J K,LEE K M.Accurate Image Super-Resolution Using Very Deep Convolutional Networks//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2016:1646-1654. [7] HE K M,ZHANG X Y,REN S Q,et al.Deep Residual Learning for Image Recognition//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE, 2016:770-778. [8] LIM B,SON S,KIM H,et al. Enhanced Deep Residual Networks for Single Image Super-Resolution//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2017:1132-1140. [9] ZHANG Y L,LI K P,LI K,et al.Image Super-Resolution Using Very Deep Residual Channel Attention Networks//Proc of the European Conference on Computer Vision.Berlin,Germany:Sprin-ger,2018:294-310. [10] ZHANG Y L,TIAN Y P,KONG Y,et al. Residual Dense Network for Image Super-Resolution//Proc of the IEEE/CVF Confe-rence on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2018:2472-2481. [11] KIM J,LEE J K,LEE K M.Deeply-Recursive Convolutional Network for Image Super-Resolution//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2016:1637-1645. [12] TAI Y,YANG J,LIU X M.Image Super-Resolution via Deep Recursive Residual Network//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2017:2790-2798. [13] LI J C,FANG F M,MEI K F,et al.Multi-scale Residual Network for Image Super-Resolution//Proc of the European Conference on Computer Vision.Berlin,Germany:Springer,2018:527-542. [14] SHI W Z,CABALLERO J,HUSZÁR F,et al.Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-pixel Convolutional Neural Network//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2016:1874-1883. [15] KINGMA D P,BA J L.ADAM:A Method for Stochastic Optimization[CB/OL].[2020-06-07].http://de.arxiv.org/pdf/1412.6980. [16] TIMOFTE R,AGUSTSSON E,VAN GOOL L,et al.NTIRE 2017 Challenge on Single Image Super-Resolution:Methods and Results//Proc of the IEEE Conference on Computer Vision and Pattern Recognition Workshops.Washington,USA:IEEE,2017:1110-1121. [17] BEVILACQUA M,ROUMY A,GUILLEMOT C,et al.Low-Com-plexity Single-Image Super-Resolution Based on Nonnegative Neigh-bor Embedding//Proc of the British Machine Vision Conference.Bristol,UK:BMVA Press,2012:135.1-135.10. [18] ZEYDE R,ELAD M,PROTTER M.On Single Image Scale-up Using Sparse-Representations//Proc of the International Confe-rence on Curves and Surfaces.Berlin,Germany:Springer,2010:711-730. [19] ARBELÁEZ P,MAIRE M,FOWLKES C,et al.Contour Detection and Hierarchical Image Segmentation.IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(5):898-916. [20] HUANG J B,SINGH A,AHUJA N.Single Image Super-Resolution from Transformed Self-exemplars//Proc of the IEEE Confe-rence on Computer Vision and Pattern Recognition.Washington,USA:IEEE, 2015:5197-5206. [21] MATSUI Y,ITO K,ARAMAKI Y,et al. Sketch-Based Manga Retrieval Using Manga109 Dataset.Multimedia Tools and Applications,2017,76(20):21811-21838. [22] WANG Z,BOVIK A C,SHEIKH H R,et al. Image Quality Assessment:From Error Visibility to Structural Similarity.IEEE Transactions on Image Processing,2004,13(4):600-612. [23] TIMOFTE R,DE SMET V,VAN GOOL L.A+:Adjusted Anchored Neighborhood Regression for Fast Super-Resolution//Proc of the Asian Conference on Computer Vision.Berlin,Germany:Springer,2014:111-126. [24] DONG C,LOY C C,TANG X O.Accelerating the Super-Resolution Convolutional Neural Network//Proc of the European Conference on Computer Vision.Berlin,Germany:Springer,2016:391-407. [25] LAI W S,HUANG J B,AHUJN N,et al.Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolution//Proc of the IEEE Conference on Computer Vision and Pattern Recognition.Washington,USA:IEEE,2017:5835-5843. [26] TAI Y,YANG J,LIU X M,et al.MemNet:A Persistent Memory Network for Image Restoration//Proc of the IEEE International Conference on Computer Vision.Washington,USA:IEEE,2017:4549-4557.
2020, Vol. 33 
