1. School of Mathematics, Northwest University, Xi′an 710127 2. Hepatobiliary Surgery, First Affiliated Hospital, Xi′an Jiaotong University, Xi′an 710061 3. School of Information Science and Technology, Northwest University, Xi′an 710127
Abstract Due to the high anatomical variability of pancreas, it is difficult for automated segmentation algorithms to achieve accurate localization of the target. To solve this problem, an encoder-decoder network embedded with compressive sampling is proposed. By training the network in different stages, the segmentation network can cascade the prior knowledge of pancreas location perceived from the label space in the pre-trained stage. Thus, the precise positioning of the pancreas is realized and the consistency between the segmentation result and the label is ensured. The experimental results of pancreas segmentation show that the performance of the proposed network is better.
Fund:Major Program of National Natural Science Foundation of China(No.81727802), Young Scientists Fund of National Natural Science Foundation of China (No. 61701404), Natural Science Foundation of Shaanxi Province of China(No.2020JM-438,2019JM-494), The Special Scientific Research Foundation of Shaanxi Provincial Education Department of China(No.17JK0769)
Corresponding Authors:
ZHANG Min, Ph.D., associate professor. Her research interests include artificial intelligence, computer vision and medical image processing.
About author:: XU Qiangqiang, master student. His research interests include machine learning and medical image segmentation. ZHANG Min(Corresponding author), Ph.D., associate professor. Her research interests include artificial intelligence, computer vision and medical image processing. REN Fenggang, Ph.D. candidate. His research interests include medical engineering combined with surgical technology innovation and tumor electromagnetic physical ablation technology. LÜ Yi, Ph.D., professor. His research interests include surgical treatment of hepato-biliary-pancreatic tumor. FENG Jun, Ph.D., professor. Her research interests include medical image processing, artificial intelligence, pattern recognition and multimedia system.
[1] 张荣国,姚晓玲,赵 建,等.融入局部几何特征的流行谱聚类图像分割.模式识别与人工智能, 2020, 33(4): 313-324. (ZHANG R G, YAO X L, ZHAO J, et al. Manifold Spectral Clu-stering Image Segmentation Algorithm Based on Local Geometry Features. Pattern Recognition and Artificial Intelligence, 2020, 33(4): 313-324.) [2] 张大明,张学勇,李 璐,等.利用广义信息熵谱选择的图像分割.模式识别与人工智能, 2019, 32(3): 225-236. (ZHANG D M, ZHANG X Y, LI L, et al. Image Segmentation Using Generalized Information Entropy for Eigenvector Selection. Pattern Recognition and Artificial Intelligence, 2019, 32(3): 225-236.) [3] JIMENEZ-DEL-TORO O, MÜLLER H, KRENN M, et al. Cloud-Based Evaluation of Anatomical Structure Segmentation and Landmark Detection Algorithms: Visceral Anatomy Benchmarks. IEEE Transaction on Medical Imaging, 2016, 35(11): 2459-2475. [4] FARAG A, LU L, TURKBEY E, et al. A Bottom-Up Approach for Automatic Pancreas Segmentation in Abdominal CT Scans // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2014: 103-113. [5] ZHENG Q, DELINGETTE H, DUCHATEAU N, et al. 3-D Consistent and Robust Segmentation of Cardiac Images by Deep Learning with Spatial Propagation. IEEE Transactions on Medical Imaging, 2018, 37(9): 2137-2148. [6] ZHAO T Y, GAO D H, WANG J, et al. Lung Segmentation in CT Images Using a Fully Convolutional Neural Network with Multi-instance and Conditional Adversary Loss // Proc of the 15th International Symposium on Biomedical Imaging. Washington, USA: IEEE, 2018: 505-509. [7] MANSOOR A, BAGCI U, XU Z Y, et al. A Generic Approach to Pathological Lung Segmentation. IEEE Transactions on Medical Imaging, 2014, 33(12): 2293-2310. [8] HEINRICH M P, BLENDOWSKI M. Multi-organ Segmentation Using Vantage Point Forests and Binary Context Features // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2016: 598-606. [9] CUINGNET R, PREVOST R, LESAGE D, et al. Automatic Detection and Segmentation of Kidneys in 3D CT Images Using Random Forests // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2012: 66-74. [10] WOLZ R, CHU C W, MISAWA K, et al. Automated Abdominal Multi-organ Segmentation with Subject-Specific Atlas Generation. IEEE Transactions on Medical Imaging, 2013, 32(9): 1723-1730. [11] CHRIST P F, ELSHAER M E A, ETTLINGER F, et al. Automa-tic Liver and Lesion Segmentation in CT Using Cascaded Fully Convolutional Neural Networks and 3d Conditional Random Fields // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2016: 415-423. [12] ROTH H R, LU L, FARAG A, et al. DeepOrgan: Multi-level Deep Convolutional Networks for Automated Pancreas Segmentation // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Sprin-ger, 2015: 556-564. [13] ROTH H R, LU L, FARAG A, et al. Spatial Aggregation of Holistically-Nested Networks for Automated Pancreas Segmentation // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2016: 451-459. [14] ROTH H R, LU L, LAY N, et al. Spatial Aggregation of Holistically-Nested Convolutional Neural Networks for Automated Pancreas Localization and Segmentation. Medical Image Analysis, 2018, 45: 94-107. [15] ZHOU Y Y, XIE L X, SHEN W, et al. A Fixed-Point Model for Pancreas Segmentation in Abdominal CT Scans // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2017: 693-701. [16] MA J T, LIN F, WESARG S, et al. A Novel Bayesian Model Incorporating Deep Neural Network and Statistical Shape Model for Pancreas Segmentation // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2018: 480-487. [17] ZHAO N N, TONG N, RUAN D, et al. Fully Automated Pancreas Segmentation with Two-Stage 3D Convolutional Neural Networks // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2019: 201-209. [18] FANG C W, LI G B, PAN C W, et al. Globally Guided Progre-ssive Fusion Network for 3D Pancreas Segmentation // Proc of the International Conference on Medical Image Computing and Compu-ter-Assisted Intervention. Berlin, Germany: Springer, 2019: 210-218. [19] MAN Y Z, HUANG Y S B, FENG J Y, et al. Deep Q Learning Driven CT Pancreas Segmentation with Geometry-Aware U-Net. IEEE Transactions on Medical Imaging, 2019, 38(8): 1971-1980. [20] LI F Y, LI W S, SHU Y C, et al. Multiscale Receptive Field Based on Residual Network for Pancreas Segmentation in CT Images. Biomedical Signal Processing and Control, 2020, 57. DOI: 10.1016/j.bspc.2019.101828. [21] ZHAO Y, LI H W, WAN S H, et al. Knowledge-Aided Convolutional Neural Network for Small Organ Segmentation. IEEE Journal of Biomedical and Health Informatics, 2019, 23(4): 1363-1373. [22] YANG Z Z, ZHANG L, ZHANG M, et al. Pancreas Segmentation in Abdominal CT Scans Using Inter-/Intra-Slice Contextual Information with a Cascade Neural Network // Proc of the 41st Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Washington, USA: IEEE, 2019: 5937-5940. [23] ZHU Z T, XIA Y D, SHEN W, et al. A 3D Deep Coarse-to-Fine Framework for Volumetric Medical Image Segmentation // Proc of the International Conference on 3D Vision. Washington, USA: IEEE, 2018: 682-690. [24] LIU Y J, LIU S. U-Net for Pancreas Segmentation in Abdominal CT Scans [C/OL]. [2020-05-13]. http://perfectroc.com/publication/Yijun_ISBI181page_final.pdf. [25] NING Y, HAN Z Y, ZHONG L, et al. DRAN: Deep Recurrent Adversarial Network for Automated Pancreas Segmentation. IET Image Process, 2020, 14(6): 1091-1100. [26] GAO H Y, YUAN H, WANG Z Y, et al. Pixel Transposed Convolutional Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2020, 42(5): 1218-1227. [27] ZEILER M D, KRISHNAN D, TAYLOR G W, et al. Deconvolutional networks // Proc of the IEEE Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2010: 2528-2535. [28] ZEILER M D, TAYLOR G W, FERGUS R. Adaptive Deconvolutional Networks for Mid and High Level Feature Learning // Proc of the IEEE International Conference on Computer Vision. Washington, USA: IEEE, 2011: 2018-2025. [29] NOH H, HONG S, HAN B. Learning Deconvolution Network for Semantic Segmentation // Proc of the IEEE International Confe-rence on Computer Vision. Washington, USA: IEEE, 2015: 1520-1528. [30] RONNEBERGER O, FISCHER P, BROX T. U-Net: Convolutional Networks for Biomedical Image Segmentation // Proc of the International Conference on Medical Image Computing and Computer-Assisted Intervention. Berlin, Germany: Springer, 2015: 234-241. [31] YU Q H, XIE L X, WANG Y, et al. Recurrent Saliency Transformation Network: Incorporating Multi-stage Visual Cues for Small Organ Segmentation // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2018: 8280-8289. [32] CHEN L C, ZHU Y K, PAPANDREOU G, et al. Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentation // Proc of the European Conference on Computer Vision. Berlin, Germany: Springer, 2018: 833-851. [33] DING H H, JIANG X D, LIU A Q, et al. Boundary-Aware Feature Propagation for Scene Segmentation // Proc of the IEEE/CVF International Conference on Computer Vision. Washington, USA: IEEE, 2019: 6818-6828. [34] CHEN L C, PAPANDREOU G, KOKKINOS I, et al. DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFs. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2018, 40(4): 834-848. [35] TIAN Z, HE T, SHEN C H, et al. Decoders Matter for Semantic Segmentation: Data-Dependent Decoding Enables Flexible Feature Aggregation // Proc of the IEEE/CVF Conference on Computer Vision and Pattern Recognition. Washington, USA: IEEE, 2019: 3121-3130.
2021, Vol. 34 
