华南理工大学学报(自然科学版) >

2025 , Vol. 53 >Issue 5: 94 - 108

DOI: https://doi.org/10.12141/j.issn.1000-565X.240439

计算机科学与技术

基于多尺度特征融合与重构卷积的肝肿瘤图像分割方法

  • 马金林 ,
  • 酒志青 ,
  • 马自萍 ,
  • 夏明格 ,
  • 张凯 ,
  • 程叶霞 ,
  • 马瑞士
展开
  • 1.北方民族大学 图形图像智能信息处理国家民委重点实验室，宁夏 银川 750021
    2.北方民族大学 计算机科学与工程学院，宁夏 银川 750021
    3.北方民族大学 数学与信息科学学院，宁夏 银川 750021
    4.中国移动通信有限公司，北京 100033
马金林（1976—），男，博士，副教授，主要从事计算机视觉、图像识别、计算机图形学等研究。E-mail： 624160@qq.com
酒志青（2000—），女，硕士生，主要从事图像识别研究。E-mail： 2313795280@qq.com

收稿日期: 2024-09-02

  网络出版日期: 2024-12-01

基金资助

国家自然科学基金项目(62462001);宁夏回族自治区自然科学基金项目(2024AAC03147);北方民族大学中央高校基本科研业务费专项资金项目(2023ZRLG02);宁夏回族自治区高等学校科学研究项目(NYG2024066)

收起

A Liver Tumor Image Segmentation Method Based on Multi-Scale Feature Fusion and Reconstruction Convolution

  • MA Jinlin ,
  • JIU Zhiqing ,
  • MA Ziping ,
  • XIA Mingge ,
  • ZHANG Kai ,
  • CHENG Yexia ,
  • MA Ruishi
Expand
  • 1.Key Laboratory of Intelligent Information Processing of Image and Graphics，North Minzu University，Yinchuan 750021，Ningxia，China
    2.School of Computer Science and Engineering，North Minzu University，Yinchuan 750021，Ningxia，China
    3.School of Mathematics and Information Science，North Minzu University，Yinchuan 750021，Ningxia，China
    4.China Mobile Communications Corporation，Beijing 100033，China
马金林（1976—），男，博士，副教授，主要从事计算机视觉、图像识别、计算机图形学等研究。E-mail： 624160@qq.com

Received date: 2024-09-02

  Online published: 2024-12-01

Supported by

the National Natural Science Foundation of China(62462001);the Natural Science Foundation of Ningxia Hui Autonomous Region(2024AAC03147)

Fold

摘要

针对肝肿瘤图像特征表达能力不足和全局上下文信息传递受限的问题，该文提出一种基于改进U-Net的肝肿瘤图像分割方法。首先，设计了一种低秩重构卷积来优化传统卷积运算所导致的大量参数问题，并用其构建使用残差结构改进编解码器的卷积核重构模块，使编码器保留更多的细节信息，并使解码器能更有效地恢复信息，以提升肝肿瘤图像特征的表达能力。然后，为丰富全局上下文信息的传递，设计了三分支空间金字塔池化模块来优化瓶颈结构的信息传递，打破单一路径的限制。接着，设计了多尺度特征融合模块来优化编码器信息的复用机制，增强模型对全局上下文信息的建模能力，并提升其在提取不同尺度肝肿瘤图像特征时的效能。最后，在LiTS2017和3DIRCADb数据集上对该文方法的性能进行了测试。实验结果表明：在LiTS2017数据集上的肝脏图像分割任务中，该文方法的Dice系数和IoU值分别达97.56%和95.25%，在肝肿瘤图像分割任务中的Dice系数和IoU值分别达89.71%和81.58%；在3DIRCADb数据集上的肝脏图像分割任务中，该文方法的Dice系数和IoU值分别达97.63%和95.39%，在肝肿瘤图像分割任务中的Dice系数和IoU值分别达89.62%和81.63%。

关键词： 肝肿瘤图像分割; 卷积核重构; 空间金字塔池化; 多尺度特征融合

本文引用格式

马金林 , 酒志青 , 马自萍 , 夏明格 , 张凯 , 程叶霞 , 马瑞士 . 基于多尺度特征融合与重构卷积的肝肿瘤图像分割方法[J]. 华南理工大学学报(自然科学版), 2025 , 53(5) : 94 -108 . DOI: 10.12141/j.issn.1000-565X.240439

Abstract

Aiming at the problem of insufficient expression ability of liver tumor image features and limited global contextual information transmission, an improved U-Net liver tumor image segmentation method is proposed. Firstly, a low-rank reconstruction convolution is designed to optimize the large number of parameter problems caused by traditional convolution operations, and is used to construct a convolution kernel reconstruction module that uses residual structure to improve the encoder decoder, so that the encoder retains more detailed information and the decoder recovers information more effectively, thereby enhancing the expression ability of liver tumor image features. Then, to enrich the transmission of global contextual information, a three-branch spatial pyramid pooling module is designed to optimize the bottleneck structure of information transmission and to break the limitation of a single path. Secondly, a multi-scale feature fusion module is designed to optimize the reuse mechanism of encoder information, enhance the modeling ability of the model for global contextual information, and improve its efficiency in extracting liver tumor image features in different scales. Finally, the performance of the proposed method is tested on LiTS2017 and 3DIRCADb datasets. Experimental results show that the method achieves a Dice coefficient and an IoU value of 97.56% and 95.25% in the liver image segmentation task on LiTS2017 dataset, and 89.71% and 81.58% in the liver tumor image segmentation task. Moreover, the Dice coefficient and IoU value in the liver image segmentation task on 3DIRCADb dataset respectively reach 97.63% and 95.39%, while respectively reach 89.62% and 81.63% in the liver tumor image segmentation task.

Key words： liver tumor image segmentation; convolutional kernel reconstruction; spatial pyramid pooling; multi-scale feature fusion

参考文献

1 RONNEBERGER O， FISCHER P， BROX T ．U-Net：convolutional networks for biomedical image segmentation［C］?∥Proceedings of the 18th International Conference on Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015．Munich：Springer International Publishing，2015：234-241．
2 LV P， WANG J， ZHANG X，et al ．Deep supervision and atrous inception-based U-Net combining CRF for automatic liver segmentation from CT［J］．Scientific Reports，2022，12（1）：16995/1-14．
3 GUO C， SZEMENYEI M， YI Y，et al ．SA-UNet：spatial attention U-Net for retinal vessel segmentation［C］?∥Proceedings of 2020 25th International Conference on Pattern Recognition．Milan：IEEE，2021：1236-1242．
4 CAI Z， XIN J， SHI P，et al ．DSTUNet： UNet with efficient dense SWIN transformer pathway for medical image segmentation［C］?∥Proceedings of 2022 IEEE 19th International Symposium on Biomedical Imaging．Kolkata：IEEE，2022：1-5．
5 KIRAN I， RAZA B， IJAZ A，et al ．DenseRes-UNet： segmentation of overlapped/clustered nuclei from multi organ histopathology images［J］．Computers in Bio-logy and Medicine，2022，143：105267/1-15．
6 ANSARI M Y， YANG Y， BALAKRISHNAN S，et al ．A lightweight neural network with multiscale feature enhancement for liver CT segmentation［J］．Scientific reports，2022，12（1）：14153/1-12．
7 ?ZCAN F， U?AN O N， KARA?AM S，et al ．Fully automatic liver and tumor segmentation from CT image using an AIM-Unet［J］．Bioengineering，2023，10（2）：215/1-21．
8 AMER A， LAMBROU T， YE X ．MDA-Unet： a multi-scale dilated attention U-Net for medical image segmentation［J］．Applied Sciences，2022，12（7）：3676/1-18．
9 IBTEHAZ N， KIHARA D ．ACC-UNet： a completely convolutional UNet model for the 2020s［C］?∥Proceedings of the International Conference on Medical Image Computing and Computer-Assisted Intervention．Cham：Springer Nature Switzerland，2023：692-702．
10 KONAR D， BHATTACHARYYA S， GANDHI T K，et al ．3-D quantum-inspired self-supervised tensor network for volumetric segmentation of medical images［J］．IEEE Transactions on Neural Networks and Learning Systems，2024，35（8）：10312-10325．
11 SELVAN R， DAM E B， PETERSEN J ．Segmenting two-dimensional structures with strided tensor networks［C］?∥Proceedings of the 27th International Conference on Information Processing in Medical ImagingVirtual Event：Springer International Publishing，2021：401-414．
12 DENTON E L， ZAREMBA W， BRUNA J，et al ．Exploiting linear structure within convolutional networks for efficient evaluation［C］?∥Proceedings of the Confe-rence on Advances in Neural Information Processing Systems．Montreal：MIT Press，2014：1269-1277．
13 CHENG Z， LI B， FAN Y，et al ．A novel rank selection scheme in tensor ring decomposition based on reinforcement learning for deep neural networks［C］?∥Proceedings of 2020 IEEE International Conference on Acoustics，Speech and Signal Processing （ICASSP）．Barcelona：IEEE，2020：3292-3296．
14 LIU Y， NG M K ．Deep neural network compression by tucker decomposition with nonlinear response［J］．Knowledge-Based Systems，2022，241：108171/1-12．
15 FALASCHETTI L， MANONI L， TURCHETTI C ．A low-rank CNN architecture for real-time semantic segmentation in visual slam applications［J］．IEEE Open Journal of Circuits and Systems，2022，3：115-133．
16 WANG J， LI S， YU L，et al ．SDPN： a slight dual-path network with local-global attention guided for medical image segmentation［J］．IEEE Journal of Biomedical and Health Informatics，2023，27（6）：2956-2967．
17 CHEN W， ZHU X， SUN R，et al ．Tensor low-rank reconstruction for semantic segmentation［C］?∥Proceedings of the 16th European Conference on Computer Vision （ECCV 2020）．Glasgow：Springer International Publishing，2020：52-69．
18 FAN X， LU Y， HOU J，et al ．DMC-UNet-based segmentation of lung nodules［J］．IEEE Access，2023，11：3322437/1-18．
19 JHA D， SMEDSRUD P H， RIEGLER M A，et al ．RseUNet++： an advanced architecture for medical ima-ge segmentation［C］?∥Proceedings of 2019 IEEE International Symposium on Multi-Media．San Diego：IEEE，2019：225-2255．
20 WANG J， LV P， WANG H，et al ．SAR-UNet：squeeze-and-excitation block and atrous spatial pyramid pooling based residual U-Net for automatic liver segmentation in computed tomography［J］．Computer Me-thods and Programs in Biomedicine，2021，208：106268/1-16．
21 FAN T， WANG G， LI Y，et al ．MA-Net： a multi-scale attention network for liver and tumor segmentation［J］．IEEE Access，2020，8：179656-179665．
22 LI X， CHEN H， QI X，et al ．H-DenseUNet：hybrid densely connected UNet for liver and tumor segmentation from CT volumes［J］．IEEE transactions on Medical Imaging，2018，37（12）：2663-2674．
23 SHAO Y， ZHOU K， ZHANG L ．CSSNet： cascaded spatial shift network for multi-organ segmentation［J］．Computers in Biology and Medicine，2024，170：107955/1-14．
24 LIANG B， TANG C， ZHANG W，et al ．N-Net： an UNet architecture with dual encoder for medical image segmentation［J］．Signal，Image and Video Processing，2023，17（6）：3073-3081．
25 XIE J， ZHU R， WU Z，et al ．FFUNet： a novel feature fusion makes strong decoder for medical image segmentation［J］．IET Signal Processing，2022，16（5）：501-514．
26 XIAO X， LIAN S， LUO Z，et al ．Weighted ResUNet for high-quality retina vessel segmentation［C］?∥Proceedings of 2018 9th International Conference on Information Technology in Medicine and Education．Hangzhou：IEEE，2018：327-331．
27 OKTAY O， SCHLEMPER J， FOLGOC L L，et al ．AttentionUNet： learning where to look for the pancreas［EB/OL］．（2018-04-11）［2024-08-30］．．
28 ZHOU Z， RAHMAN SIDDIQUEE M M， TAJBAKHSH N，et al ．UNet++： a nested U-Net architecture for medical image segmentation［C］?∥Proceedings of the 4th International Workshop on Deep Learning in Medical Image Analysis and Multimodal Learning for Clinical Decision Support．Granada：Springer International Publishing，2018：3-11．
29 HUANG H， LIN L， TONG R，et al ．UNet3+： a full-scale connected UNet for medical image segmentation［C］?∥Proceedings of 2020 IEEE International Conference on Acoustics，Speech and Signal Processing．Barcelona：IEEE，2020：1055-1059．
30 RUAN J， XIE M， XIANG S，et al ．MEWUNet： multi-axis representation learning in frequency domain for medical image segmentation［EB/OL］．（2022-10-25）［2024-08-30］．．
31 CHEN J， LU Y， YU Q，et al ．TransUNet： transfor-mers make strong encoders for medical image segmentation［EB/OL］．（2021-02-08）［2024-08-30］．．
32 HUANG X， DENG Z， LI D，et al ．MISSFormer： an effective transformer for 2d medical image segmentation［J］．IEEE Transactions on Medical Imaging，2022，42（5）：1484-1494．
Options
文章导航

/

〈 〉


总访问量
今日访问
在线人数
粤ICP备05084312号
版权所有 © 华南理工大学期刊中心（学报编辑部）

地址：广州 五山 华南理工大学17号楼 邮政编码：510640

电话： 020-87111794 邮箱：journal@scut.edu.cn

  • 微信号：Journalscut
  • QQ群：699235083