Frontiers of Data and Computing ›› 2024, Vol. 6 ›› Issue (2): 89-100.

CSTR: 32002.14.jfdc.CN10-1649/TP.2024.02.009

doi: 10.11871/jfdc.issn.2096-742X.2024.02.009

• Special Issue: Advance of Intelligent Healthcare • Previous Articles     Next Articles

Causal Restraint Transformer for Medical Image Segmentation

GUO Guanchen1,2(),LI Jun1,CAI Chengfei1,2,3,JIAO Yiping1,XU Jun1,*()   

  1. 1. Institute for AI in Medicine, School of Artificial Intelligence, Nanjing University of Information Science and Technology, Nanjing, Jiangsu 210044, China
    2. School of Automation, Nanjing University of Information Science and Technology, Nanjing, Jiangsu 210044, China
    3. College of Information Engineering, Taizhou University, Taizhou, Jiangsu 225300, China
  • Received:2023-10-30 Online:2024-04-20 Published:2024-04-26


[Purpose] The data distribution has a significant impact on the performance of deep learning models. However, deep models may learn features irrelevant to the segmentation target, which is usually inapplicable for new datasets, resulting in insufficient generalization ability. [Methods] To alleviate this problem, this paper proposes a Transformer-based medical image segmentation method with causal restraint. Taking MCRformer as the main body of the network, the Morphological Constraint Stream module is used to extract morphological constraint prior information. The meshed Transformer further extracts local and network-level information. The method introduces a Causal Restraint module to alleviate the correlation between features related to regions of interest (ROI) and irrelative features. Representative features are selected for the model through morphological and causal prior information, ultimately improving segmentation performance. [Results] On the public Synapse dataset, the Dice Similarity Coefficient and Hausdorff Distance achieved mean values of 80.01% and 19.39mm, respectively. On the public ACDC dataset, the mean DSC reached 90.95%, outperforming other comparative methods. [Conclusions] Experiment results demonstrate that the proposed method effectively enhances multi-organ segmentation performance on CT and MRI images and validates the feasibility of the causal restraint module across different models.

Key words: medical image segmentation, morphological constraint, Transformer, causal restraint