Frontiers of Data and Computing ›› 2024, Vol. 6 ›› Issue (2): 80-88.

CSTR: 32002.14.jfdc.CN10-1649/TP.2024.02.008

doi: 10.11871/jfdc.issn.2096-742X.2024.02.008

• Special Issue: Advance of Intelligent Healthcare • Previous Articles     Next Articles

Domain Independent Cycle-GAN for Cross Modal Medical Image Generation

LI Haopeng1(),ZHOU Wanting1,*(),CHEN Yu2,ZHANG Man1   

  1. 1. Department of Artificial Intelligence, Beijing University of Posts and Telecommunications, Beijing 100876, China
    2. Beijing Tiantan Hospital, Capital Medical University, Beijing 100070, China
  • Received:2023-10-29 Online:2024-04-20 Published:2024-04-26


[Objective] To solve the problem of misaligned and inaccurate image structure generated by training with unpaired data in cross-modal medical image generation tasks, [Methods] this article proposes a cross-modal medical image generation model based on domain independent cyclic generation adversarial network, which constrains the structural consistency of images before and after modal transformation by aligning the intermediate features during cyclic generation. [Results] The experimental results on the brain CT-MRI dataset show that the method proposed in this article can improve the consistency of image structure before and after cross-modal transformation, thereby improving the quality of cross-modal medical image generation. [Limitations] This study has conducted a large number of experiments on the multimodal brain dataset. Further verification of its universality is needed in other datasets. [Conclusions] The method proposed in this article outperforms the current best performing cross-modal medical image generation model in various metrics for measuring the quality of generated images.

Key words: generative adversarial networks, medical image synthesis, self-attention mechanism