基于CiteSpace的国内外多模态人工智能在医学领域的研究热点与趋势分析
(中国民用航空飞行学院 理学院,四川 成都 641419)
摘要
本研究基于Web of Science和中国知网数据库,对2015—2025年医学多模态技术相关文献进行文献计量与可视化分析,重点关注图像分割与融合领域的研究热点与发展趋势。共纳入1 187篇文献,利用CiteSpace分析作者与国家/地区合作、机构分布、年度发文变化及关键词共现、聚类和突现特征。结果显示,该领域发文量近十年持续快速增长,2023年后增速明显;中国、美国和印度贡献突出。特征提取、深度学习、图像融合、电子健康记录、多模态配准、肺癌以及功能性磁共振成像等为核心研究主题,其中“图像融合”为最早且强度最高的突现词。研究重心正由多模态图像融合向多源异构数据融合转变,医学多模态预训练数据集构建及电子病历与影像联合建模将成为未来发展方向。
关键词
多模态;图像分割;图像融合;CiteSpace;深度学习
参考文献
- [1] 范勇,张政波,王晶.基于深度学习的电子病历多模态数据融合研究进展 [J].生物医学工程学杂志,2024,41(5):1062-1071.
- [2] Li Y H,Daho M E H,Conze P-H,et al. A Review of Deep Learning-based Information Fusion Techniques for Multimodal Medical Image Classification [J/OL].Computers in Biology and Medicine,2024,177:108635.https://doi.org/10.1016/j.compbiomed.2024.108635.
- [3] Huang W J,Shu N. AI-powered Integration of Multimodal Imaging in Precision Medicine for Neuropsychiatric Disorders [J/OL].Cell Reports Medicine,2025,6(5):102132.http://dx.doi.org/10.1016/J.XCRM.2025.102132.
- [4] 陈书晴,郭熙铜.多模态大模型在重大疾病领域的研究综述 [J].哈尔滨工业大学学报,2025,57(12):156-164.
- [5] Azam M A,Khan K B,Salahuddin S,et al. A Review on Multimodal Medical Image Fusion: Compendious Analysis of Medical Modalities,Multimodal Databases, Fusion Techniques and Quality Metrics [J/OL].Computers in Biology and Medicine,2022,144:105253.https://doi.org/10.1016/j.compbiomed.2022.105253.
- [6] 汤占军,蹇洪,王健.基于U-Net和Transformer结合的不完整多模态脑肿瘤分割方法 [J].数据采集与处理,2025,40(4):934-949.
- [7] 崔立真,孙晓芳,刘宁,等.多源异构医疗大数据融合与分析技术 [J].山东大学学报(工学版),2026,56(1):1-13,25.
- [8] Tang W,He F Z,Liu Y S,et al. MATR: Multimodal Medical Image Fusion via Multiscale Adaptive Transformer [J].IEEE Transactions on Image Processing,2022:5134-5149.
- [9] Yin M,Liu X N,Liu Y,et al. Medical Image Fusion with Parameter-adaptive Pulse Coupled Neural Network in Nonsubsampled Shearlet Transform Domain [J].IEEE Transactions on Instrumentation and Measurement,2019,68(1):49-64.
- [10] Zhang J,Liu A,Liu Y,et al. LeGFusion: Locally Enhanced Global Learning for Multimodal Image Fusion [J].IEEE Sensors Journal,2024,24(8):12806-12818.
- [11] Liu Y,Mu F H,Shi Y,et al. SF-Net: A Multi-task Model for Brain Tumor Segmentation in Multimodal MRI via Image Fusion [J].IEEE Signal Processing Letters,2022,29:1799-1803.
- [12] Shi K,Liu A P,Zhang J,et al. Medical Image Fusion Based on Multilevel Bidirectional Feature Interaction Network [J].IEEE Sensors Journal,2024,24(12):19428-19441.
- [13] Zhang J,Liu Y,Liu A P,et al. Multimodal Image Fusion via Self-supervised Transformer [J].IEEE Sensors Journal,2023,23(9):9796-9807.
- [14] Zhu Z Q,He X Y,Qi G Q,et al. Brain Tumor Segmentation Based on the Fusion of Deep Semantics and Edge Information in Multimodal MRI [J].Information Fusion,2023,91:376-387.
- [15] Liu Y,Ma Y Z,Zhu Z Q,et al. TransSea: Hybrid CNN-transformer with Semantic Awareness for 3-D Brain Tumor Segmentation [J].IEEE Transactions on Instrumentation and Measurement,2024,73:16-31.
- [16] 沈瑜,白珊,魏子易,等.基于跨模态感知和空频交叉的医学图像融合 [J].中国激光,2025,52(9):96-110.
- [17] 邸敬,梁婵,郭文庆,等.基于掩膜优化和并联注意力机制的多模态医学图像融合(英文) [J].Journal of Measurement Science and Instrumentation,2025,16(1):26-36.
- [18] 沈瑜,刘佳英,闫佳荣,等.基于局部与全局信息协同的双分支多模态医学图像融合 [J].光学学报,2025,45(8):125-139.
- [19] 邸敬,郭文庆,任莉,等.基于结构功能交叉神经网络的多模态医学图像融合 [J].光学精密工程,2024,32(2):252-267.
- [20] 楼建强,戴文战,李俊峰.基于非下采样Contourlet变换的自适应医学图像融合算法 [J].应用科学学报,2017,35(6):763-774.
- [21] 楼建强,李俊峰,戴文战.非下采样剪切波变换的医学图像融合 [J].中国图象图形学报,2017,22(11):1574-1583.
- [22] 李加恒,戴文战,李俊峰.基于互信息的多模态医学图像融合 [J].浙江理工大学学报(自然科学版),2016,35(4):607-614.
- [23] Zhang Y F,Deng Y J,Zhou Z X,et al. Multimodal Learning for Fetal Distress Diagnosis Using a Multimodal Medical Information Fusion Framework [J/OL].Frontiers in Physiology,2022,13:1021400.https://doi.org/10.3389/fphys.2022.1021400.
- [24] Murad N Y,Hasan M H,AZAM M H,et al. Unraveling the Black Box: A Review of Explainable Deep Learning Healthcare Techniques [J].IEEE Access,2024,12:66556-66568.
- [25] Wang W X,Chen C,Ding M,et al. TransBTS: Multimodal Brain Tumor Segmentation Using Transformer [C]//International Conference on Medical Image Computing and Computer-Assisted Intervention,2021:109-119.
- [26] Rahman M M,Rahman S,Bhatt S,et al. Text-assisted Vision Model for Medical Image Segmentation [J].IEEE Journal of Biomedical and Health Informatics,2025,29(11):8199-8212.
- [27] 邢素霞,李珂娴,方俊泽,等.深度学习下的医学图像分割综述 [J].计算机工程与应用,2025,61(7):25-41.
- [28] 常青,李梦珂,陆晨豪,等.基于多层级特征融合的多模态医学图像配准 [J].中国科学院大学学报(中英文),2025,42(5):645-654.
- [29] 常锦才,张笑林,武伟娜,等.基于CT和MRI的多模态医学图像配准算法 [J].华北理工大学学报(自然科学版),2021,43(4):108-118.
- [30] 蒋宏贵,胡冀苏,钱旭升,等.基于联合学习和多级小波特征金字塔的MRI-TRUS图像配准方法 [J].计算机工程,2025,51(10):270-283.
- [31] 汤玉杰.X光与CT图像配准系统设计与实现 [D].合肥:安徽大学,2022.
- [32] 赵祥成,宋丽文,李传璞,等.基于不完整多模态医学图像的深度学习模型在原发性骨肿瘤分类中的应用 [J].临床放射学杂志,2025,44(8):1521-1528.
- [33] 李光宇,杨锋,张智悦,等.深度残差网络在脑肿瘤MRI分类上的研究进展 [J].磁共振成像,2025,16(3):143-149,161.
- [34] 胡馨悦,石雨,刘羽.结合DenseNet和Mamba的多模态脑影像阿尔茨海默症分类 [J].中国图象图形学报,2025,30(10):3230-3241.
- [35] Menze B H,Jakab A,Bauer S,et al. The Multimodal Brain Tumor Image Segmentation Benchmark (BRATS) [J].IEEE Transactions on Medical Imaging,2015,34(10):1993-2024.
- [36] Bakas S,Akbari H,Sotiras A,et al. Advancing the Cancer Genome Atlas Glioma MRI Collections with Expert Segmentation Labels and Radiomic Features [J/OL].Scientific data,2017,4(1):170117.https://doi.org/10.1038/sdata.2017.117.
- [37] Baid U,Ghodasara S,Mohan S,et al. The RSNA-ASNR-MICCAI BraTS 2021 Benchmark on Brain Tumor Segmentation and Radiogenomic Classification [J/OL].arXiv:2107.02314[cs.CV].https://arxiv.org/abs/2107.02314.
基金项目
中央高校基本科研业务费(25CAFUC09011)
作者简介
唐安妮(1999—),女,汉族,重庆人,硕士在读,研究方向:医学大数据及人工智能;徐海文(1978—),男,汉族,山东菏泽人,教授,博士研究生,研究方向:大数据技术与模型、优化理论与算法。