基于Transformer生成对抗网络模型生成的虚拟CT图像对自发性脑出血后早期血肿的预测研究OA
Predictive study on a transformer-based generative adversarial network for virtual CT image generation in early hematoma evolution of spontaneous intracerebral hemorrhage
目的 探讨基于Transformer生成对抗网络(TransGAN)模型生成的虚拟CT图像对自发性脑出血(sICH)后早期血肿的预测价值.方法 回顾性连续纳入2017年1月至2024年5月于杭州市第一人民医院放射科(中心1)和联勤保障部队第九○三医院放射科(中心2)行头部影像学检查的sICH患者.以中心1患者为训练集,中心2患者为测试集.收集所有患者人口学基线资料(年龄、性别)及影像学资料[发病后首次头部CT(基线CT)及其后24 h内复查的头部CT影像].对所有患者头部CT图像行标准化处理,通过仿射配准将基线CT平扫图像与首次头部CT后24 h内复查CT平扫图像对齐至同一空间,作为模型训练的成对数据.对训练集患者CT图像行成对同步数据扩增,包括随机旋转、缩放及灰度变换,通过设置超参数与终止条件训练TransGAN、自编码卷积神经网络(AutoCNN)、条件生成对抗网络(cGAN)模型,将训练过的模型权重加载至测试集,生成虚拟CT图像.比较3种模型生成的虚拟图像的定量和主观评价指标.以峰值信噪比(PSNR)和结构相似性指数(SSIM)为定量评价指标,PSNR为信号最大可能功率与影响其表示精度的破坏性噪声功率的比率,PSNR越高表示生成的虚拟图像与真实图像的像素级差异越小,图像重建质量越好;SSIM可基于亮度、对比度和结构特征衡量图像间的相似性,SSIM越大表示生成的虚拟图像与真实图像在视觉结构上越接近.由2名具有10年及以上工作经验的神经影像学主治医师采用Likert量表对测试集3种模型生成的虚拟图像与真实复查图像进行对比,从血肿成像质量、水肿成像质量及脑实质背景质量3个维度对3种模型生成的虚拟图像进行主观评价,虚拟图像与真实复查图像高度相似,血肿、水肿细节精准,脑实质结构自然清晰为5分;虚拟图像具有明确参考价值,血肿与水肿边界清晰,脑实质结构清楚为4分;虚拟图像具备基本参考价值,血肿与水肿形态大致可辨,脑实质结构可见为3分;虚拟图像参考价值有限,血肿与水肿边界模糊,脑实质结构难以辨认为2分;虚拟图像几乎无参考价值,各结构严重失真,无法用于评估为1分.采用加权Kappa系数评估Likert量表评分者间一致性.结果 共纳入sICH患者311例,其中男166例,女145例,年龄43~95岁,中位年龄62(53,72)岁.训练集213例,测试集98例.(1)训练集患者年龄较测试集更高(P=0.021),两数据集性别差异无统计学意义(P=0.851).(2)测试集 TransGAN、AutoCNN、cGAN 模型生成的虚拟图像 PSNR 分别为(26.73±1.11)、(22.56±1.53)、(23.54±1.41)dB,3种模型比较差异有统计学意义(F=251.343,P<0.01);且TransGAN模型生成的虚拟图像PSNR均高于其他两种模型(均P<0.01),cGAN模型生成的虚拟图像PSNR高于AutoCNN模型(P<0.01);测试集TransGAN、AutoCNN、cGAN模型生成的虚拟图像SSIM分别为(91.23±1.10)%、(86.78±1.48)%、(89.32±1.25)%,3种模型比较差异有统计学意义(F=295.232,P<0.01),且TransGAN模型生成的虚拟图像SSIM均高于其他两种模型(均P<0.01),cGAN模型生成的虚拟图像SSIM高于AutoCNN模型(P<0.01).(3)一致性分析结果显示,2名医师对各模型生成的虚拟图像的Likert量表评分加权Kappa值均≥0.81(TransGAN为0.89,AutoCNN 为 0.92,cGAN 为 0.82),观察者间一致性极佳.测试集 AutoCNN、TransGAN、cGAN模型生成的虚拟图像Likert量表评分分别为3.0(2.0,4.0)、4.0(3.0,5.0)、3.0(2.0,3.0)分,3组比较差异有统计学意义(x2=251.800,P<0.01),且TransGAN生成的虚拟图像Likert量表评分均高于其他两种模型(均P<0.01),AutoCNN模型生成的虚拟图像Likert量表评分高于cGAN模型(P<0.01).结论 TransGAN模型生成的sICH早期血肿虚拟复查图像或可为预测sICH早期脑内结构变化提供影像学参考.
Objective To investigate the predictive value of virtual CT images generated by a Transformer-based generative adversarial network(TransGAN)model for early hematoma after spontaneous intracerebral hemorrhage(sICH).Methods Patients with sICH who underwent head imaging examinations at the Department of Radiology,Hangzhou First People's Hospital(center 1)and the Department of Radiology,the 903th Hospital of the Joint Logistics Support Force(center 2)from January 2017 to May 2024 were retrospectively and consecutively enrolled.Patients from center 1 were assigned to the training set,and those from center 2 to the test set.Baseline demographic data(age,sex)and imaging data(first head CT examination after onset[baseline CT]and the 24-hour follow-up head CT images)were collected.All head CT images were standardized.The baseline non-contrast CT images and the 24-hour follow-up non-contrast CT images were aligned to the same space through affine registration,serving as paired data for model training.Paired synchronous data augmentation,including random rotation,scaling,and grayscale transformation,was performed on the training set.TransGAN,auto-encoding convolutional neural network(AutoCNN),and conditional generative adversarial networks(cGAN)models were trained by setting hyperparameters and termination conditions.The trained model weights were then loaded into the test set to generate virtual follow-up CT images.The quantitative and subjective evaluation indicators of the virtual follow-up images generated by the three models were compared.With the peak signal-to-noise ratio(PSNR)and structural similarity index measure(SSIM)as quantitative evaluation indictor,PSNR represented the ratio of the maximum possible power of a signal to the power of corrupting noise that affected the fidelity of its representation.A higher PSNR indicated a smaller pixel-level difference between the generated image and the real image,reflecting better image reconstruction quality.SSIM measured the similarity between images based on brightness,contrast,and structural features.A higher SSIM indicated that the generated image was closer to the real image in visual structure.Two neuroimaging physicians with 10 or more years of work experience subjectively evaluated the virtual images generated by the three models using a 5-point Likert scale from three dimensions:hematoma imaging quality,edema imaging quality,and brain parenchyma background quality.A score of 5 indicated that the virtual image was highly similar to the real CT image,with precise hematoma and edema details,and natural and clear brain parenchymal structures;4 indicated definite reference value,with clear hematoma and edema boundaries,and clear brain parenchymal structures;3 indicated basic reference value,with roughly distinguishable hematoma and edema morphology,and visible brain parenchymal structures;2 indicated limited reference value,with blurred hematoma and edema boundaries,and difficult-to-identify brain parenchymal structures;1 indicated almost no reference value,with severe distortion of all structures,making reliable assessment impossible.The weighted Kappa coefficient was used to evaluate inter-rater reliability.Results A total of 311 sICH patients were included,comprising 166 males and 145 females,aged 43-95 years,with a median age of 62(53,72)years.There were 213 cases in the training set and 98 cases in the test set.(1)The age of patients in the training set was higher than that in the test set(P=0.021),while there was no statistically significant difference in gender between the two groups(P=0.851).(2)The PSNR of the virtual images generated by the TransGAN,AutoCNN,and cGAN models in the test set were(26.73±1.11),(22.56±1.53),and(23.54±1.41)dB,respectively.The difference among the three models was statistically significant(F=251.343,P<0.01).The PSNR of the virtual images generated by the TransGAN model was higher than those of the other two models(both P<0.01),and the PSNR of the cGAN model was higher than that of the AutoCNN model(P<0.01).The SSIM of the virtual images generated by the TransGAN,AutoCNN,and cGAN models in the test set were(91.23±1.10)%,(86.78±1.48)%,and(89.32±1.25)%,respectively.The difference among the three models was statistically significant(F=295.232,P<0.01).The SSIM of the virtual images generated by the TransGAN model was higher than those of the other two models(both P<0.01),and the SSIM of the cGAN model was higher than that of the AutoCNN model(P<0.01).(3)The consistency analysis showed that the weighted Kappa coefficients of the Likert scale scores by the two physicians for the virtual images generated by each model were all ≥0.81(0.89 for TransGAN,0.92 for AutoCNN,and 0.82 for cGAN),indicating excellent inter-observer reliability.The Likert scale scores of the virtual images generated by the AutoCNN,TransGAN,and cGAN models in the test set were 3.0(2.0,4.0),4.0(3.0,5.0),and 3.0(2.0,3.0),respectively.The difference among the three groups was statistically significant(x2=251.800,P<0.01).The Likert scale scores of the virtual images generated by the TransGAN model were higher than those of the other two models(both P<0.01),and the Likert scale score of the AutoCNN model was higher than that of the cGAN model(P<0.01).Conclusion The TransGAN model can predict and visualize the early hematoma changes of sICH to a certain extent,providing an imaging reference for a more comprehensive assessment of structural changes in the brain after sICH.
胡晨曦;冯长锋;孔帅航;叶子怡;胡美萍;楼智骞;沈起钧;郗玉珍
310003 杭州,浙江中医药大学第四临床医学院西湖大学医学院附属杭州市第一人民医院(杭州市第一人民医院)放射科310003 杭州,浙江中医药大学第四临床医学院310003 杭州,浙江中医药大学第四临床医学院310003 杭州,浙江中医药大学第四临床医学院310003 杭州,浙江中医药大学第四临床医学院西湖大学医学院附属杭州市第一人民医院(杭州市第一人民医院)放射科联勤保障部队第九○三医院放射科
脑出血深度学习生成对抗网络TransformerCT
Cerebral hemorrhageDeep learningGenerative adversarial networkTransformerCT
《中国脑血管病杂志》 2026 (3)
159-168,10
浙江省医药卫生科技计划项目(2025KY166)
评论