基于多层病理学监督的乳腺癌H&E生成虚拟Ki-67图像研究OA
Multi-level pathology-guided virtual staining for H&E-to-Ki-67 image generation in breast cancer
针对乳腺癌Ki-67 免疫组织化学染色耗时且H&E与Ki-67 图像存在弱配对的问题,本研究提出了一种多层病理学导向的监督生成对抗网络(MPAS-GAN),旨在通过H&E图像生成高质量虚拟Ki-67 图像,以评估Ki-67 生物标志物的表达分布.首先,在MPAS-GAN中引入多层病理学监督框架,通过置信度加权的最优传输对齐,解决宏观特征层面的组织错位问题;最后,通过Ki-67 病理信息一致性约束,还原关键病理语义层面的诊断信息,并通过病理细胞结构一致性约束,保留基础细胞结构层面的细胞核形态.在MIST和IHC4BC公开数据集上的实验结果显示,MPAS-GAN在结构相似性指数(SSIM)、峰值信噪比(PSNR)、弗雷歇初始距离(FID)和学习感知图像块相似度(LPIPS)等指标上均显著优于现有主流方法,并在Ki-67阳性区域的定量相关性分析中取得了最高的一致性.本研究能够生成视觉逼真且病理学可靠的虚拟Ki-67 图像,可有效解决弱配对医学图像翻译问题,有望为乳腺癌的数字化病理诊断提供更加高效、可靠的工具.
Regarding the problem of time-consuming of Ki-67 immunohistochemical staining and weak pairing between H&E and Ki-67 images in breast cancer,we proposed a multi-level pathology-guided supervised generative adversarial network(MPAS-GAN)to generate high-quality virtual Ki-67 images from H&E counterparts to assess the expression distribution of the Ki-67 biomarker.Firstly,the multi-level pathology-guided supervision framework was introduced in MPAS-GAN to solve the tissue misalignment at the macro-feature level,through the confidence-weighted optimal transport alignment.Finally,the diagnostic information at the key patho-logical semantic level was restored through the consistency constraint of Ki-67 pathological information,and the nuclear morphology at the basic cell structure level was retained through the consistency constraint of pathological cell structure.Experimental results on the public MIST and IHC4BC datasets demonstrated that MPAS-GAN significantly outperformed existing state-of-the-art methods across structural similarity index measure(SSIM),peak signal-to-noise ratio(PSNR),Fréchet inception distance(FID),learned percep-tual image patch similarity(LPIPS)metrics.Furthermore,it achieved the highest consistency in the quantitative correlation analysis of Ki-67 positive regions.This research can generate visually realistic and pathologically reliable virtual Ki-67 images,which can effec-tively solve the problem of weakly paired medical image translation,and is expected to provide a more efficient and reliable tool for the digital pathological diagnosis of breast cancer.
白少康;陈春晓;陈利海;李阳;王亮;陈柏凯;肖月月
南京航空航天大学 自动化学院,南京 211106南京航空航天大学 自动化学院,南京 211106南京市第一医院 麻醉科,南京 210000南京航空航天大学 自动化学院,南京 211106南京航空航天大学 自动化学院,南京 211106南京航空航天大学 自动化学院,南京 211106南京航空航天大学 自动化学院,南京 211106
医药卫生
虚拟染色免疫组织化学弱配对图像深度学习监督信息挖掘反卷积配准组织病理学
Virtual stainingImmunohistochemistryWeakly-paired imagesDeep learningSupervised information miningDe-convolutionRegistrationHistopathology
《生物医学工程研究》 2026 (1)
36-42,7
南京航空航天大学研究生科研与实践创新计划项目(1003-016001).
评论