基于CNN-ViT融合与特征增强的金刚石刀头结块缺陷检测OA
CNN-ViT fusion with feature enhancement for defect detection of diamond tool segments
当前基于深度学习的工业品缺陷检测研究大多是针对纹理规则、成像均匀的工件,对表面存在复杂反射与纹理干扰的高反射合金部件的检测挑战关注不足.金刚石刀头结块作为高反射合金工件的典型代表,其表面因含有金刚石颗粒和金属粉末而呈现强烈的镜面反射及随机高光点,导致划痕、孔洞、边缘缺陷等与背景噪声高度混杂,极大地增加了检测难度.为此,提出一种面向复杂高反射复合材质表面缺陷检测的跨模态动态融合框架DCVNet.通过构建局部-全局特征解耦机制,利用多阶段缺陷增强聚类实现背景-缺陷的物理先验分离,并引入渐进式特征融合模块实现卷积神经网络与视觉变换器的跨尺度深度特征融合,突破了传统算法在高反射复合材质缺陷检测上的局限性.构建金刚石刀头结块表面缺陷图像数据集,对模型进行训练,并与GoogLeNet、ResNet50、ResNet101、ViT-L16、MobileNetV2、CRAD、PNI、SuperSimpleNet和MAML模型进行仿真对比实验.结果表明,DCVNet模型检测准确率达到0.841,召回率为0.866,显著优于对比模型.DCVNet模型在复杂高反射复合材质表面缺陷检测中具有较高的检测精度和鲁棒性,为工业缺陷检测提供了新的解决方案.
Existing deep learning-based industrial defect detection methods primarily focus on workpieces with regular textures and uniform imaging conditions,while insufficient attention has been paid to highly reflective alloy components with complex surface reflections and textural interference.Owing to the presence of diamond particles and metal powders,their surfaces exhibit strong specular reflections and random highlights,causing scratches,holes,edge defects,and other imperfections to be highly entangled with background noise and thus significantly increasing detection difficulty.To address this challenge,a cross-modal dynamic fusion framework,termed DCVNet,is proposed for defect detection on complex,highly reflective composite material surfaces.A local-global feature decoupling mechanism is constructed to separate defect-related information from reflection-induced background interference.A multi-stage defect-enhanced clustering algorithm is designed to achieve physical prior separation of background and defects.Furthermore,a progressive feature fusion module is introduced to realize deep cross-scale feature fusion between convolutional neural network(CNN)and vision transformer(ViT).A dedicated surface defect image dataset of diamond tool segments was constructed to train the model.Persuasive experiments were conducted by comparing DCVNet with GoogLeNet,ResNet50,ResNet101,ViT-L16,MobileNetV2,CRAD,PNI,SuperSimpleNet,and MAML models.The results demonstrate that the DCVNet model achieves a detection accuracy of 0.841 and a recall rate of 0.866,outperforming the comparison models.The proposed DCVNet model exhibits strong robustness and high detection performance for defects on complex,highly reflective composite material surfaces,providing an effective solution for industrial defect inspection scenarios.
赵楠楠;赵文龙;张海刚;匡国文;何玉林
辽宁科技大学电子与信息工程学院,辽宁 鞍山 114051辽宁科技大学电子与信息工程学院,辽宁 鞍山 114051||深圳职业技术大学粤港澳大湾区人工智能应用技术研究院,广东 深圳 518055深圳职业技术大学粤港澳大湾区人工智能应用技术研究院,广东 深圳 518055深圳职业技术大学粤港澳大湾区人工智能应用技术研究院,广东 深圳 518055人工智能与数字经济广东省实验室(深圳),广东 深圳 518107
信息技术与安全科学
计算机视觉工业品缺陷检测卷积神经网络视觉变换器自注意力特征融合金刚石刀头结块
computer visionindustrial defect detectionconvolutional neural networkvision transformerself-attentionfeature fusiondiamond tool segments
《深圳大学学报(理工版)》 2026 (2)
171-178,8
National Natural Science Foundation of China(62272320)Research Projects of Department of Education of Guangdong Province(2023KCXTD077)Science and Technology Major Project of Shenzhen(KJZD20230923114809020)Scientific Research Startup Fund for Shenzhen High-Caliber Personnel of SZPU(6021310030K) 国家自然科学基金资助项目(62272320)广东省教育厅重点领域专项资助项目(2023KCXTD077)深圳市科技重大专项资助项目(KJZD20230923114809020)深圳职业技术大学高层次人才科研启动资助项目(6021310030K)
评论