基于注意力机制的特征融合语义分割模型OA
A feature fusion semantic segmentation model based on attention mechanism
针对现有的语义分割模型DeepLabV3+容易出现误分割、分割精度低以及细节信息丢失严重等问题,提出了一种基于注意力机制的融合语义分割模型.首先,在该模型中的空洞卷积分支级联一个可切换空洞卷积,使其更加灵活地适应不同尺度的特征,减少误分割现象;其次,引入RFEM 模块,捕获浅层特征多尺度信息以及不同范围的依赖关系,提高模型的性能;再次,提取模型的中间层特征,并利用ELAFF模块与其深层特征融合,使模型恢复在下采样过程中丢失的细节信息;最后,添加高效局部注意力,使模型更加关注图像信息,减少背景干扰.在PASCAL VOC 2012数据集上的实验结果表明,相比原模型,所提模型的平均交并比提升2.36个百分点,平均像素准确度提升1.60个百分点,可有效改善模型的分割性能.
To address the issues of mis-segmentation,low segmentation accuracy,and severe loss of detailed information commonly encountered in the existing DeepLabV3+semantic segmentation model,a feature-fusion semantic segmentation model based on an attention mechanism is proposed.Firstly,a switchable atrous convolution is cascaded within the dilated convolution branch of the model,enabling it to adapt more flexibly to features at different scales and thereby reducing mis-segmentation.Additional-ly,an RFEM module is introduced to capture multi-scale information from shallow features and depen-dencies across different ranges,enhancing the model's performance.Furthermore,intermediate-layer features of the model are extracted and fused with its deep features using the ELAFF module,enabling the model to recover detailed information lost during the downsampling process.Finally,an efficient lo-cal attention mechanism is added to make the model focus more on image information and reduce back-ground interference.Experimental results on the PASCAL VOC 2012 dataset demonstrate that,com-pared to the original model,the proposed model achieves a 2.36 percentage points increase in mean intersection-over-union(mIoU)and a 1.60 percentage points improvement in mean pixel accuracy(MPA),effectively enhancing the model's segmentation performance.
马冬梅;朱启荣;吕雪龙
西北师范大学物理与电子工程学院,甘肃 兰州 730070西北师范大学物理与电子工程学院,甘肃 兰州 730070西北师范大学物理与电子工程学院,甘肃 兰州 730070
信息技术与安全科学
注意力机制语义分割DeepLabV3+特征融合
attention mechanismsemantic segmentationDeepLabV3+feature fusion
《计算机工程与科学》 2026 (5)
898-905,8
国家自然科学基金(61961037)
评论