融合多层级特征与注意力机制的高效语义分割算法OA
An efficient semantic segmentation algorithm fusing multi-level features and attention mechanism
针对当前语义分割算法参数量大、计算复杂、推理速度慢,难以在移动设备和嵌入式设备等资源有限的场景中应用等问题,提出基于 DeepLabV3+的一种融合多层级特征与注意力机制的高效语义分割算法(HE-DeepLabV3+).该算法采用 MobileNetV2 作为骨干网络,输出的浅层特征通过特征金字塔(FPN)模块进行多层级特征融合,以增强浅层特征的表达能力.又提出增强型空洞空间金字塔池化(EASPP)模块实现特征的密集连接,解决特征提取过程中的语义信息丢失问题.进而设计并行通道空间注意力模块(PCSAM),在保留原始特征的同时获得空间权重和通道权重,提高分割精度.实 验 结 果 表 明,HE-DeepLabV3+在 PASCAL VOC2012Aug 数据集上的平均交并比和平均像素精度分别达到75.44%和84.99%,与传统 DeepLabV3+相比,其参数量、计算量分别减少82.55%和62.52%,推理速度提高71.92%.在保持高精度的同时,显著降低计算成本,实现了准确性与模型轻量化之间的有效平衡.
Due to the current semantic segmentation algorithm's numerious parameters,complex calculations,slow inference speed,it is difficult to apply in resource-limited scenarios such as mobile devices and embedded devices.Soan efficient semantic segmentation algorithm named HE-DeepLabV3+that integrates multi-level features and attention mechanism is proposed by improving DeepLabV3+.First,MobileNetV2 is used as the backbone network,and the output shallow features are fused with multi-level features to enhance the expressive ability of shallow features by the feature pyramid networks(FPN)module.Afterwards,the enhanced atrous spatial pyramid pooling(EASPP)module is proposed to realize dense connection of features and to prevent semantic information loss in the feature extraction process.Then the parallel channel-spatial attention module(PCSAM)module is designed to obtain spatial weights and channel weights while retaining the original features,and to improve the segmentation accuracy.Experimental results show that the average intersection ratio and average pixel accuracy of this algorithm on the PASCAL VOC2012Aug data set reached 75.44%and 84.99%.By comparing this algorithm with the traditional DeepLabV3+,the amount of parameters and calculations reduced by 82.55%and 62.52%respectively,meanwhile the inference speed increased by 71.92%.This algorithm significantly reduces computational costs while maintaining high accuracy,achieving an effective balance between accuracy and model lightweight.
郑仕敏;毕建鹏;于潇雁
福州大学机械工程及自动化学院,福建 福州 350108福州大学机械工程及自动化学院,福建 福州 350108福州大学机械工程及自动化学院,福建 福州 350108
信息技术与安全科学
语义分割DeepLabV3+注意力机制多层级特征融合
semantic segmentationDeepLabV3+attention mechanismmulti-level feature fusion
《福州大学学报(自然科学版)》 2026 (2)
137-144,8
科技部国家重点研发计划资助项目(2022YFB4702401)福建省自然科学基金资助项目(2024J01241)
评论