首页|期刊导航|光学精密工程|跨层级交互与方位感知的航拍图像语义分割

跨层级交互与方位感知的航拍图像语义分割OA

Semantic segmentation of aerial images based on multi-scale feature interaction and fusion

中文摘要英文摘要

针对航拍图像语义分割中提取特征尺度单一、细节丢失、边界模糊的问题,本文提出一种跨层级交互与方位感知的航拍图像语义分割网络.通过方向解耦注意力策略构建方位感知模块,增强模型对空间方向信息的处理能力;设计跨层级交互模块进行跨通道特征交互融合,提升空间感知能力,同时利用通道-空间注意力机制增强特征提取能力,在复杂场景中缓解细节模糊问题;最后对分割头进行轻量化设计,去除冗余操作,在降低计算量的同时保证分割性能.实验结果表明,本文网络在UAVid数据集与Aeroscapes数据集的平均交并比相较于基线模型SegFormer分别提升了1.7%和1.3%,证明了该网络在航拍图像等复杂情况下语义分割的有效性.Human类别相较基线模型分割精度提升了1.8%,证明了本文网络在小目标分割方面表现出色.与多个主流网络相比,本文方法在两个数据集上均实现了最高的分割精度,表现出更优的泛化能力.

To address the issues of single-scale feature extraction,detail loss,and blurred boundaries in aerial image semantic segmentation,this paper proposed an aerial image semantic segmentation network with cross-level interaction and orientation awareness.A position awareness module was constructed through a direction-decoupled attention strategy to enhance the model's ability to process spatial directional information;a cross-level interaction module was designed for inter-channel feature interaction and fusion to improve spatial perception,while a channel-spatial attention mechanism was used to enhance feature ex-traction capabilities and alleviate detail blurring issues in complex scenes;finally,a lightweight design was implemented for the segmentation head,removing redundant operations to reduce computational load while ensuring segmentation performance.Experimental results indicate that the proposed network achieves a 1.7%and 1.3%improvement in mean intersection over union on the UAVid and Aeroscapes datasets,respectively,compared to the baseline model SegFormer,demonstrating the network's effective-ness in semantic segmentation under complex conditions such as aerial images.The segmentation accuracy of the Human category improved by 1.8%compared to the baseline model,demonstrating that the net-work proposed in this paper performs excellently in small object segmentation.Compared with several mainstream networks,the method proposed in this paper achieves the highest segmentation accuracy on both datasets,showing superior generalization capability.

刘杰;吴紫钰;田明;韩轲

哈尔滨理工大学 模式识别与信息感知黑龙江省重点实验室,黑龙江 哈尔滨 150080哈尔滨理工大学 模式识别与信息感知黑龙江省重点实验室,黑龙江 哈尔滨 150080中国电信股份有限公司黑龙江分公司,黑龙江 哈尔滨 150040哈尔滨商业大学 计算机与信息工程学院,黑龙江 哈尔滨 150028

信息技术与安全科学

跨层级交互语义分割航拍图像轻量化方向解耦

inter-level interactionsemantic segmentationaerial imagerylightweightingdirection de-coupling

《光学精密工程》 2026 (2)

267-278,12

黑龙江省自然科学基金(No.LH2023E086)黑龙江省交通运输厅科技项目(No.HJK2024B002)

10.37188/OPE.20263402.0267

评论