增强上下文特征交互的实时无人机影像分割算法OA
Real-time UAV image segmentation algorithm with enhanced contextual feature interaction
针对无人机影像语义分割任务中轻量级算法缺乏全局信息交互导致分割结果中目标漏检与不完整问题,提出了一种增强上下文特征交互的实时无人机影像分割算法.算法采用双分支结构,利用不同方向的全局平均池化对通道和空间信息进行编码,保留了精准的位置信息,并增强了对图像中局部细节信息的关注;利用位置感知循环卷积和空间加权构建全局感知提取模块,实现了全局上下文信息捕获;对不同尺度特征采用加权操作进行融合,降低了融合过程中的信息损失与算法的计算量.在UAVid 和AeroScapes数据集上对所提算法进行验证,结果显示:平均交并比(mIoU)分别达到 66.5%和 63.0%,相比 BiSeNet V2提升了 2.6%和 2.2%,分割速度分别达到79.9帧/s和 71.4帧/s,相比BiSeNet V2提升了 8.3帧/s和 6.9帧/s,在保证实时分割速度的同时取得了较好的分割精度.
A real-time UAV image segmentation algorithm with enhanced contextual feature interaction is proposed to address the problem of target omission and incompleteness in segmentation results due to the lack of global information interaction in lightweight algorithms for semantic segmentation tasks of UAV images.The approach uses a two-branch structure.To encode the channel and spatial information,global average pooling in various directions was used.This preserves the correct position information and increases the attention to the local detail information in the image.Secondly,a global perceptual extraction module was constructed by using the position-aware circular convolution and spatial weighting,which achieves the global contextual information capture;Finally,the weighting operation is applied to the features of different scales for the fusion,which reduces the information loss in the fusion process and the computation of the algorithm.The UAVid and AeroScapes datasets are used to validate the algorithm.The results indicate that the mean intersection over union(mIoU)achieved 66.5%and 63.0%,respectively,marking a 2.6%and 2.2%improvement over BiSeNet V2.The segmentation speeds reached 79.9 and 71.4 frames per second,respectively,showing an increase of 8.3 and 6.9 frames per second compared to BiSeNet V2.This method ensures real-time segmentation speed while delivering satisfactory segmentation accuracy.
李云红;张富星;苏雪平;李丽敏;王梅;梁成名
西安工程大学 电子信息学院,西安 710048西安工程大学 电子信息学院,西安 710048西安工程大学 电子信息学院,西安 710048西安工程大学 电子信息学院,西安 710048西安工程大学 电子信息学院,西安 710048西安工程大学 电子信息学院,西安 710048
信息技术与安全科学
语义分割无人机影像卷积神经网络上下文信息特征融合
semantic segmentationUAV imageconvolutional neural networkcontext informationfeature fusion
《北京航空航天大学学报》 2026 (3)
668-677,10
国家自然科学基金(62203344)陕西省自然科学基础研究计划重点项目(2022JZ-35)陕西高校青年创新团队西安市"科学家+工程师"队伍建设项目(25KGYB00029) National Natural Science Foundation of China(62203344)Key Projects of Natural Science Basic Research Program of Shaanxi(2022JZ-35)The Youth Innovation Team of Shaanxi UniversitiesXi'an City"Scientist+Engineering"Team Construction Project(25KGYB00029)
评论