首页|期刊导航|北京航空航天大学学报|基于多源图像融合的无人机航拍舰船目标识别方法

基于多源图像融合的无人机航拍舰船目标识别方法OA

Ship target recognition method based on multi-source image fusion for unmanned aerial vehicle aerial photography

中文摘要英文摘要

针对无人机航拍采集到的多源舰船图像,提出一种多源舰船图像融合识别方法,面对现实场景中存在诸多干扰,采用像素级融合方式,通过对红外、可见光舰船图像进行融合,再进行目标识别,相比于特征级识别方法,既可以降低网络对样本的依赖,又可以增强方法的可解释性.所提方法聚焦于解决因传感器参数不同存在的像素偏移情况,为避免传统图像配准容易产生的畸变、伪影等问题,将图像配准转化为端到端下的特征对齐,提出一种多源舰船图像融合识别网络,网络共由交叉调制特征提取模块、特征动态对齐模块、多粒度特征细化模块和金字塔特征融合模块组成,可以充分融合不同模态图像的特征和纹理细节,有效提升对舰船目标的识别性能.经实验验证:所提方法对多源图像的融合效果好、可解释性强,对舰船目标的识别准确度高、鲁棒性强.

A multi-source ship image fusion recognition method is proposed for unmanned aerial vehicle aerial photography of multi-source ship images.In the face of many interferences in real scenes,pixel level fusion is adopted to fuse infrared and visible light ship images,and then perform target recognition.It can improve the algorithm's interpretability and lessen the network's reliance on samples as compared to feature level recognition techniques.This article focuses on solving the pixel offset caused by different sensor parameters.To eliminate the distortion and artifacts that traditional picture registration can readily cause,image registration has been turned into end-to-end feature alignment.A multi-source ship image fusion recognition network is proposed,which consists of a cross modulation feature extraction module,a feature dynamic alignment module,a multi granularity feature refinement module,and a pyramid feature fusion module.It can fully integrate the features and texture details of different modal images,effectively improving the recognition performance of ship targets.The approach described in this study has demonstrated great interpretability for multi-source images,good fusion performance,and high accuracy and robustness in recognizing ship targets through experimental verification.

姜杰;闫文君;刘凯;张立民

海军航空大学 航空作战勤务学院,烟台 264001海军航空大学 航空作战勤务学院,烟台 264001海军航空大学 航空作战勤务学院,烟台 264001海军航空大学 航空作战勤务学院,烟台 264001

航空航天

无人机多源舰船图像融合识别像素级融合像素偏移

unmanned aerial vehiclemulti source ship imagesfusion recognitionpixel level fusionpixel offset

《北京航空航天大学学报》 2026 (6)

1955-1964,10

国家自然科学基金(62371465)山东省青创团队(2022kj084)山东省自然科学基金(ZR2020QF010) National Natural Science Foundation of China(62371465)Shandong Province Youth Innovation Team(2022kj084)Shandong Provincial Natural Science Foundation(ZR2020QF010)

10.13700/j.bh.1001-5965.2024.0289

评论