首页|期刊导航|医疗卫生装备|基于多模态特征融合的无人机小目标检测方法研究

基于多模态特征融合的无人机小目标检测方法研究OA

UAB small target detection method based on multimodal feature fusion

中文摘要英文摘要

目的:针对无人机平台下小目标检测对高精度与轻量化的双重需求,提出一种基于多模态特征融合的无人机小目标检测方法.方法:首先,通过光照感知型渐进式红外-可见光图像融合网络自适应整合多模态信息,生成红外-可见光融合图像,为后续检测提供更加完备的输入特征.其次,基于YOLOv11构建改进模型,在Backbone(主干网络)的C3k2模块中引入并行化补丁感知注意力(parallelized patch-aware attention,PPA)模块以强化小目标特征提取能力,在Neck(颈部模块)中增加浅层细节融合模块(shallow detail fusion module,SDFM)以提升多尺度特征融合能力,并在Head(头部模块)中采用动态检测头(dynamic head,DyHead)以增强模型对不同尺度目标的检测鲁棒性.最后,采用多场景多模态数据集(Multi-Scenario Multi-Modality Dataset,M3FD)对提出的方法进行验证,并对比在融合图像与单模态图像下改进模型的小目标检测性能以及在融合图像下改进模型与多种主流小目标检测模型对小目标的检测性能.结果:在融合图像下改进模型的mAP50(交并比为0.5时的平均精度均值)为0.811,较在单模态可见光图像(mAP为0.782)与红外图像(mAP为0.798)下分别提升了3.7%和1.6%.在融合图像下改进模型相比主流小目标检测模型综合性能较优.结论:提出的方法实现了检测精度与轻量化的平衡,为无人机战场侦察与伤员搜救任务中小目标检测提供了高效的解决方案.

Objective To propose a UAV small target detection method based on multi-modal feature fusion to meet the requirements for high precision and light weight.Methods Firstly,an illumination-aware progressive infrared-visible image fusion network was employed to adaptively integrate multimodal information,generating fused images to provide comprehen-sive features of small targets for subsequent detection.Secondly,an improved model was constructed based on YOLOv11,and for Backbone a parallelized patch-aware attention(PPA)module was introduced into the C3k2 module to enhance small target feature extraction,a shallow detail fusion module(SDFM)was added into the Neck module to strengthen multi-scale feature integration and a dynamic head(DyHead)was involved in the Head module to improve the detection robustness of the model for multi-scale targets.Finally,the proposed method was validated using the Multi-Scenario Multi-Modality Dataset(M3FD)dataset,and the improved model had its small object detection performance on fused images versus single-modality images compared,whose detection capabilities for fused images were evaluated against mainstream small target detection models.Results The improved model achieved an mAP50(mean average precision at an intersection-over-union ratio of 0.5)of 0.811 for fused images,representing a 3.7%and 1.6%improvement over single-modal visible light images(mAP 0.782)and infrared images(mAP 0.798),respectively.It gained advantages over mainstream small target detection models for fused images.Conclusion The proposed method achieves a balance between detection accuracy and lightweight design,providing an efficient solution for small target detection in battlefield reconnaissance and casualty search-and-rescue missions conducted by unmanned aerial vehicles.[Chinese Medical Equipment Journal,2026,47(1):1-7].

何畅;何密;龚渝顺;刘炳文

陆军军医大学生物医学工程与影像医学系,重庆 400038陆军军医大学生物医学工程与影像医学系,重庆 400038陆军军医大学生物医学工程与影像医学系,重庆 400038陆军军医大学生物医学工程与影像医学系,重庆 400038

医药卫生

YOLOv11小目标检测多模态特征融合无人机深度学习

YOLOv11small target detectionmultimodal feature fusionunmanned aerial vehicle(UAV)deep learning

《医疗卫生装备》 2026 (1)

1-7,7

国家部委研究生重点课题(JY2022B054)重庆市自然科学基金面上项目(CSTB2023NSCQ-MSX0558)

10.19745/j.1003-8868.2026001

评论