面向无人机巡检的玉米病虫害图文协同检测模型OA
Image-Text Collaborative Detection Model for Corn Pests and Diseases in Drone-based Inspections
结合无人机巡检与深度学习检测玉米病虫害是智慧农业发展趋势.然而深度学习模型检测性能不仅受图像样本数量影响,还受田间环境、成像质量及模型泛化能力等因素制约,导致单一图像模态难以全面表征病虫害特征.针对上述问题,本文基于YOLO-World 模型,融合文本语义信息,提出一种面向无人机巡检的玉米病虫害图文协同检测模型.该模型结合重参数化视觉几何网络、注意力机制及多尺度融合模块,重构了图像特征提取网络,提高了多尺度图像特征提取能力;通过在文本注入图像中加入特征线性调制层和多类注意力,在图像嵌入文本中加入前馈模块、门控机制和残差结构,改进可重参数化的视觉-语言路径聚合网络,提升了图像与文本特征的语义对齐能力与表达精度.从无人机巡检视角采集500 幅玉米病虫害图像,包含早期玉米黄叶病和虫害导致的烂叶病 2类,并通过数据增强扩展至2 000 幅,结合对应文本描述构建 COCO 格式的多模态数据集.试验结果表明,在 500幅数据集条件下(分别取25-shot、50-shot 训练样本,固定400 幅验证样本),本文模型 mAP@0.5 较单模态 YOLO v8系列提升9.40～10.40 个百分点,较 YOLO-World 提升2.80～4.40 个百分点;在2 000 幅数据集上(按比例8∶2划分训练集与验证集),mAP@0.5 较单模态YOLO v8 系列提高5.40～10.70 个百分点,较YOLO-World 提升3.10 个百分点.该模型可为小样本条件下无人机巡检识别玉米病虫害提供新的研究思路.
Combining drone inspection with deep learning for maize pest and disease detection represents a trend in the development of smart agriculture.However,the detection performance of deep learning models is influenced not only by the number of image samples but also constrained by factors such as field environment,imaging quality,and model generalization capability,making it difficult for a single image modality to fully characterize pest and disease features.To address the above issues,a vision-language collaborative detection model for maize pests and diseases under drone inspection was proposed based on the YOLO-World framework,integrating textual semantic information.The model reconstructed the image feature extraction network by incorporating a re-parameterized visual geometry network,attention mechanisms,and multi-scale fusion modules,thereby improving the multi-scale image feature extraction capability.By adding a feature linear modulation layer and multi-class attention to the text-injected image,and introducing a feed forward module,gating mechanism,and residual structure to the image-embedded text,the re-parameterizable vision-language path aggregation network was enhanced,which improved the semantic alignment capability and expression accuracy between image and text features.In the experiments,totally 500 corn pest and disease images were captured from a drone inspection perspective,including two categories:early corn yellow leaf disease and leaf rot caused by pests.The dataset was augmented to 2 000 images,and a multi-modal dataset in COCO format was constructed by incorporating corresponding textual descriptions.Experimental results showed that on the 500 image dataset(with 25-shot and 50-shot training samples respectively and a fixed validation set of 400 images),the proposed model improved mAP@0.5 by 9.40～10.40 percentage points over the single modal YOLO v8 series and by 2.80～4.40 percentage points over YOLO-World.On the 2 000 image dataset(with an8∶2 training-validation split),mAP@0.5 was improved by 5.40～10.70 percentage points over the single modal YOLO v8 series and by 3.10 percentage points over YOLO-World.This model can provide a research approach for identifying corn pests and diseases under few-shot conditions in drone based inspection.
承达瑜;苏皓;梁优;赵伟;王建东;宋辞
河北工程大学矿业与测绘工程学院,邯郸 056038||地理信息科学与技术全国重点实验室,北京 100101河北工程大学信息与电气工程学院,邯郸 056038河北工程大学矿业与测绘工程学院,邯郸 056038华南师范大学北斗研究院,佛山 528225中国农业科学院农业环境与可持续发展研究所,北京 100081地理信息科学与技术全国重点实验室,北京 100101
玉米病虫害无人机巡检YOLO-World多模态小样本检测
corn diseases and pestsunmanned aerial vehicle inspectionYOLO-Worldmulti-modalfew-shot object detection
《农业机械学报》 2026 (18)
106-116,11
河北省重大科技成果转化专项(22287401Z)、国家自然科学基金项目(42171212)和地理信息科学与技术全国重点实验室开放基金项目
评论