基于多模态融合的水稻生育期智能识别方法OA
Intelligent Recognition Method of Rice Growth Stage Based on Multimodal Fusion
[目的]水稻生育期是水稻种植管理过程中灌溉、施肥和病虫害防控措施的重要参考指标.研究基于多模态融合的水稻生育期智能识别方法,提高水稻生育期识别准确率,对优化水稻种植管理措施,提升水稻产量具有重要意义.[方法]针对RGB图像易受光照影响,提取H颜色通道图像,建立基于残差网络与注意力机制的双分支水稻生育期图像识别模型;由于气象因子影响水稻生育期长短,建立基于 3 个气象因子和双向长短期记忆网络的水稻生育期气象识别模型;利用决策树进行决策级多模态特征融合,在自建数据集上进行多种模型的训练和测试.[结果]改进的水稻生育期图像识别模型准确率达到 84.25%,优于ResNet50、ConvNeXt等传统图像识别模型.基于图像和气象的多模态模型对 9 个水稻生育期识别准确率达到 87.66%,优于单一图像和气象的单模态识别模型.[结论]基于图像与气象融合的多模态识别模型弥补了单模态识别方法的不足,相较于单模态识别模型,显著提升了对 9 个水稻生育期的识别准确率.
[Objective]The growth period of rice is an important reference indicator for irrigation,fertilization,and pest control measures in rice planting management.Researching an intelligent recognition method for rice growth period based on multimodal fusion,improving the accuracy of rice growth period recognition,is of great significance for optimizing rice planting management measures and increasing rice yield.[Method]To address the vulnerability of RGB images to lighting,an H-color channel image is extracted,and a dual-branch rice growth stage image recognition model based on residual network and attention mechanism is established;Due to the influence of meteorological factors on the length of rice growth period,a rice growth period meteorological identification model based on three meteorological factors and a bidirectional long-short period network is established;Using decision trees for decision-level multimodal feature fusion,multiple models were trained and tested on a self-built rice growth period dataset.[Result]The improved rice growth period image recognition model achieved an accuracy of 84.25%,which is superior to traditional image recognition models such as ResNet50 and ConvNeXt.The multi-modality model based on images and meteorological achieved an accuracy of 87.66%in identifying 9 rice growth stages,which is superior to the single modality recognition model based on images and meteorology.[Conclusion]The multimodal recognition model based on image and meteorological fusion compensates for the shortcomings of single modal recognition methods.Compared with single modal recognition models,it has significantly improved the accuracy of identifying 9 rice growth stages.
许永炜;刘淑华;冯泽霖;罗举;倪兆新;杨保军;姚青;李阿根
浙江理工大学 计算机科学与技术学院,杭州 310018中国水稻研究所,杭州 311401浙江理工大学 计算机科学与技术学院,杭州 310018||浙江理工大学 信息与控制学院,杭州 312369中国水稻研究所,杭州 311401浙江理工大学 计算机科学与技术学院,杭州 310018中国水稻研究所,杭州 311401浙江理工大学 计算机科学与技术学院,杭州 310018余杭区农业生态与植物保护服务站,杭州 311100
水稻生育期多模态融合图像模态气象模态决策树
rice growth periodmultimodalimage modalitymeteorological modalitydecision tree
《中国水稻科学》 2026 (5)
663-678,16
浙江省"三农九方"科技协作计划项目(2024SNJF010)浙江省农业重大技术协同推广计划项目(2023ZDXT01-5).
评论