首页|期刊导航|Tsinghua Science and Technology|Improving the SGD Optimizer from the Perspective of ODE for Plant Disease Identification

Improving the SGD Optimizer from the Perspective of ODE for Plant Disease IdentificationOA

中文摘要

Identification of plant diseases is crucial for the healthy growth of plants.Notably,the identification depends on the details of images and should adapt to the variability of real-world conditions,which imposes high demands on the convergence and generalization capabilities of optimizers for deep neural networks(DNNs).However,traditional optimizers need help ensuring effective convergence and achieving satisfactory generalization.To address this issue,we interpret the optimization process of DNNs as an initial-value problem associated with the gradient flow of an ordinary differential equation(ODE),which is solved by discretization using a high-order multistep method.Then,an improved stochastic gradient descent(SGD)-based optimizer is proposed and characterized by high-order accuracy and zero stability,thereby enhancing convergence to zerogradient points.The construction of this optimizer is equivalent to increasing the learning rate,which enhances generalization while ensuring convergence.Plant disease identification relies on detailed analysis of plant images,necessitating a well-converged optimization method.Furthermore,generalizing to unseen cases is crucial for effective plant disease identification.In experiments of plant disease identification,the proposed method demonstrates effective convergence and satisfactory generalization,demonstrating significant practical utility.The method provides a new perspective for designing optimizers that enable DNNs to achieve excellent performance and reliability.

Tian Jin;Jun Kong

School of Information Science and Technology,Northeast Normal University,Changchun 130000,ChinaSchool of Information Science and Technology,Northeast Normal University,Changchun 130000,China

农业科技

deep neural networks(DNNs)gradient flownumerical methodsplant disease identification

《Tsinghua Science and Technology》 2026 (3)

P.1652-1660,9

supported by the National Natural Science Foundation of China(No.62272096)the Jilin Provincial Science and Technology Department of China(No.20230201079GX).

10.26599/TST.2024.9010189

评论