Adaptive optimal tracking control for underactuated surface vessels using extended state observer and reinforcement learningOA
This paper investigates the adaptive optimal tracking control(AOTC)for underactuated surface vessels(USVs).Compared to the majority of existing studies,the control strategy in this paper innovatively combines an extended state observer(ESO)with reinforcement learning(RL).The designed ESO has high estimation accuracy and robust disturbance rejection capabilities for the unmeasurable information for USVs.To obtain the AOTC,the actor–critic(AC)networks based on RL are constructed to solve the Hamilton–Jacobi–Bellman(HJB)equations.Due to the uncertainties,it is challenging to obtain the optimal controller by directly solving the HJB equations.To address this issue,this paper employs neural networks(NNs)to approximate the uncertainties and solves the optimal controller via AC-RL and ESO.In addition,the adaptive parameters of the optimal controller is trained in parallel with AC networks,which can ensure that the trained networks can further improve tracking performance.The boundedness of AOTC for USVs is shown by Lyapunov stability theorem.Finally,simulation results demonstrate the effectiveness of the proposed algorithm.
Yinkun Li;Yawen Zhou;Yufeng Zhou;Li Chai
School of Artificial Intelligence and Automation,Wuhan University of Science and Technology,Wuhan,430081,ChinaSchool of Artificial Intelligence and Automation,Wuhan University of Science and Technology,Wuhan,430081,ChinaSchool of Artificial Intelligence and Automation,Wuhan University of Science and Technology,Wuhan,430081,ChinaState Key Laboratory of Industrial Control Technology,College of Control Science and Engineering,Zhejiang University,Hangzhou,310027,China Huzhou Institute of Industrial Control Technology,Huzhou,310027,China
交通工程
Extended state observerActor–critic networksReinforcement learningBackstepping methodUnderactuated surface vessel
《Journal of Automation and Intelligence》 2026 (1)
P.24-34,11
supported by the National Natural Science Foundation of China under Grants 62203338,62173259 and U1913602Zhejiang Provincial Natural Science Foundation of China under Grant LZ24F0390006the Postdoctoral Science Foundation of China under Grant 2022M722485.
评论