A Reinforcement Learning Method Based on Hybrid Proximal Policy Optimization for Deformation Control in Machining Titanium Alloy ComponentsOA
A hybrid action deformation control method based on hybrid proximal policy optimization(HPPO)is proposed for titanium alloy structural components.Existing reinforcement learning algorithms are generally confined to either discrete or continuous action spaces,and thus cannot simultaneously optimize machining sequence and allowance.The proposed method unifies both decision variables—machining sequence as discrete actions and machining allowance as continuous parameters—into a single parameterized hybrid action space.Online deformation force monitoring data serve as state feedback to enable adaptive control under dynamic machining conditions.A duallayer reward mechanism combining process-level deformation force uniformity with terminal deformation convergence is designed to guide the agent toward synchronized suppression of both local and global deformations.Experimental validation on a Ti6Al4V aviation structural component demonstrates that the proposed method reduces average machining deformation from 0.103 mm to 0.054 mm,with RMSE decreasing from 0.119 mm to 0.071 mm,representing a 47.57%reduction relative to the uncontrolled case.These results confirm the accuracy and effectiveness of the proposed method in real manufacturing environments.
HE Fangzhou;LIU Changqing;TIE Lei;XU Yiyun;YANG Fan;GAO James;LI Yingguang
College of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.ChinaCollege of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.ChinaCollege of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.ChinaCollege of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.ChinaCollege of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.ChinaCollege of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.ChinaCollege of Mechanical and Electrical Engineering,Nanjing University of Aeronautics and Astronautics,Nanjing 210016,P.R.China
航空航天
titanium alloyhybrid machining processmachining deformation controlhybrid proximal policy optimization(HPPO)
《Transactions of Nanjing University of Aeronautics and Astronautics》 2026 (3)
P.340-355,16
supported by the Key Projects of the Basic Scientific Research Program(No.JCKY2024605B003)National Natural Science Foundation of China(No.52575579).
评论