基于安全强化学习的交叉口多车协同决策方法OA
Multi-vehicle cooperative decision-making method with safe reinforcement learning at urban intersections
针对城市路口多车驾驶场景中,如何准确表征自动驾驶车辆之间的动态交互,优化通行顺序,确保驾驶安全,提出一种基于多智能体安全强化学习的协同控制方法,旨在避免因缺乏安全约束引发的不安全行为.将约束马尔可夫博弈与多智能体强化学习相结合,利用拉格朗日乘子法与多智能体深度确定性策略梯度算法,在最大化奖励的同时最小化安全成本,以限制危险行为;提出安全经验回放机制,避免决策空间受限带来适应性下降和局部最优问题.仿真结果表明,所提方法在安全性方面优于基准算法,可使碰撞率下降至8.6%,能有效提升该场景下自动驾驶车辆的协同决策能力.
At urban intersections with multiple vehicles in motion,effectively characterizing the dynamic interactions between autonomous vehicles,optimizing right-of-way sequences,and ensuring driving safety remain significantly challenging.This paper proposes a collaborative control method based on safe multi-agent reinforcement learning to mitigate unsafe behaviors caused by the lack of safety constraints.First,the constrained Markov game(CMG)is integrated with multi-agent reinforcement learning.The Lagrange multiplier method and multi-agent Deep Deterministic Policy Gradient algorithm are employed to maximize the reward while minimizing the safety costs to limit dangerous behaviors.Next,a safety-awareness experience replay mechanism is proposed to mitigate the adaptability degradation and the potential for suboptimal solutions caused by over-restricting individual agents decision-making.Simulation results demonstrate the proposed algorithm outperforms existing baseline methods in safety,achieving a collision rate of 8.6%,effectively improving the collaborative decision-making capabilities of self-driving vehicles.
黄亚飞;石晴;田浩;张云龙;胡伟
贵州大学 现代制造技术教育部重点实验室,贵阳 550025贵州大学 现代制造技术教育部重点实验室,贵阳 550025贵州师范大学 大数据与计算机科学学院,贵阳 550025中国电子科技集团公司第五十四研究所,石家庄 050081北京交通大学 电子信息工程学院,北京 100044
信息技术与安全科学
多智能体强化学习安全强化学习协同通行策略自动驾驶
multi-agent reinforcement learningsafe reinforcement learningcooperative driving strategyautonomous driving
《重庆理工大学学报》 2026 (1)
54-61,8
贵州省科技厅自然科学项目(黔科合基础-ZK[2023]一般056)贵州大学高层次人才科研项目(贵大人基合字[2021]56号)贵州大学科研平台支持项目(202101347720230009002023000885)贵州省智能网联汽车创新人才团队项目(CXTD2022-009)
评论