首页|期刊导航|重庆理工大学学报|基于安全强化学习的交叉口多车协同决策方法

基于安全强化学习的交叉口多车协同决策方法OA

Multi-vehicle cooperative decision-making method with safe reinforcement learning at urban intersections

中文摘要英文摘要

针对城市路口多车驾驶场景中,如何准确表征自动驾驶车辆之间的动态交互,优化通行顺序,确保驾驶安全,提出一种基于多智能体安全强化学习的协同控制方法,旨在避免因缺乏安全约束引发的不安全行为.将约束马尔可夫博弈与多智能体强化学习相结合,利用拉格朗日乘子法与多智能体深度确定性策略梯度算法,在最大化奖励的同时最小化安全成本,以限制危险行为;提出安全经验回放机制,避免决策空间受限带来适应性下降和局部最优问题.仿真结果表明,所提方法在安全性方面优于基准算法,可使碰撞率下降至8.6%,能有效提升该场景下自动驾驶车辆的协同决策能力.

At urban intersections with multiple vehicles in motion,effectively characterizing the dynamic interactions between autonomous vehicles,optimizing right-of-way sequences,and ensuring driving safety remain significantly challenging.This paper proposes a collaborative control method based on safe multi-agent reinforcement learning to mitigate unsafe behaviors caused by the lack of safety constraints.First,the constrained Markov game(CMG)is integrated with multi-agent reinforcement learning.The Lagrange multiplier method and multi-agent Deep Deterministic Policy Gradient algorithm are employed to maximize the reward while minimizing the safety costs to limit dangerous behaviors.Next,a safety-awareness experience replay mechanism is proposed to mitigate the adaptability degradation and the potential for suboptimal solutions caused by over-restricting individual agents decision-making.Simulation results demonstrate the proposed algorithm outperforms existing baseline methods in safety,achieving a collision rate of 8.6%,effectively improving the collaborative decision-making capabilities of self-driving vehicles.

黄亚飞;石晴;田浩;张云龙;胡伟

贵州大学 现代制造技术教育部重点实验室,贵阳 550025贵州大学 现代制造技术教育部重点实验室,贵阳 550025贵州师范大学 大数据与计算机科学学院,贵阳 550025中国电子科技集团公司第五十四研究所,石家庄 050081北京交通大学 电子信息工程学院,北京 100044

信息技术与安全科学

多智能体强化学习安全强化学习协同通行策略自动驾驶

multi-agent reinforcement learningsafe reinforcement learningcooperative driving strategyautonomous driving

《重庆理工大学学报》 2026 (1)

54-61,8

贵州省科技厅自然科学项目(黔科合基础-ZK[2023]一般056)贵州大学高层次人才科研项目(贵大人基合字[2021]56号)贵州大学科研平台支持项目(202101347720230009002023000885)贵州省智能网联汽车创新人才团队项目(CXTD2022-009)

10.3969/j.issn.1674-8425(z).2026.01.007

评论