首页|期刊导航|聊城大学学报(自然科学版)|基于融合社交模型的多智能体强化学习导航方法

基于融合社交模型的多智能体强化学习导航方法OACHSSCD

An integrated social-model approach to multi-agent navigation

中文摘要英文摘要

密集人群环境中的多智能体协同导航仍面临交互关系复杂、社交规范难以建模等问题.为提升智能体在复杂环境中的避碰效率与社交适应性,构建了一种基于RVO与SFM建立融合式社会性交互模型的多智能体导航方法(即SFMRVO-DRL),通过碰撞风险调节两者权重,实现高效避障与自然运动的统一.在此基础上,设计包含图注意力机制的决策结构,用以捕捉智能体间的动态关联,并引入右手通行规则构建多目标奖励函数,以增强策略的社交合规性与稳定性.训练过程中采用 MAPPO在集中训练、分散执行框架下实现策略优化.实验结果表明,该方法在典型圆形交互场景中,相较GA3C-CADRL、NH-ORCA与HeR-DRL在成功率、导航时间与速度等指标上均具有显著优势.研究验证了RVO-SFM融合交互建模、注意力图社交感知与社交规范驱动的多目标强化学习对提升复杂人群导航性能的有效性.图社交感知与社交规范驱动的多目标强化学习对提升复杂人群导航性能的有效性.

Multi-agent cooperative navigation in dense crowds remains challenging due to complex interac-tion patterns and the difficulty of modeling social norms.To enhance collision avoidance efficiency and so-cial adaptability in such environments,this paper proposes SFMRVO-DRL,a multi-agent navigation framework that integrates Reciprocal Velocity Obstacles(RVO)with the Social Force Model(SFM)into a unified hybrid social interaction model.The framework adaptively balances the two components based on collision risk,enabling both efficient collision avoidance and naturalistic motion.Building on this hybrid interaction model,we design a decision architecture incorporating a graph attention mechanism to capture dynamic inter-agent relationships,and introduce a multi-objective reward function grounded in right-hand passing conventions to improve social compliance and policy stability.The proposed method employs MAPPO for policy optimization under a centralized-training and decentralized-execution paradigm.Experi-mental results in a canonical circular crowd-interaction scenario demonstrate that our approach significantly outperforms GA3C-CADRL,NH-ORCA,and HeR-DRL in terms of success rate,navigation time,and speed.This study highlights the effectiveness of hybrid RVO-SFM interaction modeling,attention-based social perception,and socially normative multi-objective reinforcement learning in advancing multi-agent navigation performance in complex crowd environments.

徐文博;胡春鹤

北京林业大学 工学院,北京 100083北京林业大学 工学院,北京 100083

信息技术与安全科学

深度强化学习多智能体社会力模型社交导航

deep reinforcement learningmulti-agentsocial force modelsocially navigation

《聊城大学学报(自然科学版)》 2026 (4)

486-497,12

北京林业大学科技创新计划项目(2024XY-G009)资助

10.19728/j.issn1672-6634.2025120008

评论