基于多特征融合的行人过街意图推理方法OA
Pedestrian crossing intent inference method based on multi-feature fusion
准确理解和预测行人过街意图对自动驾驶汽车的行驶安全至关重要.现有方法多依赖于行人轨迹或整体身体姿态等视觉运动特征,而对行人与车辆之间的交互信号关注不足,因此难以捕捉行人通过手势、头部朝向等细微信号所传递的通行意图.为了解决这些限制,提出了准确推理行人过街意图(accurate reasoning for pedestrian crossing intent,ARPCI)框架,这是一个多特征融合框架.具体而言,设计了一个行人特征模块,该模块首先关注行人的骨架特征以捕捉行人的运动趋势,在此基础上利用MobileNet提取头部姿态特征,结合YOLOv8n识别手部动作,从而获得行人与车辆间的交互信号.此外,还引入了场景编码模块和自车特征模块,这能够有效融合环境上下文与车辆动态信息,增强模型对复杂交通场景的适应能力,提高对行人过街意图的预测准确率.在广泛使用的JAAD数据集上进行的实验表明,该方法准确率达到了88%,优于多个同类模型SOTA(state of the art),消融实验也进一步验证了各输入特征的有效性.
Accurately understanding and predicting pedestrian crossing intent is crucial for ensuring the safety of autono-mous vehicles.Existing approaches are often limited to visual motion cues such as pedestrian trajectories or body poses,while overlooking interactive signals like gestures and head orientations,making it difficult to capture key cues of pedestrian-vehicle interaction.To address these limitations,ARPCI(accurate reasoning for pedestrian crossing intent)was proposed,a multi-feature fusion framework designed for pedestrian intent inference.Specifically,a pedestrian feature module was developed that first focused on skeleton-based features to capture motion trends,and further leveraged Mo-bileNet to extract head pose features.Combined with YOLOv8n for gesture recognition,pedestrian-vehicle interaction signals were captured more comprehensively by the model.In addition,a scene encoding module and a self-vehicle fea-ture module were introduced to integrate contextual and ego-dynamic information,thereby enhancing adaptability to com-plex traffic environments and improving prediction accuracy.Extensive experiments on the widely used JAAD dataset show that the approach achieves an accuracy of 88%,surpassing several state-of-the-art counterparts.Moreover,the abla-tion studies provide further evidence of the effectiveness of the proposed input features.
尹守国;杜泉成;李灵犀;王晓;孙长银
安徽大学人工智能学院,安徽 合肥 230601北京科技大学计算机与通信工程学院,北京 100083美国普渡大学电子与计算机工程系,印第安纳州 西拉法叶 IN 46204安徽大学人工智能学院,安徽 合肥 230601||光电信息获取与防护技术全国重点实验室,安徽 合肥 230031安徽大学,安徽 合肥 230601
信息技术与安全科学
行人过街意图多模态特征融合交互信号行驶安全
pedestrian crossing intentionmulti-feature fusioninteraction signaltraffic safety
《智能科学与技术学报》 2026 (1)
47-60,14
国家自然科学基金项目(No.62522601)The National Natural Science Foundation of China(No.62522601)
评论