基于时空交互信息融合的车辆违规超车识别OA
Spatiotemporal Interaction Information Fusion for Vehicle Illegal Overtaking Recognition
为提升车辆违规超车行为的识别精度,本文提出了基于时空交互信息融合的违规超车识别算法.该算法以 TimeSformer 为主干模型,融合 RGB 图像、光流、深度图以及超车交互图四种模态信息,构建统一的超车信息图,从外观特征、运动特性、三维空间结构以及车辆间交互关系等多个维度对超车行为进行联合建模.通过引入分离时空注意力机制以及多模态特征融合策略,有效刻画超车过程中目标车辆的动态演化特征及其与周围车辆之间的时空交互模式,从而弥补复杂交通场景下多车辆交互关系表述不足的问题.在 PREVENTION 数据集上的实验结果表明,所提算法在违规超车识别任务中取得了 94.04%的识别准确率,较多种主流基准算法表现出更优的识别性能,验证了多模态时空交互信息融合策略在复杂交通行为识别中的有效性.
To improve the accuracy of vehicle illegal overtaking recognition,this paper proposes spatiotemporal interaction information fusion for vehicle illegal overtaking recognition algorithm.The algorithm is built upon the TimeSformer architecture as the backbone model.Four types of modality information,namely RGB images,optical flow,depth maps,and overtaking interaction graphs,are integrated to construct a unified overtaking information graph.From multiple perspectives,including appearance features,motion information,3D spatial structure,and inter-vehicle interaction relationships,the method performs joint modeling of overtaking behaviors.By introducing divided space-time attention mechanism and multi-modal feature fusion strategy,the proposed approach effectively captures the dynamic evolution of the target vehicle during the overtaking process as well as its spatiotemporal interactions with surrounding vehicles,thereby alleviating the insufficient representation of multi-vehicle interactions in complex traffic scenarios.Experimental results on the PREVENTION dataset show that the proposed algorithm achieves a recognition accuracy of 94.04%for illegal overtaking behaviors,outperforming several existing mainstream algorithms and validating the effectiveness of multimodal spatiotemporal interaction information fusion for complex traffic behavior recognition.
巢新;吉根林;赵斌;麦丞程;王嘉琦
南京师范大学地理科学学院,江苏 南京 210023||南京师范大学计算机与电子信息学院/人工智能学院,江苏 南京 210023南京师范大学计算机与电子信息学院/人工智能学院,江苏 南京 210023南京师范大学计算机与电子信息学院/人工智能学院,江苏 南京 210023南京师范大学计算机与电子信息学院/人工智能学院,江苏 南京 210023南京师范大学计算机与电子信息学院/人工智能学院,江苏 南京 210023||南京师范大学 数学科学学院,江苏 南京 210023
交通工程
智能交通车辆违规超车行为识别时空交互信息融合多车辆交互建模TimeSformer
intelligent transportationvehicle illegal overtaking recognitionspatiotemporal interaction information fusionmulti-vehicle interaction modelingTimeSformer
《南京师大学报(自然科学版)》 2026 (2)
85-97,13
国家自然科学基金项目(41971343)、江苏省前沿技术研发计划项目(BF2024005).
评论