基于多尺度融合和双记忆单元的视频异常检测OA
Video Anomaly Detection Based on Multi-scale Fusion and Dual Memory Units
在弱监督视频异常检测任务中,现有方法常因过度聚焦异常特征建模而忽视正常行为的时序规律学习,导致特征空间中正常与异常的判别边界模糊,进而引发定位偏差与高误报率问题.该文提出了一种基于多尺度融合和双记忆单元的视频异常检测模型.该模型设计了一个多尺度融合模块(MSTF),并行提取短时序动作细节与长时序事件上下文,经自适应卷积融合后生成包含多粒度时序语义的特征表示,以解决传统单尺度卷积的上下文缺失问题;提出了双分支动态位置注意力机制(DPAM),采用时间分支建模帧间依赖模式,内容分支使用正弦余弦位置编码与注意力分数加权融合,精确捕捉视频帧间的时序依赖,显著提升异常事件的时间定位精度;引入通道门控机制减少不同通道间的信息重叠、噪声干扰,并强化异常相关通道,有效解决了特征融合时的信息冗余问题.实验结果表明,该方法在 XD-Violence 数据集上的AP 指标值达到82.42%,在 UCF-Crime 数据集上的 AUC 指标值达到 86.71%,优于多数主流方法,尤其在 XD-Violence数据集上的表现更为突出,比 baseline 高出了2.8 百分点,具有一定的竞争力.
In the task of weakly supervised video anomaly detection,existing methods often neglect the learning of the temporal patterns of normal behaviors due to excessive focus on the modeling of abnormal features,resulting in a blurred boundary for distinguishing normal from abnormal in the feature space,which in turn leads to problems of positioning deviation and high false alarm rate.We propose a video anomaly detection model based on multi-scale fusion and dual memory units.This model designs a multi-scale fusion module(MSTF)to extract the details of short-sequence actions and the context of long-sequence events in parallel.After adaptive convolution fusion,a feature representation containing multi-granularity temporal semantics is generated to solve the problem of context loss in traditional single-scale convolution.The dual-branch dynamic position attention mechanism(DPAM)is proposed.The time branch is adopted to model the inter-frame dependency pattern.The content branch uses sine and cosine position coding and weighted fusion of at-tention scores to accurately capture the temporal dependency between video frames and significantly improve the temporal positioning accuracy of abnormal events.The introduction of channel gating mechanisms reduces information overlap and noise interference between different channels,and strengthens abnormally correlated channels,effectively solving the problem of information redundancy during feature fusion.The experimental results show that the AP index value of the proposed method on the XD-Violence dataset reaches 82.42%,and the AUC index value on the UCF-Crime dataset reaches 86.71%,which is superior to most mainstream methods,especially the performance on the XD-Violence dataset is more outstanding.It is 2.8 percentage points higher than the baseline and has certain competitiveness.
张艳;赵月爱;孔李沛;王玲
太原师范学院 计算机科学与技术学院,山西 晋中 030602||山西智能优化计算与区块链技术重点实验室,山西 晋中 030619太原师范学院 计算机科学与技术学院,山西 晋中 030602||山西智能优化计算与区块链技术重点实验室,山西 晋中 030619太原师范学院 计算机科学与技术学院,山西 晋中 030602||山西智能优化计算与区块链技术重点实验室,山西 晋中 030619山西大学 自动化与软件学院,山西 太原 030006
信息技术与安全科学
视频异常检测多尺度融合双记忆单元双分支动态位置注意力通道门控机制
video anomaly detectionmulti-scale fusiondual memory unitdual-branch dynamic position attentionchannel gating mechanisms
《计算机技术与发展》 2026 (4)
69-77,9
山西省科技战略研究专项重点项目(202304031401011)太原师范学院研究生实践创新项目(SYYJSYC-2590)
评论