基于条件扩散概率模型的视频异常检测OA
A conditional diffusion model for video anomaly detection
视频异常检测在现代社会中越来越重要,由于视频中存在多样的模糊行为,并且类别无法穷举,基于单分类的方法难以界定正常和异常事件.针对以上问题,提出了基于条件扩散概率模型的视频异常检测模型CDiffuVAD.首先,设计了一个常态内容生成器,用于提高生成图像的准确性.它通过记忆池增强模型对正常样本分布特征的理解,并借助扩散概率模型来学习视频数据的复杂分布.其次,引入了隐式运动条件来学习视频片段的时空特征,将双向光流信息作为扩散过程的隐式运动条件,并采用坐标归一化方法提供片段帧的坐标嵌入,从而实现对多帧序列数据中的运动趋势的学习拟合,缓解模型对视频中的正常行为模式(硬正态信息)敏感的问题.实验表明,所提出的模型在Avenue数据集、ShanghaiTech数据集和UBnormal数据集上分别达到85.7%,75.5%和65.7%的帧级AUC值,表明其可以发现正常样本中多样的特征,并在视频异常检测任务中表现有效.
Video anomaly detection is becoming increasingly important in modern society.Because there are various fuzzy behaviors in videos and the categories cannot be exhaustive,it is difficult to de-fine normal and abnormal based on single-classification methods.In response to the aforementioned is-sues,a conditional diffusion probabilistic model for video anomaly detection(CDiffuVAD)is proposed.Firstly,a normal content generator is designed to improve the content accuracy of the image generated by the model.It highlights the distribution pattern of normal samples through a memory pool and lever-ages the diffusion probability model to learn the complex distribution of video data.Secondly,implicit motion conditions are designed and introduced to learn the spatiotemporal features of video segments.The bidirectional optical flow information is used as the implicit motion condition of the diffusion process,and the coordinate normalization method is used to provide the coordinate embedding of the segment frame,so as to realize the learning and fitting of the motion trend in the multi-frame sequence data and alleviate the sensitivity of the model to the hard normal information in the video.Experimental results show that the proposed method achieves frame-level AUC scores of 85.7%on the Avenue data-set,75.5%on the ShanghaiTech dataset,and 65.7%on the UBnormal dataset,demonstrating its abili-ty to capture diverse features in normal samples and its effectiveness in video anomaly detection tasks.
叶亚琴;汤子健;牛嘉诚;张新欢
中国地质大学(武汉)计算机学院,湖北 武汉 430078||中国地质大学(武汉)智能地学信息处理湖北省重点实验室,湖北 武汉 430078中国地质大学(武汉)计算机学院,湖北 武汉 430078中国地质大学(武汉)计算机学院,湖北 武汉 430078中国地质大学(武汉)计算机学院,湖北 武汉 430078
信息技术与安全科学
视频异常检测扩散模型不确定性记忆池生成模型
video anomaly detectiondiffusion modeluncertaintymemory poolgenerative model
《计算机工程与科学》 2026 (8)
1433-1444,12
湖北省智能地学信息处理重点实验室开放研究项目(KLIGIP-2022-B14)桐兴(湖北)投资咨询有限公司项目(2021116490)
评论