首页|期刊导航|计算机科学与探索|结合多模态时序特征与变分编码的视频流行度预测算法

结合多模态时序特征与变分编码的视频流行度预测算法OA

Video Popularity Prediction Algorithm Combining Multi-modal Temporal Features and Variational Encoding

中文摘要英文摘要

当前,视频流行度预测在社交媒体营销、智能广告投放等领域应用广泛,传统的基于多元线性回归、支持向量回归模型等的预测方法在处理数据多样性、捕捉预测的不确定性等方面存在一定的局限性.从多模态数据出发,提出了一种多模态时序变分自编码器(MTVAE)视频流行度预测模型.从视频数据中提取视觉、音频、文本和社交等多模态特征,利用变分自编码器对多模态特征进行降维并提取隐层信息,借助时间卷积网络挖掘长序列特征的内在联系,同时在网络层面添加了残差连接,用于增强模型的深度表达能力和训练稳定性.运用贝叶斯专家乘积系统进行多模态特征融合与预测判别.构建了基于新浪微博平台的全过程多属性视频流行度预测数据集(WPMAD),弥补了当前数据集在模态多样性、时序完整性等方面的不足.大量的实验结果表明,MTVAE模型在WPMAD数据集上的预测准确率提升了3.93个百分点,在公开数据集MicroLens上的预测准确率也有所提升,较之于当前已存在的预测方法,性能表现更为优异,为社交媒体平台内容推荐、舆情监测等应用方向提供了创新性的技术支持.

Currently,video popularity prediction is widely used in social media marketing,intelligent advertisement place-ment,etc.Traditional prediction methods based on multiple linear regression,support vector regression model,etc.,have some limitations in dealing with data diversity and capturing prediction uncertainty.A multi-modal temporal variational autoencoder(MTVAE)video popularity prediction model is proposed from multi-modal data.Multi-modal features such as visual,audio,text and social are extracted from video data,and the MTVAE is used to downsize the multi-modal fea-tures and extract the hidden information.The intrinsic connection of long sequential features is mined with the help of temporal convolution network,while residual connectivity is added at the network level to enhance the deep expression capability and the training stability of the model.A Bayesian expert product system is applied to perform multi-modal fea-ture fusion and prediction discrimination.In addition,whole-process multi-attribute video popularity prediction dataset(WPMAD)based on Sina Weibo platform is constructed,which makes up for the deficiencies of the current dataset in terms of modal diversity and temporal integrity.A large number of experimental results show that the MTVAE model improves prediction accuracy by 3.93 percentage points on the WPMAD dataset and also improves prediction accuracy on the public MicroLens dataset.Compared with existing prediction methods,it performs better and provides innovative tech-nical support for applications such as content recommendation and public opinion monitoring on social media platforms.

水映懿;张琪;李根;张士豪

中国人民公安大学信息网络安全学院,北京 100038中国人民公安大学信息网络安全学院,北京 100038中国人民公安大学信息网络安全学院,北京 100038中国人民公安大学信息网络安全学院,北京 100038

信息技术与安全科学

视频流行度预测变分自编码器时间卷积网络多模态融合社交媒体

video popularity predictionvariational autoencodertemporal convolutional networkmulti-modal fusionsocial media

《计算机科学与探索》 2026 (4)

1115-1133,19

中央高校基本科研业务费(2024JKF02ZK09).This work was supported by the Fundamental Research Funds for the Central Universities of China(2024JKF02ZK09).

10.3778/j.issn.1673-9418.2505005

评论