首页|期刊导航|计算机工程与应用|基于图数据增强与多模态特征对齐的虚假新闻检测

基于图数据增强与多模态特征对齐的虚假新闻检测OA

Fake News Detection Based on Graph Data Augmentation and Multimodal Feature Alignment

中文摘要英文摘要

虽然研究人员开展了丰富的多模态虚假新闻检测研究,但仍存在大型语言模型的知识幻觉问题以及跨模态语义不一致性两大挑战.为了解决上述问题,提出一种基于图数据增强与多模态特征对齐的虚假新闻检测模型GDAFMA.利用大语言模型构建新闻文档风格、信源权威性和图像描述的多维度提示模板,实现细粒度语义解构.将语义信息转换为图结构,通过图知识增强和图编码解码机制实现跨模态深度推理.设计多模态局部与全局特征对齐策略,完成语义一致性验证和综合可信度评估.在GossipCop、Weibo以及PolitiFact三个公开数据集上的实验结果表明,GDAFMA的分类准确度分别高达0.868、0.916以及0.898,远高于所有基线方法,证明所提方法能显著提升多模态虚假新闻的检测性能.

Although researchers have conducted extensive research on multimodal fake news detection,there are still two major challenges:knowledge illusion in large language model(LLM)and cross modal semantic inconsistency.To address the above issues,a fake news detection model GDAFMA based on graph data augmentation and multimodal feature align-ment is proposed.Firstly,the LLM is used to construct multi-dimensional prompt templates for news document style,source authority,and image description,achieving fine-grained semantic deconstruction.Secondly,semantic information is transformed into graph structures,and cross modal deep inference is achieved through graph knowledge enhancement and graph encoding decoding mechanisms.Finally,a multimodal local and global feature alignment strategy is designed to achieve semantic consistency verification and comprehensive credibility evaluation.The experimental results on three publicly available datasets,GossipCop,Weibo,and PolitiFact,show that the classification accuracy of GDAFMA is as high as 0.868,0.916,and 0.898,respectively,far higher than all baseline methods,proving that it can significantly improve the multimodal fake news detection results.

李洁;孙国营;段伊晴;王海龙;柳林

内蒙古师范大学 计算机科学技术学院,呼和浩特 010020||澳门科技大学 国际学院,澳门 999078内蒙古师范大学 计算机科学技术学院,呼和浩特 010020||哈尔滨工业大学 网络与信息安全技术研究中心,哈尔滨 150006内蒙古师范大学 计算机科学技术学院,呼和浩特 010020内蒙古师范大学 计算机科学技术学院,呼和浩特 010020内蒙古师范大学 计算机科学技术学院,呼和浩特 010020

信息技术与安全科学

多模态虚假新闻检测多维度提示模板图数据增强图编码解码多模态特征对齐

multimodal fake news detectionmulti-dimensional prompt templatesgraph data augmentationgraph encoding decodingmultimodal feature alignment

《计算机工程与应用》 2026 (9)

145-158,14

国家自然科学基金地区科学基金(62567004).

10.3778/j.issn.1002-8331.2510-0249

评论