首页|期刊导航|计算机科学与探索|多模态信息与门控注意力协同驱动的知识图谱补全方法

多模态信息与门控注意力协同驱动的知识图谱补全方法OA

Knowledge Graph Completion Method Driven by Multimodal Information and Gated Attention Collaboration

中文摘要英文摘要

知识图谱补全旨在通过已有结构信息推断缺失三元组,提升图谱的完整性与推理能力.传统结构化嵌入模型在建模实体关系交互方面表现良好,但在处理稀疏实体或复杂语义关系时常面临表示能力不足的问题.近年来,预训练语言模型的发展为引入实体文本语义信息提供了新思路,然而如何有效融合结构与语义信息仍面临挑战.针对现有知识图谱补全方法在结构建模能力不足或语义融合不充分等问题,提出一种融合结构信息与文本语义的混合模型HST-KG.该模型以TuckER作为结构编码器以捕捉实体-关系交互模式,引入BERT获取实体与关系描述的上下文语义,并设计门控注意力融合机制对结构与语义嵌入进行动态加权,实现多模态信息的自适应协同建模.在FB15K-237和WN18RR两个基准数据集上的实验结果表明,所提出的HST-KG模型相较最新的语义增强模型ISA-KGC均取得了更优的性能.在FB15K-237数据集上,HST-KG在Hits@1和Hits@3指标上分别提升了2.2与6.5个百分点;在WN18RR数据集上,MRR与Hits@10指标分别提升了0.7与0.8个百分点,验证了该方法在复杂关系建模与稀疏实体预测中的有效性.

Knowledge graph completion aims to infer missing triples based on existing structural information,thereby enhancing the completeness and reasoning capabilities of the graph.Traditional structure-based embedding models perform well in modeling entity-relation interactions but often struggle with sparse entities and complex semantic relations due to limited representational capacity.With the recent advancements in pretrained language models,incorporating textual semantics of entities has emerged as a promising direction.However,effectively integrating structural and semantic infor-mation remains a challenge.To address the insufficient structural modeling and inadequate semantic fusion in existing methods,this paper proposes a hybrid model named HST-KG(hybrid struct text KG-model),which integrates structural information and textual semantics.Specifically,TuckER is employed as the structural encoder to capture entity-relation interaction patterns,while BERT(bidirectional encoder representations from transformers)is utilized to extract contextual semantics from entity and relation descriptions.Furthermore,a gated attention fusion mechanism is designed to dynamically weight structural and semantic embeddings,enabling adaptive multimodal collaborative modeling.Experimental results on two benchmark datasets,FB15K-237 and WN18RR,demonstrate that the proposed HST-KG outperforms the latest semantic-enhanced model ISA-KGC.On FB15K-237,HST-KG achieves improvements of 2.2 and 6.5 percentage points in Hits@1 and Hits@3,respectively;on WN18RR,it achieves gains of 0.7 percentage points in MRR and 0.8 percentage points in Hits@10.These results validate the effectiveness of the proposed method in complex relation modeling and sparse entity prediction.

李亚峥;赵妍;刘宇航;季伟东;杨建柏

哈尔滨师范大学 计算机科学与信息工程学院,哈尔滨 150025哈尔滨师范大学 计算机科学与信息工程学院,哈尔滨 150025哈尔滨师范大学 计算机科学与信息工程学院,哈尔滨 150025哈尔滨师范大学 计算机科学与信息工程学院,哈尔滨 150025哈尔滨师范大学 计算机科学与信息工程学院,哈尔滨 150025

信息技术与安全科学

知识图谱补全多模态融合结构化嵌入预训练语言模型门控注意力机制

knowledge graph completionmultimodal fusionstructured embeddingpretrained language modelgated attention mechanism

《计算机科学与探索》 2026 (5)

1455-1464,10

黑龙江省自然科学基金(PL2024F007).This work was supported by the Natural Science Foundation of Heilongjiang Province(PL2024F007).

10.3778/j.issn.1673-9418.2506054

评论