首页|期刊导航|通信学报|基于多模态用户图的跨领域服务匹配方法

基于多模态用户图的跨领域服务匹配方法OA

Cross-domain service matching method based on multimodal user graph

中文摘要英文摘要

跨领域服务匹配场景中,用户偏好分布于多个服务领域,并呈现显著的多模态与异构特征,准确刻画用户跨领域偏好是提升匹配性能的关键.针对现有方法普遍依赖统一嵌入空间,易造成多源偏好压缩并忽略模态差异的问题,提出了一种基于多模态用户图的跨领域服务匹配方法.该方法以偏好标签为锚点构建多模态用户图,通过显式建模用户在文本、图像、音频和视频等模态下的偏好结构,并引入开放知识图谱与虚拟辅助节点增强图的连通性.在此基础上,设计模态感知图池化模块MUGPool,实现不同模态偏好的自适应聚合.实验结果表明,所提方法在Amazon多领域多模态数据集上优于多种跨领域服务匹配基线模型.

In cross-domain service matching scenarios,user preferences are distributed across multiple service domains and exhibit pronounc multimodal and heterogeneous characteristics.Accurately modeling users'cross-domain preferences are therefore crucial for improving matching performance.Existing methods predominantly relied on unified embedding spaces,which tended to compress multi-source preferences and overlooked modality-specific discrepancies.To address these limitations,a multimodal user graph-based cross-domain service matching method was proposed.The proposed ap-proach constructed a multimodal user graph using preference labels as anchors,explicitly modeling user preferences across text,image,audio,and video modalities,while incorporating an open knowledge graph and virtual auxiliary nodes to en-hance graph connectivity.Furthermore,a modality-aware graph pooling module,termed MUGPool,was designed to adap-tively aggregate preferences across different modalities.Experimental results on the Amazon multimodal multi-domain data-set demonstrate that the proposed method outperforms state-of-the-art cross-domain service matching baselines.

王海艳;刘万宇;骆健;张少聪

南京邮电大学计算机学院,江苏 南京 210023||大数据安全与智能处理省高校重点实验室,江苏 南京 210023南京邮电大学计算机学院,江苏 南京 210023南京邮电大学计算机学院,江苏 南京 210023||大数据安全与智能处理省高校重点实验室,江苏 南京 210023南京邮电大学计算机学院,江苏 南京 210023

信息技术与安全科学

跨领域服务匹配多模态用户图模态感知图池化模态聚合

cross-domain service matchingmultimodal user graphmodality-aware graph poolingmodality aggregation

《通信学报》 2026 (5)

91-102,12

国家自然科学基金资助项目(No.62272243) The National Natural Science Foundation of China(No.62272243)

10.11959/j.issn.1000-436x.TXXB260048

评论