基于多模态用户图的跨领域服务匹配方法OA
Cross-domain service matching method based on multimodal user graph
跨领域服务匹配场景中,用户偏好分布于多个服务领域,并呈现显著的多模态与异构特征,准确刻画用户跨领域偏好是提升匹配性能的关键.针对现有方法普遍依赖统一嵌入空间,易造成多源偏好压缩并忽略模态差异的问题,提出了一种基于多模态用户图的跨领域服务匹配方法.该方法以偏好标签为锚点构建多模态用户图,通过显式建模用户在文本、图像、音频和视频等模态下的偏好结构,并引入开放知识图谱与虚拟辅助节点增强图的连通性.在此基础上,设计模态感知图池化模块MUGPool,实现不同模态偏好的自适应聚合.实验结果表明,所提方法在Amazon多领域多模态数据集上优于多种跨领域服务匹配基线模型.
In cross-domain service matching scenarios,user preferences are distributed across multiple service domains and exhibit pronounc multimodal and heterogeneous characteristics.Accurately modeling users'cross-domain preferences are therefore crucial for improving matching performance.Existing methods predominantly relied on unified embedding spaces,which tended to compress multi-source preferences and overlooked modality-specific discrepancies.To address these limitations,a multimodal user graph-based cross-domain service matching method was proposed.The proposed ap-proach constructed a multimodal user graph using preference labels as anchors,explicitly modeling user preferences across text,image,audio,and video modalities,while incorporating an open knowledge graph and virtual auxiliary nodes to en-hance graph connectivity.Furthermore,a modality-aware graph pooling module,termed MUGPool,was designed to adap-tively aggregate preferences across different modalities.Experimental results on the Amazon multimodal multi-domain data-set demonstrate that the proposed method outperforms state-of-the-art cross-domain service matching baselines.
王海艳;刘万宇;骆健;张少聪
南京邮电大学计算机学院,江苏 南京 210023||大数据安全与智能处理省高校重点实验室,江苏 南京 210023南京邮电大学计算机学院,江苏 南京 210023南京邮电大学计算机学院,江苏 南京 210023||大数据安全与智能处理省高校重点实验室,江苏 南京 210023南京邮电大学计算机学院,江苏 南京 210023
信息技术与安全科学
跨领域服务匹配多模态用户图模态感知图池化模态聚合
cross-domain service matchingmultimodal user graphmodality-aware graph poolingmodality aggregation
《通信学报》 2026 (5)
91-102,12
国家自然科学基金资助项目(No.62272243) The National Natural Science Foundation of China(No.62272243)
评论