Impli-R1:结合多模态推理的隐性属性值抽取方法OA
Impli-R1:multi-modal reasoning-driven method for implicit attribute value extraction
多模态属性值抽取在电子商务、搜索引擎及自动化产品分类等领域具有重要作用,其目标是从产品描述中识别属性-值对.传统的属性值抽取方法主要集中在显性属性上,即那些直接在文本或图像中呈现的属性值.然而,随着数据多样性的增加,隐性属性的抽取逐渐成为一个重要的研究方向.与显性属性不同,隐性属性并未直接显现,需要依赖多模态推理和语义关联进行识别.现有方法在复杂跨模态推理与信息融合方面仍存在不足.因此提出了 Impli-R1模型,将系统性多模态推理机制引入隐性属性值抽取任务中.该模型结合高质量长思维链推理样本,采用监督微调与强化学习相结合的训练策略,并通过组奖励策略优化提升推理的精细化与稳健性.实验结果表明,Impli-R1在ChiImpAVE和ImplicitAVE两个基准数据集上的Micro-F1得分均显著优于现有方法,验证了其在多模态隐性属性值抽取中的有效性与泛化能力.
Multimodal attribute value extraction plays a crucial role in applications such as e-commerce,search engines,and automated product categorization,aiming to identify attribute-value pairs from product descriptions.Traditional approaches mainly focus on explicit attributes whose values are directly presented in text or images,however,with the growing diversity of data,extracting implicit attributes has become an increasingly important research direction.Unlike explicit attributes,implicit attributes are not directly observable and require multimodal reasoning and semantic associations for identification,while exis ting methods still struggle with complex cross-modal reasoning and information fusion.To address these challenges,this paper proposed Impli-R1,which introduced a systematic multimodal reasoning mechanism into implicit attribute value extraction by leveraging high-quality long chain-of-thought reasoning samples and adopting a hybrid training strategy that combined super-vised fine-tuning and reinforcement learning,further enhanced by a group-based reward strategy to improve the granularity and robustness of reasoning.Experimental results show that Impli-R1 significantly outperforms existing methods in terms of Micro-F1 on both the ChiImpAVE and ImplicitAVE benchmark datasets,demonstrating its effectiveness and generalization ability in multimodal implicit attribute value extraction.
陈奇;于碧辉;魏靖烜;王海广;史慧洋;伍高巍;孙林壮
中国科学院沈阳计算技术研究所,沈阳 110168||中国科学院大学,北京 100049中国科学院沈阳计算技术研究所,沈阳 110168||中国科学院大学,北京 100049中国科学院沈阳计算技术研究所,沈阳 110168||中国科学院大学,北京 100049中国科学院沈阳计算技术研究所,沈阳 110168||中国科学院大学,北京 100049中国科学院大学,北京 100049||中国科学院大学计算机科学与技术学院,北京 101408中国科学院沈阳计算技术研究所,沈阳 110168||中国科学院大学,北京 100049中国科学院沈阳计算技术研究所,沈阳 110168||中国科学院大学,北京 100049
信息技术与安全科学
多模态属性值抽取多模态推理监督微调强化学习
multimodal attribute value extractionmultimodal reasoningsupervised fine-tuningreinforcement learning
《计算机应用研究》 2026 (6)
1601-1608,8
沈阳市科学技术计划-社会治理科技专项(23-407-3-29)
评论