基于多粒度知识的无监督常识问答OA
Unsupervised Commonsense Question Answering Based on Multi-Granularities
常识性问答(Commonsense Question Answering,CQA)是一项比传统问答任务更具挑战性的自然语言理解任务,它要求模型具备更强的常识推理能力.目前,基于无监督方法的常识问答在若干数据集上取得了较好的性能,但这些方法难以充分挖掘和利用常识知识,限制了模型在复杂场景下的推理能力.针对这一问题,本文提出了一种新颖的无监督常识问答方法,其核心优势在于通过无监督学习有效整合外部常识知识,从而提升模型的泛化能力和推理深度.首先,该方法对问题进行分类,区分科学常识问题与日常事件问题;随后,根据问题类型生成相应的知识前缀;接着,将知识前缀输入预训练语言模型,通过大模型提示生成多粒度的常识知识;最后,利用多粒度知识辅助问答推理模块进行答案生成.采用无监督方法不仅可以减少对标注数据的依赖,还能更好地适应多样化的常识场景,体现了其在实际应用中的灵活性和普适性.实验结果表明,所提方法在相关数据集上显著优于基线模型,验证了其在无监督常识问答任务中的正确性和合理性.
As a natural language understanding task,commonsense question answering(CQA)is signifi-cantly more challenging than conventional question answering tasks.It requires the model to possess stron-ger commonsense reasoning capabilities.Currently,unsupervised methods for CQA have achieved rela-tively good performance on several datasets,but these approaches struggle to adequately mine and utilize commonsense knowledge,limiting the model's reasoning ability in complex scenarios.To address this issue,this paper proposed a novel unsupervised CQA method,whose core advantage lay in effectively integrating external commonsense knowledge through unsupervised learning,thereby enhancing the model's generalization capability and reasoning depth.Firstly,the method classifies questions into sci-entific commonsense questions and everyday event questions.Then,it generates corresponding knowledge prefixes based on the question type.Next,these knowledge prefixes are input into a pre-trained language model to produce multi-granularities commonsense knowledge through large model prompts.Finally,the multi-grained knowledge is leveraged to assist the answer generation module in reasoning.The adoption of an unsupervised approach not only reduces the reliance on annotated data but also better adapts to diverse commonsense scenarios,demonstrating its flexibility and generalizability in practical applications.Experimental results show that the proposed method significantly outperforms baseline models on relevant datasets,validating its correctness and rationality in unsupervised CQA tasks.
杨陟卓;王年楷
山西大学 计算机与信息技术学院,山西 太原 030006山西大学 计算机与信息技术学院,山西 太原 030006
信息技术与安全科学
常识问答大模型提示知识生成答案推理
commonsense question answeringlarge model promptingknowledge generationanswer reasoning
《中北大学学报(自然科学版)》 2026 (1)
62-70,9
评论