基于大语言模型提示调优的教育文本分类方法OA
Research on Education Text Classification Based on Prompts Learning and Large Language Models
教育文本分类是智能教育的核心任务,广泛应用于教材内容分析、自动试题分类和教学资源推荐等场景.然而,与新闻、评论等通用文本相比,教育类文本具有术语密集、结构化知识丰富等特征,导致模型的语义理解与迁移学习难度显著增加.在低资源条件下,现有依赖大规模标注数据和监督微调的主流方法面临样本稀缺的困境.提出了一种适用于低资源与小样本场景的文本分类方法,基于提示调优策略引导预训练语言模型与大型语言模型的先验知识迁移.该方法设计了离散、连续与混合三类提示模板,并引入双向长短期记忆网络以建模提示词元之间的依赖关系,从而提升模型对任务语义的适配能力.在EduBooks、AGNews、MELD与IMDB四个典型文本分类数据集上的实验结果表明,该方法在F1指标上分别较八种主流基线方法提升了3.7%、3.3%、5.7%和1.1%.结果显示,所提方法在无需微调预训练模型参数的前提下,能够实现对不同类型文本的高效、准确分类,具有较强的通用性.消融实验进一步验证了冻结策略的合理性.
Educational text classification is a core task in intelligent education,with wide applications in textbook content analysis,automatic exam-question categorization,and educational-resource recommendation.Compared with general texts such as news or reviews,educational texts are characterized by dense terminology and rich structured knowledge,which substantially increase the difficulty of semantic understanding and transfer learning.Under low-resource and small-sample conditions,mainstream approaches that rely on large-scale annotated data and supervised fine-tuning suffer from severe data scarcity.This paper proposes a text-classification method tailored for low-resource and small-sample scenarios,based on a prompt-tuning strategy that facilitates the transfer of prior knowledge from pre-trained language models(PLMs)and large language models(LLMs).This paper designs three types of prompt templates:discrete,continuous,and hybrid.It incorporates a bidirectional long short-term memory network(BiLSTM)to model dependencies among prompt tokens,thereby improving the model's task-specific semantic adaptation.Experiments on four representative benchmarks(EduBooks,AGNews,MELD,and IMDB)show that the proposed method outperforms eight strong baselines on Fl by 3.7%,3.3%,5.7%,and 1.1%,respectively.The results indicate that the proposed approach can efficiently and accurately classify diverse text types with strong generalizability,without fine-tuning the parameters of the pre-trained models.Abla-tion studies further validate the effectiveness of the parameter-freezing strategy.
戎璐;喻梅;赵东明;王永刚;张亚洲
天津大学教育学院,天津 300350天津大学教育学院,天津 300350||天津大学计算机科学与技术学院,天津 300350天津移动AI产业研究院,天津 300020飞腾信息技术有限公司,天津 300459天津大学计算机科学与技术学院,天津 300350
信息技术与安全科学
大语言模型文本分类提示学习
large language modelstext classificationprompt learning
《计算机科学与探索》 2026 (4)
1006-1018,13
国家自然科学基金青年基金(62006212)河南省自然科学基金面上项目(242300421412)2024年天津市制造业高质量发展项目(24ZGZNGX00020).This work was supported by the Youth Program of the National Natural Science Foundation of China(62006212),the General Program of the Natural Science Foundation of Henan Province(242300421412),and the Tianjin's Manufacturing Industry High-Quality Development Project in 2024(24ZGZNGX00020).
评论