首页|期刊导航|计算机与现代化|大语言模型提示词迭代的低成本查询词理解方法

大语言模型提示词迭代的低成本查询词理解方法OA

Low-cost Query Term Understanding Method Based on Iterative Prompting of Large Language Models

中文摘要英文摘要

针对自然语言理解任务中查询词理解成本高、开发门槛高等问题,提出一种大语言模型提示词迭代的低成本查询词理解方法.该方法面向搜索引擎中的查询词分类任务,利用大语言模型构建初始提示词并指导大模型对提示词进行多轮优化,实现大规模训练数据的自动化高质量标注,进而通过知识蒸馏将能力迁移至小模型,以满足实时性要求和资源受限场景的应用需求.实验结果表明,在最优提示词组合下,大语言模型预测的精确率和准确率分别达到97.5%和93.0%.该方法显著降低了对人工标注的依赖,将70000条数据的标注成本从传统人工标注的21000元降至30.24元,有效提升了数据标注效率与模型开发效率.进一步通过知识蒸馏,将大模型能力迁移至小模型,在保持高分类性能的同时,大幅增强了模型的部署灵活性,为低资源环境下的文本分类任务提供了一种可行、经济且高效的技术路径.

To address the high cost and development barriers associated with query term understanding in natural language un-derstanding tasks,this paper proposes a low-cost query term understanding method based on iterative prompting of Large Lan-guage Models(LLMs).Aiming at the query classification task in search engines,the method uses LLMs to construct initial prompt words and guide the large model to optimize the prompt words through multiple rounds,achieving automated high-quality annotation of large-scale training data.Then,through knowledge distillation,the capabilities are transferred to small models to meet the application requirements of real-time performance and resource-constrained scenarios.The experimental results show that,under the optimal prompt ensemble,the LLMs achieves a precision of 97.5%and an accuracy of 93.0%in query classifica-tion.This method significantly reduces reliance on manual annotation,cutting the labeling cost for 70000 samples from 21000 RMB(manual labeling)to only 30.24 RMB(LLMs-based labeling),greatly improving both data annotation efficiency and model development efficiency.Further,through knowledge distillation,the capabilities of large models are transferred to small models,maintaining high classification performance while significantly enhancing the deployment flexibility of the models.Therefore,this method provides a feasible,economical and efficient technical path for text classification tasks in low-resource environments.

张军;张红梅;王石磊

东华理工大学人工智能与信息工程学院,江西 南昌 330013东华理工大学人工智能与信息工程学院,江西 南昌 330013东华理工大学人工智能与信息工程学院,江西 南昌 330013

信息技术与安全科学

查询词理解大语言模型提示词优化知识蒸馏文本分类

query term understandinglarge language modelsprompt optimizationknowledge distillationtext classification

《计算机与现代化》 2026 (7)

12-18,7

国家自然科学基金资助项目(62162002)

10.3969/j.issn.1006-2475.2026.07.002

评论