面向自动提示词工程的反馈进化算法OA
Feedback-Driven Evolutionary Algorithm for Automatic Prompt Engineering
针对现有离散提示词优化算法过度依赖大规模搜索反馈或局限于自然选择、短句级随机变异的问题,提出反馈驱动进化(feedback-driven evolutionary,FDE)算法,通过融合主动环境反馈与被动自然选择机制实现高效提示词生成与优化.该算法结合显式反馈与隐式引导,引入双向环境信号驱动的变异策略,并改进基于小批量样本更新的置信区间上界评估方法,显著提升优化效率.采用18个自然语言任务数据集与8种典型提示词算法进行对比实验,测试结果表明FDE算法综合性能较现有最佳算法相对提升11.44%,稳定性提高43.88%,同时有效降低模型调用量与传输字符数.通过跨参数规模模型分析进一步验证泛化性,其在所有测试模型中综合性能均相对基线提升超10%.FDE算法实现从被动筛选到主动-被动协同适应的进化模式转变,有利于驱动语言模型低成本更高效地执行自然语言处理任务.
To address the problems that existing discrete prompt optimization algorithms are overly dependent on large-scale search feedback or limited to natural selection and phrase-level random variation,the feedback-driven evolutionary(FDE)algorithm is proposed,which achieves efficient prompt generation and optimization by integrating active environ-mental feedback and passive natural selection mechanisms.The algorithm combines explicit feedback and implicit guidance,introduces a mutation strategy driven by bidirectional environmental signals,and improves the upper confidence bound evaluation method based on batch sample update,significantly enhancing optimization efficiency.Comparative experi-ments are conducted on 18 natural language task datasets with 8 typical prompt algorithms.Test results show that the com-prehensive performance of the FDE algorithm is relatively improved by 11.44%and the stability by 43.88%compared with the existing best algorithms,while effectively reducing the number of model calls and transmitted characters.Further verification of generalization through cross-parameter scale model analysis reveals that its comprehensive performance is relatively improved by more than 10%compared with the baseline algorithm across all tested models.The FDE algorithm realizes the evolutionary paradigm shift from passive filtering to active-passive collaborative adaptation,which is condu-cive to driving language models to perform natural language processing tasks in a low-cost and more efficient manner.
程湘钧;张红梅;唐希浪;徐思宁
空军工程大学 装备管理与无人机工程学院,西安 710051空军工程大学 装备管理与无人机工程学院,西安 710051空军工程大学 装备管理与无人机工程学院,西安 710051空军工程大学 装备管理与无人机工程学院,西安 710051
信息技术与安全科学
提示词自动提示词工程语言模型进化计算环境反馈自然语言处理
promptautomatic prompt engineeringlanguage modelevolutionary computationenvironmental feedbacknatural language processing
《计算机工程与应用》 2026 (6)
96-109,14
国家自然科学基金(72201276).
评论