首页|期刊导航|计算机工程与应用|生成式大模型越狱攻击安全性研究综述

生成式大模型越狱攻击安全性研究综述OA

Overview of Security Research on Jailbreak Attacks Against Generative Large Models

中文摘要英文摘要

近年来,生成式大模型广泛应用于文本生成、对话交互、内容创作等多个关键场景.然而,越狱攻击正成为生成式大模型的新威胁,越狱攻击能够绕过生成式大模型内置的安全机制,诱使经过其产生有害输出,带来伦理风险、隐私泄露以及模型滥用等安全挑战.针对这一威胁,全面综述了近年来大语言模型与多模态大模型这两类主流的生成式大模型的越狱攻击研究进展.从越狱攻击类型、防御策略、安全评估框架三个方面,详细总结了当前越狱攻击方法的基本原理、实施方法与研究结论,为后续的研究提供了有效参考.基于上述研究,进一步总结了当前两类主流生成式模型在越狱攻击安全性研究方面存在的不足,并提出了未来生成式大模型安全性研究所面临的主要挑战与发展机遇,为研究人员在生成式大模型的复杂应用和安全性研究领域提供指导建议.

In recent years,generative large models have been widely used in a variety of key scenarios,including text gen-eration,conversational interaction,and content creation.However,jailbreak attacks are emerging as a threat to these models.Jailbreak attacks can bypass their built-in security mechanisms and induce them to produce harmful outputs,posing security challenges such as ethical risks,privacy leaks,and model abuse.To address this threat,this paper comprehensively reviews recent research progress on jailbreak attacks against two mainstream generative models:large language models and multimodal large language models.This review focuses on three aspects:jailbreak attack types,defense strategies,and security assessment frameworks.It details the basic principles,implementation methods,and research conclusions of current jailbreak attack methods,providing valuable insights for future research.Building on this work,this paper further summarizes the current deficiencies in jailbreak security research for these two mainstream generative models and identi-fies key challenges and development opportunities for future research on the security of generative large models.This review provides guidance for researchers working on the complex applications and security of generative large models.

李燕;王钢;王浩

内蒙古工业大学 智能科学与技术学院(网络空间安全学院),呼和浩特 010080内蒙古工业大学 智能科学与技术学院(网络空间安全学院),呼和浩特 010080内蒙古工业大学 智能科学与技术学院(网络空间安全学院),呼和浩特 010080

信息技术与安全科学

生成式大模型(GLMs)越狱攻击安全挑战防御策略安全性研究

generative large models(GLMs)jailbreak attacksecurity challengedefense strategysecurity research

《计算机工程与应用》 2026 (6)

27-50,24

内蒙古自治区高校网络安全和教育管理信息化工程研究中心专项(RZ2200000611).

10.3778/j.issn.1002-8331.2509-0303

评论