大语言模型的人格化对齐及其对道德判断的影响OACHSSCD
Personality-based alignment of large language models and its impact on moral judgment
随着人机共生时代的到来,大语言模型(LLM)的伦理困境与算法偏见引发了社会广泛的担忧,引导人工智能技术向善发展已成为该领域极具紧迫性和挑战性的重要议题.研究探讨了基于 HEXACO 人格模型的人格化对齐对 LLM 道德判断的影响,其中研究 1 检验并证实了 LLM 可以通过遵循提示词有效表达 HEXACO 人格特质,研究 2 探讨了人格化对齐对 LLM 功利主义倾向的影响及其与人类的异同.结果表明,高诚实-谦恭、宜人性和尽责性的人格提示词显著减少了 GPT-3.5、GPT-4 和 ERNIE 3.5 做出功利主义选择的倾向.由此,本研究提出基于HEXACO人格模型和人格元特质的LLM人格化对齐框架,强调稳定性元特质中的诚实-谦恭、宜人性和尽责性等维度在LLM人格化对齐中的道德凸显效应.本研究为人工智能人格化对齐的理论构建与技术路径提供了心理学依据.
With the advent of the human-machine symbiosis era,the ethical dilemmas and algorithmic biases of large language models(LLMs)have triggered widespread societal concerns.Guiding artificial intelligence(AI)toward beneficial development has thus become an urgent and challenging imperative.This research explores the impact of personality-based alignment grounded in the HEXACO personality model on the moral judgment of LLMs.Specifically,the study aims to verify whether LLMs can effectively achieve personality-based alignment through prompting and to systematically evaluate how such alignment influences utilitarian tendencies in LLMs compared to humans across various moral dilemmas.By leveraging established psychological frameworks,this research seeks to provide a scientific basis for constructing controllable and ethical AI alignment strategies. Study 1 tested GPT-3.5,GPT-4,and ERNIE 3.5 using personality prompts targeting each HEXACO domain separately at high,low,and baseline levels,integrated with different gender roles.Manipulation checks were conducted using two distinct methods:a quantitative personality assessment using the HEXACO-60 scale and a qualitative personality story-writing task rated by independent human evaluators.Study 2 utilized a set of standardized moral dilemmas to assess utilitarian versus deontological choices in both LLMs and human participants.Human data were categorized into high and low personality groups for comparison,while the LLMs performed the same moral judgment tasks under various personality settings to identify shifts in decision-making patterns. The results of Study 1 confirmed the feasibility of personality-based alignment,demonstrating that LLMs can dynamically represent HEXACO personality traits through prompts.Among the LLMs tested,GPT-4 exhibited superior instruction-following capabilities and more distinct trait differentiation than GPT-3.5 and ERNIE 3.5.Findings from Study 2 revealed that personality-based alignment significantly alters the moral judgment of LLMs,though the impact varies across different models and personality domains.Specifically,traits such as Honesty-Humility,Agreeableness,and Conscientiousness were found to reduce utilitarian tendencies,leading to a preference for deontological responses.While some traits,particularly Honesty-Humility,showed stable and consistent effects between humans and LLMs,others displayed divergent or even opposite patterns,highlighting fundamental differences in their respective moral reasoning mechanisms. The study reached three primary conclusions.First,LLMs can effectively manifest HEXACO personality traits by following prompts.Second,the influence of Honesty-Humility on moral judgment exhibits a consistent effect across humans and different LLMs,whereas other personality domains show inconsistencies.This suggests that while LLMs'moral decision-making shares partial cognitive logic with humans,fundamental differences remain.Third,the personality metatrait of"Stability"—and particularly the Honesty-Humility domain—demonstrates a significant moral salience effect within the personality-based alignment process.Based on these insights,this research proposes a personality-based alignment framework grounded in the HEXACO model and personality metatrait theory for shaping the moral responses of AI,providing a psychological foundation for the development of safety,controllable and ethical AI systems.This framework emphasizes integrating psychological theories to mitigate ethical risks and ensure that AI behavior remains consistent with human values.
李昌锦;焦丽颖;陈圳;许恒彬;吴胜涛;许燕
北京师范大学心理学部||应用实验心理北京市重点实验室||心理学国家级实验教学示范中心[北京师范大学],北京 100875北京林业大学人文社会科学学院心理学系,北京 100083北京师范大学心理学部||应用实验心理北京市重点实验室||心理学国家级实验教学示范中心[北京师范大学],北京 100875北京师范大学心理学部||应用实验心理北京市重点实验室||心理学国家级实验教学示范中心[北京师范大学],北京 100875吉林大学哲学社会学院哲学系,长春 130012北京师范大学心理学部||应用实验心理北京市重点实验室||心理学国家级实验教学示范中心[北京师范大学],北京 100875
社会科学
大语言模型人格化对齐道德判断HEXACO人格元特质
large language modelspersonality-based alignmentmoral judgmentHEXACO personalitymetatrait
《心理学报》 2026 (7)
1237-1253,中插1-中插3,20
国家自然科学基金面上项目(31671160),教育部人文社会科学研究青年基金项目(24YJC190012),北京市教育科学"十四五"规划2025年度青年专项课题(BCHA25157)资助.
评论