IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Bai, Yuzhuo, Duan, Shitong, Huang, Muhua, Yao, Jing, Liu, Zhenghao, Zhang, Peng, Lu, Tun, Yi, Xiaoyuan, Sun, Maosong, Xie, Xing
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866914173038886912
author Bai, Yuzhuo
Duan, Shitong
Huang, Muhua
Yao, Jing
Liu, Zhenghao
Zhang, Peng
Lu, Tun
Yi, Xiaoyuan
Sun, Maosong
Xie, Xing
author_facet Bai, Yuzhuo
Duan, Shitong
Huang, Muhua
Yao, Jing
Liu, Zhenghao
Zhang, Peng
Lu, Tun
Yi, Xiaoyuan
Sun, Maosong
Xie, Xing
contents Trained on various human-authored corpora, Large Language Models (LLMs) have demonstrated a certain capability of reflecting specific human-like traits (e.g., personality or values) by prompting, benefiting applications like personalized LLMs and social simulations. However, existing methods suffer from the superficial elicitation problem: LLMs can only be steered to mimic shallow and unstable stylistic patterns, failing to embody the desired traits precisely and consistently across diverse tasks like humans. To address this challenge, we propose IROTE, a novel in-context method for stable and transferable trait elicitation. Drawing on psychological theories suggesting that traits are formed through identity-related reflection, our method automatically generates and optimizes a textual self-reflection within prompts, which comprises self-perceived experience, to stimulate LLMs' trait-driven behavior. The optimization is performed by iteratively maximizing an information-theoretic objective that enhances the connections between LLMs' behavior and the target trait, while reducing noisy redundancy in reflection without any fine-tuning, leading to evocative and compact trait reflection. Extensive experiments across three human trait systems manifest that one single IROTE-generated self-reflection can induce LLMs' stable impersonation of the target trait across diverse downstream tasks beyond simple questionnaire answering, consistently outperforming existing strong baselines.
format Preprint
id arxiv_https___arxiv_org_abs_2508_08719
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization
Bai, Yuzhuo
Duan, Shitong
Huang, Muhua
Yao, Jing
Liu, Zhenghao
Zhang, Peng
Lu, Tun
Yi, Xiaoyuan
Sun, Maosong
Xie, Xing
Computation and Language
Artificial Intelligence
Computers and Society
Trained on various human-authored corpora, Large Language Models (LLMs) have demonstrated a certain capability of reflecting specific human-like traits (e.g., personality or values) by prompting, benefiting applications like personalized LLMs and social simulations. However, existing methods suffer from the superficial elicitation problem: LLMs can only be steered to mimic shallow and unstable stylistic patterns, failing to embody the desired traits precisely and consistently across diverse tasks like humans. To address this challenge, we propose IROTE, a novel in-context method for stable and transferable trait elicitation. Drawing on psychological theories suggesting that traits are formed through identity-related reflection, our method automatically generates and optimizes a textual self-reflection within prompts, which comprises self-perceived experience, to stimulate LLMs' trait-driven behavior. The optimization is performed by iteratively maximizing an information-theoretic objective that enhances the connections between LLMs' behavior and the target trait, while reducing noisy redundancy in reflection without any fine-tuning, leading to evocative and compact trait reflection. Extensive experiments across three human trait systems manifest that one single IROTE-generated self-reflection can induce LLMs' stable impersonation of the target trait across diverse downstream tasks beyond simple questionnaire answering, consistently outperforming existing strong baselines.
title IROTE: Human-like Traits Elicitation of Large Language Model via In-Context Self-Reflective Optimization
topic Computation and Language
Artificial Intelligence
Computers and Society
url https://arxiv.org/abs/2508.08719