Editing Personality for Large Language Models
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866916376044634112 |
|---|---|
| author | Mao, Shengyu Wang, Xiaohan Wang, Mengru Jiang, Yong Xie, Pengjun Huang, Fei Zhang, Ningyu |
| author_facet | Mao, Shengyu Wang, Xiaohan Wang, Mengru Jiang, Yong Xie, Pengjun Huang, Fei Zhang, Ningyu |
| contents | This paper introduces an innovative task focused on editing the personality traits of Large Language Models (LLMs). This task seeks to adjust the models' responses to opinion-related questions on specified topics since an individual's personality often manifests in the form of their expressed opinions, thereby showcasing different personality traits. Specifically, we construct PersonalityEdit, a new benchmark dataset to address this task. Drawing on the theory in Social Psychology, we isolate three representative traits, namely Neuroticism, Extraversion, and Agreeableness, as the foundation for our benchmark. We then gather data using GPT-4, generating responses that align with a specified topic and embody the targeted personality trait. We conduct comprehensive experiments involving various baselines and discuss the representation of personality behavior in LLMs. Our findings uncover potential challenges of the proposed task, illustrating several remaining issues. We anticipate that our work can stimulate further annotation in model editing and personality-related research. Code is available at https://github.com/zjunlp/EasyEdit. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2310_02168 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Editing Personality for Large Language Models Mao, Shengyu Wang, Xiaohan Wang, Mengru Jiang, Yong Xie, Pengjun Huang, Fei Zhang, Ningyu Computation and Language Artificial Intelligence Computers and Society Machine Learning Multiagent Systems This paper introduces an innovative task focused on editing the personality traits of Large Language Models (LLMs). This task seeks to adjust the models' responses to opinion-related questions on specified topics since an individual's personality often manifests in the form of their expressed opinions, thereby showcasing different personality traits. Specifically, we construct PersonalityEdit, a new benchmark dataset to address this task. Drawing on the theory in Social Psychology, we isolate three representative traits, namely Neuroticism, Extraversion, and Agreeableness, as the foundation for our benchmark. We then gather data using GPT-4, generating responses that align with a specified topic and embody the targeted personality trait. We conduct comprehensive experiments involving various baselines and discuss the representation of personality behavior in LLMs. Our findings uncover potential challenges of the proposed task, illustrating several remaining issues. We anticipate that our work can stimulate further annotation in model editing and personality-related research. Code is available at https://github.com/zjunlp/EasyEdit. |
| title | Editing Personality for Large Language Models |
| topic | Computation and Language Artificial Intelligence Computers and Society Machine Learning Multiagent Systems |
| url | https://arxiv.org/abs/2310.02168 |