TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866908619706990592 |
|---|---|
| author | Du, Bangde Guo, Minghao He, Songming Ye, Ziyi Zhu, Xi Su, Weihang Zhu, Shuqi Zhou, Yujia Zhang, Yongfeng Ai, Qingyao Liu, Yiqun |
| author_facet | Du, Bangde Guo, Minghao He, Songming Ye, Ziyi Zhu, Xi Su, Weihang Zhu, Shuqi Zhou, Yujia Zhang, Yongfeng Ai, Qingyao Liu, Yiqun |
| contents | Large Language Models (LLMs) are exhibiting emergent human-like abilities and are increasingly envisioned as the foundation for simulating an individual's communication style, behavioral tendencies, and personality traits. However, current evaluations of LLM-based persona simulation remain limited: most rely on synthetic dialogues, lack systematic frameworks, and lack analysis of the capability requirement. To address these limitations, we introduce TwinVoice, a comprehensive benchmark for assessing persona simulation across diverse real-world contexts. TwinVoice encompasses three dimensions: Social Persona (public social interactions), Interpersonal Persona (private dialogues), and Narrative Persona (role-based expression). It further decomposes the evaluation of LLM performance into six fundamental capabilities, including opinion consistency, memory recall, logical reasoning, lexical fidelity, persona tone, and syntactic style. Experimental results reveal that while advanced models achieve moderate accuracy in persona simulation, they still fall short of capabilities such as syntactic style and memory recall. Consequently, the average performance achieved by LLMs remains considerably below the human baseline. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_25536 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation Du, Bangde Guo, Minghao He, Songming Ye, Ziyi Zhu, Xi Su, Weihang Zhu, Shuqi Zhou, Yujia Zhang, Yongfeng Ai, Qingyao Liu, Yiqun Computation and Language I.2.7; I.2.6; I.2.0 Large Language Models (LLMs) are exhibiting emergent human-like abilities and are increasingly envisioned as the foundation for simulating an individual's communication style, behavioral tendencies, and personality traits. However, current evaluations of LLM-based persona simulation remain limited: most rely on synthetic dialogues, lack systematic frameworks, and lack analysis of the capability requirement. To address these limitations, we introduce TwinVoice, a comprehensive benchmark for assessing persona simulation across diverse real-world contexts. TwinVoice encompasses three dimensions: Social Persona (public social interactions), Interpersonal Persona (private dialogues), and Narrative Persona (role-based expression). It further decomposes the evaluation of LLM performance into six fundamental capabilities, including opinion consistency, memory recall, logical reasoning, lexical fidelity, persona tone, and syntactic style. Experimental results reveal that while advanced models achieve moderate accuracy in persona simulation, they still fall short of capabilities such as syntactic style and memory recall. Consequently, the average performance achieved by LLMs remains considerably below the human baseline. |
| title | TwinVoice: A Multi-dimensional Benchmark Towards Digital Twins via LLM Persona Simulation |
| topic | Computation and Language I.2.7; I.2.6; I.2.0 |
| url | https://arxiv.org/abs/2510.25536 |