Imagen de Portada

PingPong: A Benchmark for Role-Playing Language Models with User Emulation and Multi-Model Evaluation

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Gusev, Ilya
Formato:	Preprint
Publicado:	2024
Materias:	Computation and Language
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

PingPong: A Natural Benchmark for Multi-Turn Code-Switching Dialogues
por: Farhansyah, Mohammad Rifqi, et al.
Publicado: (2026)

RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing
por: Xiang, Hao, et al.
Publicado: (2025)

Role-Playing Evaluation for Large Language Models
por: Boudouri, Yassine El, et al.
Publicado: (2025)

A User-Centric Multi-Intent Benchmark for Evaluating Large Language Models
por: Wang, Jiayin, et al.
Publicado: (2024)

RoleLLM: Benchmarking, Eliciting, and Enhancing Role-Playing Abilities of Large Language Models
por: Wang, Zekun Moore, et al.
Publicado: (2023)

RoleEval: A Bilingual Role Evaluation Benchmark for Large Language Models
por: Shen, Tianhao, et al.
Publicado: (2023)

RPGBENCH: Evaluating Large Language Models as Role-Playing Game Engines
por: Yu, Pengfei, et al.
Publicado: (2025)

Egocentric Event-Based Vision for Ping Pong Ball Trajectory Prediction
por: Alberico, Ivan, et al.
Publicado: (2025)

Rehearse With User: Personalized Opinion Summarization via Role-Playing based on Large Language Models
por: Zhang, Yanyue, et al.
Publicado: (2025)

MT-PingEval: Evaluating Multi-Turn Collaboration with Private Information Games
por: Eisenstein, Jacob, et al.
Publicado: (2026)

SpeechRole: A Large-Scale Dataset and Benchmark for Evaluating Speech Role-Playing Agents
por: Jiang, Changhao, et al.
Publicado: (2025)

Evaluating Language Translation Models by Playing Telephone
por: Saba, Syeda Jannatus, et al.
Publicado: (2025)

CharacterEval: A Chinese Benchmark for Role-Playing Conversational Agent Evaluation
por: Tu, Quan, et al.
Publicado: (2024)

TimeChara: Evaluating Point-in-Time Character Hallucination of Role-Playing Large Language Models
por: Ahn, Jaewoo, et al.
Publicado: (2024)

Parallelize Over Data Particle Advection: Participation, Ping Pong Particles, and Overhead
por: Wang, Zhe, et al.
Publicado: (2024)

VoxRole: A Comprehensive Benchmark for Evaluating Speech-Based Role-Playing Agents
por: Wu, Weihao, et al.
Publicado: (2025)

DEBATE: A Large-Scale Benchmark for Evaluating Opinion Dynamics in Role-Playing LLM Agents
por: Chuang, Yun-Shiuan, et al.
Publicado: (2025)

The Oscars of AI Theater: A Survey on Role-Playing with Language Models
por: Chen, Nuo, et al.
Publicado: (2024)

Large Language Model-based Role-Playing for Personalized Medical Jargon Extraction
por: Lim, Jung Hoon, et al.
Publicado: (2024)

Towards a Design Guideline for RPA Evaluation: A Survey of Large Language Model-Based Role-Playing Agents
por: Chen, Chaoran, et al.
Publicado: (2025)

RoleMRC: A Fine-Grained Composite Benchmark for Role-Playing and Instruction-Following
por: Lu, Junru, et al.
Publicado: (2025)

User Profile with Large Language Models: Construction, Updating, and Benchmarking
por: Prottasha, Nusrat Jahan, et al.
Publicado: (2025)

Words at Play: Benchmarking Audio Pun Understanding in Large Audio-Language Models
por: Su, Yuchen, et al.
Publicado: (2026)

HoLLMwood: Unleashing the Creativity of Large Language Models in Screenwriting via Role Playing
por: Chen, Jing, et al.
Publicado: (2024)

Role-Play Paradox in Large Language Models: Reasoning Performance Gains and Ethical Dilemmas
por: Zhao, Jinman, et al.
Publicado: (2024)

On the Decision-Making Abilities in Role-Playing using Large Language Models
por: Shen, Chenglei, et al.
Publicado: (2024)

MT-Eval: A Multi-Turn Capabilities Evaluation Benchmark for Large Language Models
por: Kwan, Wai-Chung, et al.
Publicado: (2024)

McBE: A Multi-task Chinese Bias Evaluation Benchmark for Large Language Models
por: Lan, Tian, et al.
Publicado: (2025)

Evaluating Large Language Models on Spatial Tasks: A Multi-Task Benchmarking Study
por: Xu, Liuchang, et al.
Publicado: (2024)

Rethinking Role-Playing Evaluation: Anonymous Benchmarking and a Systematic Study of Personality Effects
por: Peng, Ji-Lun, et al.
Publicado: (2026)

Ping‐Pong Gaze in Sporadic Creutzfeldt‐Jakob Disease
por: Yuan Yang, et al.
Publicado: (2024)

Flipping the Dialogue: Training and Evaluating User Language Models
por: Naous, Tarek, et al.
Publicado: (2025)

MedRiskEval: Medical Risk Evaluation Benchmark of Language Models, On the Importance of User Perspectives in Healthcare Settings
por: Corbeil, Jean-Philippe, et al.
Publicado: (2025)

RoleCraft-GLM: Advancing Personalized Role-Playing in Large Language Models
por: Tao, Meiling, et al.
Publicado: (2023)

Controlling Summarization Length Through EOS Token Weighting
por: Belligoli, Zeno, et al.
Publicado: (2025)

Moral Susceptibility and Robustness under Persona Role-Play in Large Language Models
por: Costa, Davi Bastos, et al.
Publicado: (2025)

Repairs in a Block World: A New Benchmark for Handling User Corrections with Multi-Modal Language Models
por: Chiyah-Garcia, Javier, et al.
Publicado: (2024)

Capturing Minds, Not Just Words: Enhancing Role-Playing Language Models with Personality-Indicative Data
por: Ran, Yiting, et al.
Publicado: (2024)

A Spectrum Evaluation Benchmark for Medical Multi-Modal Large Language Models
por: Liu, Jie, et al.
Publicado: (2024)

Pitfalls of Evaluating Language Models with Open Benchmarks
por: Hasan, Md. Najib, et al.
Publicado: (2025)