RoleConflictBench: A Benchmark of Role Conflict Scenarios for Evaluating LLMs' Contextual Sensitivity

Documenti analoghi

• Spotting Out-of-Character Behavior: Atomic-Level Evaluation of Persona Fidelity in Open-Ended Generation
  di: Shin, Jisu, et al.
  Pubblicazione: (2025)
• Different Bias Under Different Criteria: Assessing Bias in LLMs with a Fact-Based Approach
  di: Ko, Changgeon, et al.
  Pubblicazione: (2024)
• Flex-TravelPlanner: A Benchmark for Flexible Planning with Language Agents
  di: Oh, Juhyun, et al.
  Pubblicazione: (2025)
• Beyond Static Benchmarks: Synthesizing Harmful Content via Persona-based Simulation for Robust Evaluation
  di: Lee, Huije, et al.
  Pubblicazione: (2026)
• The Generative AI Paradox on Evaluation: What It Can Solve, It May Not Evaluate
  di: Oh, Juhyun, et al.
  Pubblicazione: (2024)