Cover Image

User-centric Subjective Leaderboard by Customizable Reward Modeling

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jia, Qi, Song, Xiujie, Zhang, Zicheng, Guo, Yijin, Zhang, Kaiwei, Chen, Zijian, Zhai, Guangtao
Format:	Preprint
Published:	2025
Subjects:	Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

QoNext: Towards Next-generation QoE for Foundation Models
by: Guo, Yijin, et al.
Published: (2025)

One Battle After Another: Probing LLMs' Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework
by: Jia, Qi, et al.
Published: (2025)

UniDial-EvalKit: A Unified Toolkit for Evaluating Multi-Faceted Conversational Abilities
by: Jia, Qi, et al.
Published: (2026)

A Multi-To-One Interview Paradigm for Efficient MLLM Evaluation
by: Shen, Ye, et al.
Published: (2025)

EvolMem: A Cognitive-Driven Benchmark for Multi-Session Dialogue Memory
by: Shen, Ye, et al.
Published: (2026)

Sycophancy under Pressure: Evaluating and Mitigating Sycophantic Bias via Adversarial Dialogues in Scientific QA
by: Zhang, Kaiwei, et al.
Published: (2025)

Human-Centric Evaluation for Foundation Models
by: Guo, Yijin, et al.
Published: (2025)

Evaluating from Benign to Dynamic Adversarial: A Squid Game for Large Language Models
by: Chen, Zijian, et al.
Published: (2025)

The Ever-Evolving Science Exam
by: Wang, Junying, et al.
Published: (2025)

Q-Mirror: Unlocking the Multi-Modal Potential of Scientific Text-Only QA Pairs
by: Wang, Junying, et al.
Published: (2025)

KidVis: Do Multimodal Large Language Models Possess the Visual Perceptual Capabilities of a 6-Year-Old?
by: Wang, Xianfeng, et al.
Published: (2026)

Affordance Benchmark for MLLMs
by: Wang, Junying, et al.
Published: (2025)

SafetyFlow: An Agent-Flow System for Automated LLM Safety Benchmarking
by: Zhu, Xiangyang, et al.
Published: (2025)

Libra-Leaderboard: Towards Responsible AI through a Balanced Leaderboard of Safety and Capability
by: Li, Haonan, et al.
Published: (2024)

Improve MLLM Benchmark Efficiency through Interview
by: Wen, Farong, et al.
Published: (2025)

Can Large Models Fool the Eye? A New Turing Test for Biological Animation
by: Chen, Zijian, et al.
Published: (2025)

Prompt-to-Leaderboard
by: Frick, Evan, et al.
Published: (2025)

DyCoRM: Dynamic Criterion-Aware Reward Modeling for Text-to-Image Generation
by: Qian, Jiaying, et al.
Published: (2026)

League: Leaderboard Generation on Demand
by: Wu, Jian, et al.
Published: (2025)

MEMO-Bench: A Multiple Benchmark for Text-to-Image and Multimodal Large Language Models on Human Emotion Analysis
by: Zhou, Yingjie, et al.
Published: (2024)

La Leaderboard: A Large Language Model Leaderboard for Spanish Varieties and Languages of Spain and Latin America
by: Grandury, María, et al.
Published: (2025)

Information Density Principle for MLLM Benchmarks
by: Li, Chunyi, et al.
Published: (2025)

PriceSeer: Evaluating Large Language Models in Real-Time Stock Prediction
by: Liang, Bohan, et al.
Published: (2025)

Concept -- An Evaluation Protocol on Conversational Recommender Systems with System-centric and User-centric Factors
by: Huang, Chen, et al.
Published: (2024)

Magic Mushroom: A Customizable Benchmark for Fine-grained Analysis of Retrieval Noise Erosion in RAG Systems
by: Zhang, Yuxin, et al.
Published: (2025)

A Cognitive Evaluation Benchmark of Image Reasoning and Description for Large Vision-Language Models
by: Song, Xiujie, et al.
Published: (2024)

Mesh Mamba: A Unified State Space Model for Saliency Prediction in Non-Textured and Textured Meshes
by: Zhang, Kaiwei, et al.
Published: (2025)

UserLM-R1: Modeling Human Reasoning in User Language Models with Multi-Reward Reinforcement Learning
by: Zhang, Feng, et al.
Published: (2026)

Open Universal Arabic ASR Leaderboard
by: Wang, Yingzhi, et al.
Published: (2024)

LEGOBench: Scientific Leaderboard Generation Benchmark
by: Singh, Shruti, et al.
Published: (2024)

MedOmni-45°: A Safety-Performance Benchmark for Reasoning-Oriented LLMs in Medicine
by: Ji, Kaiyuan, et al.
Published: (2025)

SAUCE: Synchronous and Asynchronous User-Customizable Environment for Multi-Agent LLM Interaction
by: Neuberger, Shlomo, et al.
Published: (2024)

The Leaderboard Illusion
by: Singh, Shivalika, et al.
Published: (2025)

Generating Storytelling Images with Rich Chains-of-Reasoning
by: Song, Xiujie, et al.
Published: (2025)

Redundancy Principles for MLLMs Benchmarks
by: Zhang, Zicheng, et al.
Published: (2025)

Act-Adaptive Margin: Dynamically Calibrating Reward Models for Subjective Ambiguity
by: Fang, Feiteng, et al.
Published: (2025)

Beyond the Leaderboard: Rethinking Medical Benchmarks for Large Language Models
by: Chen, Wenting, et al.
Published: (2025)

P-GenRM: Personalized Generative Reward Model with Test-time User-based Scaling
by: Zhang, Pinyi, et al.
Published: (2026)

Efficient Performance Tracking: Leveraging Large Language Models for Automated Construction of Scientific Leaderboards
by: Şahinuç, Furkan, et al.
Published: (2024)

ASCIIEval: Benchmarking Models' Visual Perception in Text Strings via ASCII Art
by: Jia, Qi, et al.
Published: (2024)