Copertina

am-ELO: A Stable Framework for Arena-based LLM Evaluation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Liu, Zirui, Li, Jiatong, Zhuang, Yan, Liu, Qi, Shen, Shuanghong, Ouyang, Jie, Cheng, Mingyue, Wang, Shijin
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Towards Stable and Structured Time Series Generation with Perturbation-Aware Flow Matching
di: Zhang, Jintao, et al.
Pubblicazione: (2025)

MemCast: Memory-Driven Time Series Forecasting with Experience-Conditioned Reasoning
di: Tao, Xiaoyu, et al.
Pubblicazione: (2026)

StaTS: Spectral Trajectory Schedule Learning for Adaptive Time Series Forecasting with Frequency Guided Denoiser
di: Zhang, Jintao, et al.
Pubblicazione: (2026)

From Values to Tokens: An LLM-Driven Framework for Context-aware Time Series Forecasting via Symbolic Discretization
di: Tao, Xiaoyu, et al.
Pubblicazione: (2025)

Survey of Computerized Adaptive Testing: A Machine Learning Perspective
di: Zhuang, Yan, et al.
Pubblicazione: (2024)

PaperArena: An Evaluation Benchmark for Tool-Augmented Agentic Reasoning on Scientific Literature
di: Wang, Daoyu, et al.
Pubblicazione: (2025)

InstructTime++: Time Series Classification with Multimodal Language Modeling via Implicit Feature Enhancement
di: Cheng, Mingyue, et al.
Pubblicazione: (2026)

BrowserArena: Evaluating LLM Agents on Real-World Web Navigation Tasks
di: Anupam, Sagnik, et al.
Pubblicazione: (2025)

Generative Cognitive Diagnosis
di: Li, Jiatong, et al.
Pubblicazione: (2025)

DASKT: A Dynamic Affect Simulation Method for Knowledge Tracing
di: Sun, Xinjie, et al.
Pubblicazione: (2025)

SHADE-Arena: Evaluating Sabotage and Monitoring in LLM Agents
di: Kutasov, Jonathan, et al.
Pubblicazione: (2025)

Scheduled Knowledge Acquisition on Lightweight Vector Symbolic Architectures for Brain-Computer Interfaces
di: Liu, Yejia, et al.
Pubblicazione: (2024)

TestAgent: An Adaptive and Intelligent Expert for Human Assessment
di: Yu, Junhao, et al.
Pubblicazione: (2025)

PROF: An LLM-based Reward Code Preference Optimization Framework for Offline Imitation Learning
di: Sun, Shengjie, et al.
Pubblicazione: (2025)

Can Slow-thinking LLMs Reason Over Time? Empirical Studies in Time Series Forecasting
di: Cheng, Mingyue, et al.
Pubblicazione: (2025)

GHPO: Adaptive Guidance for Stable and Efficient LLM Reinforcement Learning
di: Liu, Ziru, et al.
Pubblicazione: (2025)

TriP-LLM: A Tri-Branch Patch-wise Large Language Model Framework for Time-Series Anomaly Detection
di: Yu, Yuan-Cheng, et al.
Pubblicazione: (2025)

Are Your Reasoning Models Reasoning or Guessing? A Mechanistic Analysis of Hierarchical Reasoning Models
di: Ren, Zirui, et al.
Pubblicazione: (2026)

Time Series Forecasting as Reasoning: A Slow-Thinking Approach with Reinforced LLMs
di: Zhou, Yitong, et al.
Pubblicazione: (2025)

VESPO: Variational Sequence-Level Soft Policy Optimization for Stable Off-Policy LLM Training
di: Shen, Guobin, et al.
Pubblicazione: (2026)

ChessArena: A Chess Testbed for Evaluating Strategic Reasoning Capabilities of Large Language Models
di: Liu, Jincheng, et al.
Pubblicazione: (2025)

Accelerating LLM Reasoning via Early Rejection with Partial Reward Modeling
di: Cheshmi, Seyyed Saeid, et al.
Pubblicazione: (2025)

TextArena
di: Guertler, Leon, et al.
Pubblicazione: (2025)

A Statistical Framework for Ranking LLM-Based Chatbots
di: Ameli, Siavash, et al.
Pubblicazione: (2024)

Dependency-based Anomaly Detection: a General Framework and Comprehensive Evaluation
di: Lu, Sha, et al.
Pubblicazione: (2020)

MiMu: Mitigating Multiple Shortcut Learning Behavior of Transformers
di: Zhao, Lili, et al.
Pubblicazione: (2025)

TreeCut: A Synthetic Unanswerable Math Word Problem Dataset for LLM Hallucination Evaluation
di: Ouyang, Jialin
Pubblicazione: (2025)

CastFlow: Learning Role-Specialized Agentic Workflows for Time Series Forecasting
di: Pan, Bokai, et al.
Pubblicazione: (2026)

Unified Uncertainty Estimation for Cognitive Diagnosis Models
di: Wang, Fei, et al.
Pubblicazione: (2024)

CirrusBench: Evaluating LLM-based Agents Beyond Correctness in Real-World Cloud Service Environments
di: Yu, Yi, et al.
Pubblicazione: (2026)

Instance-level Randomization: Toward More Stable LLM Evaluations
di: Li, Yiyang, et al.
Pubblicazione: (2025)

AgentKernelArena: Generalization-Aware Benchmarking of GPU Kernel Optimization Agents
di: Younesian, Sharareh, et al.
Pubblicazione: (2026)

Dynamic Vocabulary Pruning: Stable LLM-RL by Taming the Tail
di: Li, Yingru, et al.
Pubblicazione: (2025)

Refining Alignment Framework for Diffusion Models with Intermediate-Step Preference Ranking
di: Ren, Jie, et al.
Pubblicazione: (2025)

Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
di: Liu, Yong, et al.
Pubblicazione: (2024)

ArenaBencher: Automatic Benchmark Evolution via Multi-Model Competitive Evaluation
di: Liu, Qin, et al.
Pubblicazione: (2025)

ArenaRL: Scaling RL for Open-Ended Agents via Tournament-based Relative Ranking
di: Zhang, Qiang, et al.
Pubblicazione: (2026)

Ladder: A Model-Agnostic Framework Boosting LLM-based Machine Translation to the Next Level
di: Feng, Zhaopeng, et al.
Pubblicazione: (2024)

Conformal Segmentation in Industrial Surface Defect Detection with Statistical Guarantees
di: Shen, Cheng, et al.
Pubblicazione: (2025)

On Evaluating LLM Alignment by Evaluating LLMs as Judges
di: Liu, Yixin, et al.
Pubblicazione: (2025)