Image de couverture de livre

One Battle After Another: Probing LLMs' Limits on Multi-Turn Instruction Following with a Benchmark Evolving Framework

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Jia, Qi, Shen, Ye, Song, Xiujie, Zhang, Kaiwei, Wang, Shibo, Pei, Dun, Zhu, Xiangyang, Zhai, Guangtao
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

UniDial-EvalKit: A Unified Toolkit for Evaluating Multi-Faceted Conversational Abilities
par: Jia, Qi, et autres
Publié: (2026)

User-centric Subjective Leaderboard by Customizable Reward Modeling
par: Jia, Qi, et autres
Publié: (2025)

EvolMem: A Cognitive-Driven Benchmark for Multi-Session Dialogue Memory
par: Shen, Ye, et autres
Publié: (2026)

SafetyFlow: An Agent-Flow System for Automated LLM Safety Benchmarking
par: Zhu, Xiangyang, et autres
Publié: (2025)

Multi-IF: Benchmarking LLMs on Multi-Turn and Multilingual Instructions Following
par: He, Yun, et autres
Publié: (2024)

LiveProteinBench: A Contamination-Free Benchmark for Assessing Models' Specialized Capabilities in Protein Science
par: Rong, Dingyi, et autres
Publié: (2025)

Sycophancy under Pressure: Evaluating and Mitigating Sycophantic Bias via Adversarial Dialogues in Scientific QA
par: Zhang, Kaiwei, et autres
Publié: (2025)

One Thing Follows Another
par: Rosenthal, Sarah
Publié: (2025)

A Multi-To-One Interview Paradigm for Efficient MLLM Evaluation
par: Shen, Ye, et autres
Publié: (2025)

PriceSeer: Evaluating Large Language Models in Real-Time Stock Prediction
par: Liang, Bohan, et autres
Publié: (2025)

KidVis: Do Multimodal Large Language Models Possess the Visual Perceptual Capabilities of a 6-Year-Old?
par: Wang, Xianfeng, et autres
Publié: (2026)

MedOmni-45°: A Safety-Performance Benchmark for Reasoning-Oriented LLMs in Medicine
par: Ji, Kaiyuan, et autres
Publié: (2025)

Textured Mesh Saliency: Bridging Geometry and Texture for Human Perception in 3D Graphics
par: Zhang, Kaiwei, et autres
Publié: (2024)

Mesh Mamba: A Unified State Space Model for Saliency Prediction in Non-Textured and Textured Meshes
par: Zhang, Kaiwei, et autres
Publié: (2025)

MMMT-IF: A Challenging Multimodal Multi-Turn Instruction Following Benchmark
par: Epstein, Elliot L., et autres
Publié: (2024)

The Ever-Evolving Science Exam
par: Wang, Junying, et autres
Publié: (2025)

VQAThinker: Exploring Generalizable and Explainable Video Quality Assessment via Reinforcement Learning
par: Cao, Linhan, et autres
Publié: (2025)

Generalizable Video Quality Assessment via Weak-to-Strong Learning
par: Cao, Linhan, et autres
Publié: (2025)

QualiRAG: Retrieval-Augmented Generation for Visual Quality Understanding
par: Cao, Linhan, et autres
Publié: (2026)

LifeEval: A Multimodal Benchmark for Assistive AI in Egocentric Daily Life Tasks
par: Gao, Hengjian, et autres
Publié: (2026)

Exploring Instruction Data Quality for Explainable Image Quality Assessment
par: Li, Yunhao, et autres
Publié: (2025)

MathChat: Benchmarking Mathematical Reasoning and Instruction Following in Multi-Turn Interactions
par: Liang, Zhenwen, et autres
Publié: (2024)

Can Large Models Fool the Eye? A New Turing Test for Biological Animation
par: Chen, Zijian, et autres
Publié: (2025)

ShortcutProbe: Probing Prediction Shortcuts for Learning Robust Models
par: Zheng, Guangtao, et autres
Publié: (2025)

A Hierarchical and Evolvable Benchmark for Fine-Grained Code Instruction Following with Multi-Turn Feedback
par: Duan, Guoliang, et autres
Publié: (2025)

One Thing Leads to Another: Faculty Outreach through Internet Instruction.
par: Borowske, Kate, et autres
Publié: (1997)

FollowTable: A Benchmark for Instruction-Following Table Retrieval
par: Jin, Rihui, et autres
Publié: (2026)

QoNext: Towards Next-generation QoE for Foundation Models
par: Guo, Yijin, et autres
Publié: (2025)

Falcon-UI: Understanding GUI Before Following User Instructions
par: Shen, Huawen, et autres
Publié: (2024)

LLM CHESS: Benchmarking Reasoning and Instruction-Following in LLMs through Chess
par: Kolasani, Sai, et autres
Publié: (2025)

Enhancing and Assessing Instruction-Following with Fine-Grained Instruction Variants
par: Yang, Jiuding, et autres
Publié: (2024)

SEIF: Self-Evolving Reinforcement Learning for Instruction Following
par: Ren, Qingyu, et autres
Publié: (2026)

Quality Assessment for AI Generated Images with Instruction Tuning
par: Wang, Jiarui, et autres
Publié: (2024)

Can Language Models Follow Multiple Turns of Entangled Instructions?
par: Han, Chi, et autres
Publié: (2025)

IF-RewardBench: Benchmarking Judge Models for Instruction-Following Evaluation
par: Wen, Bosi, et autres
Publié: (2026)

GraphIF: Enhancing Multi-Turn Instruction Following for Large Language Models with Relation Graph Prompt
par: Li, Zhenhe, et autres
Publié: (2025)

ELIQ: A Label-Free Framework for Quality Assessment of Evolving AI-Generated Images
par: Li, Xinyue, et autres
Publié: (2026)

Benchmarking Complex Instruction-Following with Multiple Constraints Composition
par: Wen, Bosi, et autres
Publié: (2024)

Meeseeks: A Feedback-Driven, Iterative Self-Correction Benchmark evaluating LLMs' Instruction Following Capability
par: wang, Jiaming, et autres
Publié: (2025)

A Coding Framework and Benchmark towards Low-Bitrate Video Understanding
par: Tian, Yuan, et autres
Publié: (2022)