Copertina

AGENTIF: Benchmarking Instruction Following of Large Language Models in Agentic Scenarios

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Qi, Yunjia, Peng, Hao, Wang, Xiaozhi, Xin, Amy, Liu, Youfeng, Xu, Bin, Hou, Lei, Li, Juanzi
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Constraint Back-translation Improves Complex Instruction Following of Large Language Models
di: Qi, Yunjia, et al.
Pubblicazione: (2024)

VerIF: Verification Engineering for Reinforcement Learning in Instruction Following
di: Peng, Hao, et al.
Pubblicazione: (2025)

Agentic Reward Modeling: Integrating Human Preferences with Verifiable Correctness Signals for Reliable Reward Systems
di: Peng, Hao, et al.
Pubblicazione: (2025)

On the Paradoxical Interference between Instruction-Following and Task Solving
di: Qi, Yunjia, et al.
Pubblicazione: (2026)

ADELIE: Aligning Large Language Models on Information Extraction
di: Qi, Yunjia, et al.
Pubblicazione: (2024)

StoryAlign: Evaluating and Training Reward Models for Story Generation
di: Xia, Haotian, et al.
Pubblicazione: (2026)

WildReward: Learning Reward Models from In-the-Wild Human Interactions
di: Peng, Hao, et al.
Pubblicazione: (2026)

StoryWriter: A Multi-Agent Framework for Long Story Generation
di: Xia, Haotian, et al.
Pubblicazione: (2025)

MAVEN-Fact: A Large-scale Event Factuality Detection Dataset
di: Li, Chunyang, et al.
Pubblicazione: (2024)

LLMAEL: Large Language Models are Good Context Augmenters for Entity Linking
di: Xin, Amy, et al.
Pubblicazione: (2024)

MRCEval: A Comprehensive, Challenging and Accessible Machine Reading Comprehension Benchmark
di: Ma, Shengkun, et al.
Pubblicazione: (2025)

Pre-training Distillation for Large Language Models: A Design Space Exploration
di: Peng, Hao, et al.
Pubblicazione: (2024)

R-Eval: A Unified Toolkit for Evaluating Domain Knowledge of Retrieval Augmented Large Language Models
di: Tu, Shangqing, et al.
Pubblicazione: (2024)

Boundary-Guided Policy Optimization for Memory-efficient RL of Diffusion Large Language Models
di: Lin, Nianyi, et al.
Pubblicazione: (2025)

CIF-Bench: A Chinese Instruction-Following Benchmark for Evaluating the Generalizability of Large Language Models
di: LI, Yizhi, et al.
Pubblicazione: (2024)

Event-level Knowledge Editing
di: Peng, Hao, et al.
Pubblicazione: (2024)

OctoBench: Benchmarking Scaffold-Aware Instruction Following in Repository-Grounded Agentic Coding
di: Ding, Deming, et al.
Pubblicazione: (2026)

ChatLog: Carefully Evaluating the Evolution of ChatGPT Across Time
di: Tu, Shangqing, et al.
Pubblicazione: (2023)

OpenEP: Open-Ended Future Event Prediction
di: Guan, Yong, et al.
Pubblicazione: (2024)

WaterBench: Towards Holistic Evaluation of Watermarks for Large Language Models
di: Tu, Shangqing, et al.
Pubblicazione: (2023)

Beyond Instruction Following: Evaluating Inferential Rule Following of Large Language Models
di: Sun, Wangtao, et al.
Pubblicazione: (2024)

ABC-Eval: Benchmarking Large Language Models on Symbolic Music Understanding and Instruction Following
di: Zhao, Jiahao, et al.
Pubblicazione: (2025)

Towards Understanding Safety Alignment: A Mechanistic Perspective from Safety Neurons
di: Chen, Jianhui, et al.
Pubblicazione: (2024)

Preserving Knowledge Invariance: Rethinking Robustness Evaluation of Open Information Extraction
di: Qi, Ji, et al.
Pubblicazione: (2023)

Guiding LLM Post-training Data Engineering with Model Internals from Sparse Autoencoders
di: Jing, Yi, et al.
Pubblicazione: (2026)

KITE: A Benchmark for Evaluating Korean Instruction-Following Abilities in Large Language Models
di: Kim, Dongjun, et al.
Pubblicazione: (2025)

TacoERE: Cluster-aware Compression for Event Relation Extraction
di: Guan, Yong, et al.
Pubblicazione: (2024)

LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks
di: Bai, Yushi, et al.
Pubblicazione: (2024)

KoLA: Carefully Benchmarking World Knowledge of Large Language Models
di: Yu, Jifan, et al.
Pubblicazione: (2023)

LIFEBench: Evaluating Length Instruction Following in Large Language Models
di: Zhang, Wei, et al.
Pubblicazione: (2025)

LinguaLens: Towards Interpreting Linguistic Mechanisms of Large Language Models via Sparse Auto-Encoder
di: Jing, Yi, et al.
Pubblicazione: (2025)

AtomR: Atomic Operator-Empowered Large Language Models for Heterogeneous Knowledge Reasoning
di: Xin, Amy, et al.
Pubblicazione: (2024)

Benchmarking Complex Instruction-Following with Multiple Constraints Composition
di: Wen, Bosi, et al.
Pubblicazione: (2024)

InFoBench: Evaluating Instruction Following Ability in Large Language Models
di: Qin, Yiwei, et al.
Pubblicazione: (2024)

RefuteBench: Evaluating Refuting Instruction-Following for Large Language Models
di: Yan, Jianhao, et al.
Pubblicazione: (2024)

Countering Catastrophic Forgetting of Large Language Models for Better Instruction Following via Weight-Space Model Merging
di: Lyu, Mengxian, et al.
Pubblicazione: (2026)

Aligning Large Language Models to Follow Instructions and Hallucinate Less via Effective Data Filtering
di: Si, Shuzheng, et al.
Pubblicazione: (2025)

Can Language Models Follow Multiple Turns of Entangled Instructions?
di: Han, Chi, et al.
Pubblicazione: (2025)

MulDimIF: A Multi-Dimensional Constraint Framework for Evaluating and Improving Instruction Following in Large Language Models
di: Ye, Junjie, et al.
Pubblicazione: (2025)

Instruction Following by Principled Boosting Attention of Large Language Models
di: Guardieiro, Vitoria, et al.
Pubblicazione: (2025)