Beyond Static Snapshots: A Grounded Evaluation Framework for Language Models at the Agentic Frontier
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | Henry, Jazmia |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Prompting Fairness: Artificial Intelligence as Game Players
par: Henry, Jazmia
Publié: (2024)
par: Henry, Jazmia
Publié: (2024)
Beyond Static Snapshots: Dynamic Modeling and Forecasting of Group-Level Value Evolution with Large Language Models
par: Pi, Qiankun, et autres
Publié: (2026)
par: Pi, Qiankun, et autres
Publié: (2026)
Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicine
par: Viviers, Christiaan G. A., et autres
Publié: (2026)
par: Viviers, Christiaan G. A., et autres
Publié: (2026)
The Hierarchy of Agentic Capabilities: Evaluating Frontier Models on Realistic RL Environments
par: Ritchie, Logan, et autres
Publié: (2026)
par: Ritchie, Logan, et autres
Publié: (2026)
Beyond Accuracy: A Multi-Dimensional Framework for Evaluating Enterprise Agentic AI Systems
par: Mehta, Sushant
Publié: (2025)
par: Mehta, Sushant
Publié: (2025)
Unified Preference Optimization: Language Model Alignment Beyond the Preference Frontier
par: Badrinath, Anirudhan, et autres
Publié: (2024)
par: Badrinath, Anirudhan, et autres
Publié: (2024)
Beyond Protein Language Models: An Agentic LLM Framework for Mechanistic Enzyme Design
par: Jacob, Bruno, et autres
Publié: (2025)
par: Jacob, Bruno, et autres
Publié: (2025)
The Evaluation Game: Beyond Static LLM Benchmarking
par: Wang, Paul, et autres
Publié: (2026)
par: Wang, Paul, et autres
Publié: (2026)
TeachBench: A Syllabus-Grounded Framework for Evaluating Teaching Ability in Large Language Models
par: Li, Zheng, et autres
Publié: (2026)
par: Li, Zheng, et autres
Publié: (2026)
AgenticEval: Toward Agentic and Self-Evolving Safety Evaluation of Large Language Models
par: Wang, Yixu, et autres
Publié: (2025)
par: Wang, Yixu, et autres
Publié: (2025)
Beyond Task Completion: An Assessment Framework for Evaluating Agentic AI Systems
par: Akshathala, Sreemaee, et autres
Publié: (2025)
par: Akshathala, Sreemaee, et autres
Publié: (2025)
A Unified Framework for the Evaluation of LLM Agentic Capabilities
par: Zhu, Pengyu, et autres
Publié: (2026)
par: Zhu, Pengyu, et autres
Publié: (2026)
ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence
par: Foundation, ARC Prize
Publié: (2026)
par: Foundation, ARC Prize
Publié: (2026)
Auditing Frontier Vision-Language Models for Trustworthy Medical VQA: Grounding Failures, Format Collapse, and Domain Adaptation
par: Chen, Xupeng, et autres
Publié: (2026)
par: Chen, Xupeng, et autres
Publié: (2026)
SpotAgent: Grounding Visual Geo-localization in Large Vision-Language Models through Agentic Reasoning
par: Jia, Furong, et autres
Publié: (2026)
par: Jia, Furong, et autres
Publié: (2026)
Evaluating Small Language Models for Agentic On-Farm Decision Support Systems
par: Liu, Enhong, et autres
Publié: (2025)
par: Liu, Enhong, et autres
Publié: (2025)
Beyond SMILES: Evaluating Agentic Systems for Drug Discovery
par: Wijaya, Edward
Publié: (2026)
par: Wijaya, Edward
Publié: (2026)
Beyond Static Assumptions: the Predictive Justified Perspective Model for Epistemic Planning
par: Hu, Guang, et autres
Publié: (2024)
par: Hu, Guang, et autres
Publié: (2024)
LLM-as-an-Interviewer: Beyond Static Testing Through Dynamic LLM Evaluation
par: Kim, Eunsu, et autres
Publié: (2024)
par: Kim, Eunsu, et autres
Publié: (2024)
Agentic World Modeling: Foundations, Capabilities, Laws, and Beyond
par: Chu, Meng, et autres
Publié: (2026)
par: Chu, Meng, et autres
Publié: (2026)
Beyond Metrics: A Critical Analysis of the Variability in Large Language Model Evaluation Frameworks
par: Pimentel, Marco AF, et autres
Publié: (2024)
par: Pimentel, Marco AF, et autres
Publié: (2024)
PRiSM: An Agentic Multimodal Benchmark for Scientific Reasoning via Python-Grounded Evaluation
par: Imani, Shima, et autres
Publié: (2025)
par: Imani, Shima, et autres
Publié: (2025)
Think, Act, Build: An Agentic Framework with Vision Language Models for Zero-Shot 3D Visual Grounding
par: Wang, Haibo, et autres
Publié: (2026)
par: Wang, Haibo, et autres
Publié: (2026)
Limits of Emergent Reasoning of Large Language Models in Agentic Frameworks for Deterministic Games
par: Su, Chris, et autres
Publié: (2025)
par: Su, Chris, et autres
Publié: (2025)
Beyond Monolithic Architectures: A Multi-Agent Search and Knowledge Optimization Framework for Agentic Search
par: Chen, Yiqun, et autres
Publié: (2026)
par: Chen, Yiqun, et autres
Publié: (2026)
JudgeAgent: Beyond Static Benchmarks for Knowledge-Driven and Dynamic LLM Evaluation
par: Shi, Zhichao, et autres
Publié: (2025)
par: Shi, Zhichao, et autres
Publié: (2025)
Knowledge-Grounded Agentic Large Language Models for Multi-Hazard Understanding from Reconnaissance Reports
par: Kuai, Chenchen, et autres
Publié: (2025)
par: Kuai, Chenchen, et autres
Publié: (2025)
Frontier AI Ethics: Anticipating and Evaluating the Societal Impacts of Language Model Agents
par: Lazar, Seth
Publié: (2024)
par: Lazar, Seth
Publié: (2024)
An Agentic Evaluation Framework for AI-Generated Scientific Code in PETSc
par: Zhang, Hong, et autres
Publié: (2026)
par: Zhang, Hong, et autres
Publié: (2026)
Beyond Static Artifacts: A Forensic Benchmark for Video Deepfake Reasoning in Vision Language Models
par: Gu, Zheyuan, et autres
Publié: (2026)
par: Gu, Zheyuan, et autres
Publié: (2026)
Governing AI Beyond the Pretraining Frontier
par: Caputo, Nicholas A.
Publié: (2025)
par: Caputo, Nicholas A.
Publié: (2025)
Sabotage Evaluations for Frontier Models
par: Benton, Joe, et autres
Publié: (2024)
par: Benton, Joe, et autres
Publié: (2024)
Are Frontier Large Language Models Suitable for Q&A in Science Centres?
par: Watson, Jacob, et autres
Publié: (2024)
par: Watson, Jacob, et autres
Publié: (2024)
Do Multi-Agents Solve Better Than Single? Evaluating Agentic Frameworks for Diagram-Grounded Geometry Problem Solving and Reasoning
par: Sobhani, Mahbub E, et autres
Publié: (2025)
par: Sobhani, Mahbub E, et autres
Publié: (2025)
A Frontier AI Risk Management Framework: Bridging the Gap Between Current AI Practices and Established Risk Management
par: Campos, Simeon, et autres
Publié: (2025)
par: Campos, Simeon, et autres
Publié: (2025)
How NOT to benchmark your SITE metric: Beyond Static Leaderboards and Towards Realistic Evaluation
par: Singh, Prabhant, et autres
Publié: (2025)
par: Singh, Prabhant, et autres
Publié: (2025)
GCA Framework: A GCC Countries-Grounded Dataset and Agentic Pipeline for Climate Decision Support
par: Sheikh, Muhammad Umer, et autres
Publié: (2026)
par: Sheikh, Muhammad Umer, et autres
Publié: (2026)
Beyond Surface Judgments: Human-Grounded Risk Evaluation of LLM-Generated Disinformation
par: Xu, Zonghuan, et autres
Publié: (2026)
par: Xu, Zonghuan, et autres
Publié: (2026)
AEMA: Verifiable Evaluation Framework for Trustworthy and Controlled Agentic LLM Systems
par: Lee, YenTing, et autres
Publié: (2026)
par: Lee, YenTing, et autres
Publié: (2026)
Modeling Expert AI Diagnostic Alignment via Immutable Inference Snapshots
par: Panagoulias, Dimitrios P., et autres
Publié: (2026)
par: Panagoulias, Dimitrios P., et autres
Publié: (2026)
Documents similaires
-
Prompting Fairness: Artificial Intelligence as Game Players
par: Henry, Jazmia
Publié: (2024) -
Beyond Static Snapshots: Dynamic Modeling and Forecasting of Group-Level Value Evolution with Large Language Models
par: Pi, Qiankun, et autres
Publié: (2026) -
Evidence-Grounded Frontier Mapping and Agentic Hypothesis Generation in Nanomedicine
par: Viviers, Christiaan G. A., et autres
Publié: (2026) -
The Hierarchy of Agentic Capabilities: Evaluating Frontier Models on Realistic RL Environments
par: Ritchie, Logan, et autres
Publié: (2026) -
Beyond Accuracy: A Multi-Dimensional Framework for Evaluating Enterprise Agentic AI Systems
par: Mehta, Sushant
Publié: (2025)