Copertina

Stochasticity in Agentic Evaluations: Quantifying Inconsistency with Intraclass Correlation

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Mustahsan, Zairah, Lim, Abel, Anand, Megna, Jain, Saahil, McCann, Bryan
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Smart Traffic Signals: Comparing MARL and Fixed-Time Strategies
di: Mahato, Saahil
Pubblicazione: (2025)

The Two Boundaries: Why Behavioral AI Governance Fails Structurally
di: McCann, Alan L.
Pubblicazione: (2026)

Governed Metaprogramming for Intelligent Systems: Reclassifying Eval as a Governed Effect
di: McCann, Alan L.
Pubblicazione: (2026)

Mechanized Foundations of Structural Governance: Machine-Checked Proofs for Governed Intelligence
di: McCann, Alan L.
Pubblicazione: (2026)

Rank Intraclass Correlation for Clustered Data
di: Tu, Shengxin, et al.
Pubblicazione: (2023)

GenHPE: Generative Counterfactuals for 3D Human Pose Estimation with Radio Frequency Signals
di: Huang, Shuokang, et al.
Pubblicazione: (2025)

Cryptographic Registry Provenance: Structural Defense Against Dependency Confusion in AI Package Ecosystems
di: McCann, Alan L.
Pubblicazione: (2026)

Certified Purity for Cognitive Workflow Executors: From Static Analysis to Cryptographic Attestation
di: McCann, Alan L.
Pubblicazione: (2026)

Effect-Transparent Governance for AI Workflow Architectures: Semantic Preservation, Expressive Minimality, and Decidability Boundaries
di: McCann, Alan L.
Pubblicazione: (2026)

Algebraic Semantics of Governed Execution: Monoidal Categories, Effect Algebras, and Coterminous Boundaries
di: McCann, Alan L.
Pubblicazione: (2026)

OPAL: Encoding Causal Understanding of Physical Systems for Robot Learning
di: Tcheurekdjian, Daniel, et al.
Pubblicazione: (2025)

Quantifying the Accuracy and Cost Impact of Design Decisions in Budget-Constrained Agentic LLM Search
di: McCleary, Kyle, et al.
Pubblicazione: (2026)

Explainable Adversarial Learning Framework on Physical Layer Secret Keys Combating Malicious Reconfigurable Intelligent Surface
di: Wei, Zhuangkun, et al.
Pubblicazione: (2024)

A Bossa Nova e a influência do blues, 1955-1964
di: Bryan McCann
Pubblicazione: (2010)

An Embedding-based Approach to Inconsistency-tolerant Reasoning with Inconsistent Ontologies
di: Wang, Keyu, et al.
Pubblicazione: (2023)

Beyond Expected Return: Accounting for Policy Reproducibility when Evaluating Reinforcement Learning Algorithms
di: Flageat, Manon, et al.
Pubblicazione: (2023)

Quantifying the Expectation-Realisation Gap for Agentic AI Systems
di: Lobentanzer, Sebastian
Pubblicazione: (2026)

Chapter 1 Borders of Engagement: Rethinking Scholarship, Activism, and the Academy
di: McCann, Bryan J.
Pubblicazione: (2020)

Overcoming Growth-Induced Forgetting in Task-Agnostic Continual Learning
di: Zhao, Yuqing, et al.
Pubblicazione: (2024)

Quantifying Trust: Financial Risk Management for Trustworthy AI Agents
di: Hua, Wenyue, et al.
Pubblicazione: (2026)

Reasoning and Tool-use Compete in Agentic RL:From Quantifying Interference to Disentangled Tuning
di: Li, Yu, et al.
Pubblicazione: (2026)

Impact of clinical decision support systems (cdss) on clinical outcomes and healthcare delivery in low- and middle-income countries: protocol for a systematic review and meta-analysis
di: Jain, Garima, et al.
Pubblicazione: (2025)

Agentic Discovery of Exchange-Correlation Density Functionals
di: Duston, Titouan, et al.
Pubblicazione: (2026)

An Agentic Evaluation Framework for AI-Generated Scientific Code in PETSc
di: Zhang, Hong, et al.
Pubblicazione: (2026)

Discourse-Driven Evaluation: Unveiling Factual Inconsistency in Long Document Summarization
di: Zhong, Yang, et al.
Pubblicazione: (2025)

What Limits Agentic Systems Efficiency?
di: Bian, Song, et al.
Pubblicazione: (2025)

Solving 3D Inverse Problems using Pre-trained 2D Diffusion Models
di: Chung, Hyungjin, et al.
Pubblicazione: (2022)

Position: Safety and Fairness in Agentic AI Depend on Interaction Topology, Not on Model Scale or Alignment
di: Bajaj, Tanav Singh, et al.
Pubblicazione: (2026)

(Neural-Symbolic) Machine Learning for Inconsistency Measurement
di: Weinzierl, Sven, et al.
Pubblicazione: (2025)

Beyond Stochastic Exploration: What Makes Training Data Valuable for Agentic Search
di: Hao, Chuzhan, et al.
Pubblicazione: (2026)

Tokenomics: Quantifying Where Tokens Are Used in Agentic Software Engineering
di: Salim, Mohamad, et al.
Pubblicazione: (2026)

AgenticEval: Toward Agentic and Self-Evolving Safety Evaluation of Large Language Models
di: Wang, Yixu, et al.
Pubblicazione: (2025)

Inconsistencies in Masked Language Models
di: Young, Tom, et al.
Pubblicazione: (2022)

Quantifying Variance in Evaluation Benchmarks
di: Madaan, Lovish, et al.
Pubblicazione: (2024)

Solving Stochastic Orienteering Problems with Chance Constraints Using a GNN Powered Monte Carlo Tree Search
di: Zuzuárregui, Marcos Abel, et al.
Pubblicazione: (2024)

DREAM: Deep Research Evaluation with Agentic Metrics
di: Avraham, Elad Ben, et al.
Pubblicazione: (2026)

TRAIL: Trace Reasoning and Agentic Issue Localization
di: Deshpande, Darshan, et al.
Pubblicazione: (2025)

Retrieving Classes of Causal Orders with Inconsistent Knowledge Bases
di: Baldo, Federico, et al.
Pubblicazione: (2024)

AdapTools: Adaptive Tool-based Indirect Prompt Injection Attacks on Agentic LLMs
di: Wang, Che, et al.
Pubblicazione: (2026)

Inconsistent Databases and Argumentation Frameworks with Collective Attacks
di: Mahmood, Yasir, et al.
Pubblicazione: (2026)