Generative-Evaluative Agreement: A Necessary Validity Criterion for LLM-Enabled Adaptive Assessment
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Lee, Grandee, Wang, Yue, Lye, Che Yee, Peh, Luke |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Criterion Validity of LLM-as-Judge for Business Outcomes in Conversational Commerce
par: Chen, Liang, et autres
Publié: (2026)
par: Chen, Liang, et autres
Publié: (2026)
Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
par: Eo, Sugyeong, et autres
Publié: (2025)
par: Eo, Sugyeong, et autres
Publié: (2025)
Prompt Fencing: A Cryptographic Approach to Establishing Security Boundaries in Large Language Model Prompts
par: Peh, Steven
Publié: (2025)
par: Peh, Steven
Publié: (2025)
Concurrent Criterion Validation of a Validity Screen for LLM Confidence Signals via Selective Prediction
par: Cacioli, Jon-Paul
Publié: (2026)
par: Cacioli, Jon-Paul
Publié: (2026)
On the Collapse of Generative Paths: A Criterion and Correction for Diffusion Steering
par: Lee, Ziseok, et autres
Publié: (2025)
par: Lee, Ziseok, et autres
Publié: (2025)
HALO: Hardware-aware quantization with low critical-path-delay weights for LLM acceleration
par: Juneja, Rohan, et autres
Publié: (2025)
par: Juneja, Rohan, et autres
Publié: (2025)
VSPO: Validating Semantic Pitfalls in Ontology via LLM-Based CQ Generation
par: Choi, Hyojun, et autres
Publié: (2025)
par: Choi, Hyojun, et autres
Publié: (2025)
Reality Check: A New Evaluation Ecosystem Is Necessary to Understand AI's Real World Effects
par: Schwartz, Reva, et autres
Publié: (2025)
par: Schwartz, Reva, et autres
Publié: (2025)
Case-Specific Rubrics for Clinical AI Evaluation: Methodology, Validation, and LLM-Clinician Agreement Across 823 Encounters
par: Shah, Aaryan, et autres
Publié: (2026)
par: Shah, Aaryan, et autres
Publié: (2026)
Are We Evaluating the Edit Locality of LLM Model Editing Properly?
par: Liu, Wei, et autres
Publié: (2026)
par: Liu, Wei, et autres
Publié: (2026)
LinTree: Improving LLM Reasoning with Explicitly Structured Search Histories
par: Kang, Liwei, et autres
Publié: (2026)
par: Kang, Liwei, et autres
Publié: (2026)
Decipherment-Aware Multilingual Learning in Jointly Trained Language Models
par: Lee, Grandee
Publié: (2024)
par: Lee, Grandee
Publié: (2024)
Is Prompt Selection Necessary for Task-Free Online Continual Learning?
par: Park, Seoyoung, et autres
Publié: (2026)
par: Park, Seoyoung, et autres
Publié: (2026)
Integrated Framework for LLM Evaluation with Answer Generation
par: Lee, Sujeong, et autres
Publié: (2025)
par: Lee, Sujeong, et autres
Publié: (2025)
Are Expressive Encoders Necessary for Discrete Graph Generation?
par: Revolinsky, Jay, et autres
Publié: (2026)
par: Revolinsky, Jay, et autres
Publié: (2026)
Validating LLM-Generated Programs with Metamorphic Prompt Testing
par: Wang, Xiaoyin, et autres
Publié: (2024)
par: Wang, Xiaoyin, et autres
Publié: (2024)
CLAVE: An Adaptive Framework for Evaluating Values of LLM Generated Responses
par: Yao, Jing, et autres
Publié: (2024)
par: Yao, Jing, et autres
Publié: (2024)
Model Tampering Attacks Enable More Rigorous Evaluations of LLM Capabilities
par: Che, Zora, et autres
Publié: (2025)
par: Che, Zora, et autres
Publié: (2025)
Who Validates the Validators? Aligning LLM-Assisted Evaluation of LLM Outputs with Human Preferences
par: Shankar, Shreya, et autres
Publié: (2024)
par: Shankar, Shreya, et autres
Publié: (2024)
Pioneering Reliable Assessment in Text-to-Image Knowledge Editing: Leveraging a Fine-Grained Dataset and an Innovative Criterion
par: Gu, Hengrui, et autres
Publié: (2024)
par: Gu, Hengrui, et autres
Publié: (2024)
Modeling the Data-Generating Process is Necessary for Out-of-Distribution Generalization
par: Kaur, Jivat Neet, et autres
Publié: (2022)
par: Kaur, Jivat Neet, et autres
Publié: (2022)
Towards Feedback-to-Plan Decisions for Self-Evolving LLM Agents in CUDA Kernel Generation
par: Chong, Yee Hin, et autres
Publié: (2026)
par: Chong, Yee Hin, et autres
Publié: (2026)
Enhancing Financial Inclusion and Regulatory Challenges: A Critical Analysis of Digital Banks and Alternative Lenders Through Digital Platforms, Machine Learning, and Large Language Models Integration
par: Lee, Luke
Publié: (2024)
par: Lee, Luke
Publié: (2024)
Establishing Performance Baselines in Fine-Tuning, Retrieval-Augmented Generation and Soft-Prompting for Non-Specialist LLM Users
par: Dodgson, Jennifer, et autres
Publié: (2023)
par: Dodgson, Jennifer, et autres
Publié: (2023)
Dynamic and Adaptive Feature Generation with LLM
par: Zhang, Xinhao, et autres
Publié: (2024)
par: Zhang, Xinhao, et autres
Publié: (2024)
Don't Overthink It: Inter-Rollout Action Agreement as a Free Adaptive-Compute Signal for LLM Agents
par: Sethi, Khushal
Publié: (2026)
par: Sethi, Khushal
Publié: (2026)
Benchmarking Emergent Coordination in Large-Scale LLM Populations: An Evaluation Framework on the MoltBook Archive
par: Yee, Brandon, et autres
Publié: (2026)
par: Yee, Brandon, et autres
Publié: (2026)
The Price of Agreement: Measuring LLM Sycophancy in Agentic Financial Applications
par: Zhao, Zhenyu, et autres
Publié: (2026)
par: Zhao, Zhenyu, et autres
Publié: (2026)
SMART: Self-Generating and Self-Validating Multi-Dimensional Assessment for LLMs' Mathematical Problem Solving
par: Hou, Yujie, et autres
Publié: (2025)
par: Hou, Yujie, et autres
Publié: (2025)
Chain-of-Trust: A Progressive Trust Evaluation Framework Enabled by Generative AI
par: Zhu, Botao, et autres
Publié: (2025)
par: Zhu, Botao, et autres
Publié: (2025)
Memorize or Generalize? Evaluating LLM Code Generation with Code Rewriting
par: Zhang, Lizhe, et autres
Publié: (2025)
par: Zhang, Lizhe, et autres
Publié: (2025)
From Natural Language to Solver-Ready Power System Optimization: An LLM-Assisted, Validation-in-the-Loop Framework
par: Hu, Yunkai, et autres
Publié: (2025)
par: Hu, Yunkai, et autres
Publié: (2025)
Adaptive Reasoning and Acting in Medical Language Agents
par: Dutta, Abhishek, et autres
Publié: (2024)
par: Dutta, Abhishek, et autres
Publié: (2024)
Learning to Visually Connect Actions and their Effects
par: Parmar, Paritosh, et autres
Publié: (2024)
par: Parmar, Paritosh, et autres
Publié: (2024)
Are Human-generated Demonstrations Necessary for In-context Learning?
par: Li, Rui, et autres
Publié: (2023)
par: Li, Rui, et autres
Publié: (2023)
Automated Validation of LLM-based Evaluators for Software Engineering Artifacts
par: Fandina, Ora Nova, et autres
Publié: (2025)
par: Fandina, Ora Nova, et autres
Publié: (2025)
On the Complexity of Global Necessary Reasons to Explain Classification
par: Calautti, Marco, et autres
Publié: (2025)
par: Calautti, Marco, et autres
Publié: (2025)
A Theoretical Analysis of Compositional Generalization in Neural Networks: A Necessary and Sufficient Condition
par: Li, Yuanpeng
Publié: (2025)
par: Li, Yuanpeng
Publié: (2025)
Interactive Visual Assessment for Text-to-Image Generation Models
par: Mi, Xiaoyue, et autres
Publié: (2024)
par: Mi, Xiaoyue, et autres
Publié: (2024)
Judge's Verdict: A Comprehensive Analysis of LLM Judge Capability Through Human Agreement
par: Han, Steve, et autres
Publié: (2025)
par: Han, Steve, et autres
Publié: (2025)
Documents similaires
-
Criterion Validity of LLM-as-Judge for Business Outcomes in Conversational Commerce
par: Chen, Liang, et autres
Publié: (2026) -
Debate Only When Necessary: Adaptive Multiagent Collaboration for Efficient LLM Reasoning
par: Eo, Sugyeong, et autres
Publié: (2025) -
Prompt Fencing: A Cryptographic Approach to Establishing Security Boundaries in Large Language Model Prompts
par: Peh, Steven
Publié: (2025) -
Concurrent Criterion Validation of a Validity Screen for LLM Confidence Signals via Selective Prediction
par: Cacioli, Jon-Paul
Publié: (2026) -
On the Collapse of Generative Paths: A Criterion and Correction for Diffusion Steering
par: Lee, Ziseok, et autres
Publié: (2025)