Cover Image

In-Context Environments Induce Evaluation-Awareness in Language Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Chaudhary, Maheep
Format:	Preprint
Published:	2026
Subjects:	Artificial Intelligence Computation and Language Machine Learning Multiagent Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

PAACE: A Plan-Aware Automated Agent Context Engineering Framework
by: Yuksel, Kamer Ali
Published: (2025)

Persuade Me if You Can: A Framework for Evaluating Persuasion Effectiveness and Susceptibility Among Large Language Models
by: Bozdag, Nimet Beyza, et al.
Published: (2025)

Verification-Aware Planning for Multi-Agent Systems
by: Xu, Tianyang, et al.
Published: (2025)

Training Language Models for Social Deduction with Multi-Agent Reinforcement Learning
by: Sarkar, Bidipta, et al.
Published: (2025)

Multi-Objective Reinforcement Learning for Large Language Model Optimization: Visionary Perspective
by: Kong, Lingxiao, et al.
Published: (2025)

Iteration of Thought: Leveraging Inner Dialogue for Autonomous Large Language Model Reasoning
by: Radha, Santosh Kumar, et al.
Published: (2024)

Dipper: Diversity in Prompts for Producing Large Language Model Ensembles in Reasoning tasks
by: Lau, Gregory Kang Ruey, et al.
Published: (2024)

RealICU: Do LLM Agents Understand Long-Context ICU Data? A Benchmark Beyond Behavior Imitation
by: Shen, Chengzhi, et al.
Published: (2026)

Language Agents as Optimizable Graphs
by: Zhuge, Mingchen, et al.
Published: (2024)

PLANET: A Collection of Benchmarks for Evaluating LLMs' Planning Capabilities
by: Li, Haoming, et al.
Published: (2025)

Communicating Sound Through Natural Language
by: Rossi, Emanuele, et al.
Published: (2026)

Doctorina MedBench: End-to-End Evaluation of Agent-Based Medical AI
by: Kozlova, Anna, et al.
Published: (2026)

MUSE-Autoskill: Self-Evolving Agents via Skill Creation, Memory, Management, and Evaluation
by: Lin, Huawei, et al.
Published: (2026)

Dive into the Agent Matrix: A Realistic Evaluation of Self-Replication Risk in LLM Agents
by: Zhang, Boxuan, et al.
Published: (2025)

Language-Guided Tuning: Enhancing Numeric Optimization with Textual Feedback
by: Lu, Yuxing, et al.
Published: (2025)

Advancing Agentic Systems: Dynamic Task Decomposition, Tool Integration and Evaluation using Novel Metrics and Dataset
by: Gabriel, Adrian Garret, et al.
Published: (2024)

Can Agents Judge Systematic Reviews Like Humans? Evaluating SLRs with LLM-based Multi-Agent System
by: Mushtaq, Abdullah, et al.
Published: (2025)

Exploring Natural Language-Based Strategies for Efficient Number Learning in Children through Reinforcement Learning
by: Mittra, Tirthankar
Published: (2024)

Chain of Uncertain Rewards with Large Language Models for Reinforcement Learning
by: Mo, Shentong
Published: (2026)

Context, Reasoning, and Hierarchy: A Cost-Performance Study of Compound LLM Agent Design in an Adversarial POMDP
by: Bogdanov, Igor, et al.
Published: (2026)

Editing Personality for Large Language Models
by: Mao, Shengyu, et al.
Published: (2023)

Optimizing Model Selection for Compound AI Systems
by: Chen, Lingjiao, et al.
Published: (2025)

ToolOrchestra: Elevating Intelligence via Efficient Model and Tool Orchestration
by: Su, Hongjin, et al.
Published: (2025)

Predicting Decisions of AI Agents from Limited Interaction through Text-Tabular Modeling
by: Shapira, Eilam, et al.
Published: (2026)

DR. WELL: Dynamic Reasoning and Learning with Symbolic World Model for Embodied LLM-Based Multi-Agent Collaboration
by: Nourzad, Narjes, et al.
Published: (2025)

MAGIC: A Co-Evolving Attacker-Defender Adversarial Game for Robust LLM Safety
by: Wen, Xiaoyu, et al.
Published: (2026)

Multi-Agent Constraint Factorization Reveals Latent Invariant Solution Structure
by: Scofield, Christopher
Published: (2026)

Recursive Agent Optimization
by: Gandhi, Apurva, et al.
Published: (2026)

MASPO: Joint Prompt Optimization for LLM-based Multi-Agent Systems
by: Wang, Zhexuan, et al.
Published: (2026)

GAMBIT: A Three-Mode Benchmark for Adversarial Robustness in Multi-Agent LLM Collectives
by: Mercier, Alexandre Le, et al.
Published: (2026)

SkillAdaptor: Self-Adapting Skills for LLM Agents from Trajectories
by: Yu, Zhuoyun, et al.
Published: (2026)

Can We Predict Before Executing Machine Learning Agents?
by: Zheng, Jingsheng, et al.
Published: (2026)

Towards Reliable ML Feature Engineering via Planning in Constrained-Topology of LLM Agents
by: Thakur, Himanshu, et al.
Published: (2026)

MAC: Multi-Agent Constitution Learning
by: Thareja, Rushil, et al.
Published: (2026)

AutoML-Agent: A Multi-Agent LLM Framework for Full-Pipeline AutoML
by: Trirat, Patara, et al.
Published: (2024)

Mnemosyne: An Unsupervised, Human-Inspired Long-Term Memory Architecture for Edge-Based LLMs
by: Jonelagadda, Aneesh, et al.
Published: (2025)

HealthFlow: A Self-Evolving AI Agent with Meta Planning for Autonomous Healthcare Research
by: Zhu, Yinghao, et al.
Published: (2025)

Build Your Personalized Research Group: A Multiagent Framework for Continual and Interactive Science Automation
by: Li, Ed, et al.
Published: (2025)

MedAgentBoard: Benchmarking Multi-Agent Collaboration with Conventional Methods for Diverse Medical Tasks
by: Zhu, Yinghao, et al.
Published: (2025)

ReMA: Learning to Meta-think for LLMs with Multi-Agent Reinforcement Learning
by: Wan, Ziyu, et al.
Published: (2025)