REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | Garg, Divyansh, VanWeelden, Shaun, Caples, Diego, Draguns, Andis, Ravi, Nikil, Putta, Pranav, Garg, Naman, Abraham, Tomas, Lara, Michael, Lopez, Federico, Liu, James, Gundawar, Atharva, Hebbar, Prannay, Joo, Youngchul, Gu, Jindong, London, Charles, de Witt, Christian Schroeder, Motwani, Sumeet |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
par: Putta, Pranav, et autres
Publié: (2024)
par: Putta, Pranav, et autres
Publié: (2024)
Unelicitable Backdoors in Language Models via Cryptographic Transformer Circuits
par: Draguns, Andis, et autres
Publié: (2024)
par: Draguns, Andis, et autres
Publié: (2024)
Mitigating the Influence of Distractor Tasks in LMs with Prior-Aware Decoding
par: Douglas, Raymond, et autres
Publié: (2024)
par: Douglas, Raymond, et autres
Publié: (2024)
Limitations of Agents Simulated by Predictive Models
par: Douglas, Raymond, et autres
Publié: (2024)
par: Douglas, Raymond, et autres
Publié: (2024)
h1: Bootstrapping LLMs to Reason over Longer Horizons via Reinforcement Learning
par: Motwani, Sumeet Ramesh, et autres
Publié: (2025)
par: Motwani, Sumeet Ramesh, et autres
Publié: (2025)
Superior Computer Chess with Model Predictive Control, Reinforcement Learning, and Rollout
par: Gundawar, Atharva, et autres
Publié: (2024)
par: Gundawar, Atharva, et autres
Publié: (2024)
PAC Bench: Do Foundation Models Understand Prerequisites for Executing Manipulation Policies?
par: Gundawar, Atharva, et autres
Publié: (2025)
par: Gundawar, Atharva, et autres
Publié: (2025)
Robust Planning with Compound LLM Architectures: An LLM-Modulo Approach
par: Gundawar, Atharva, et autres
Publié: (2024)
par: Gundawar, Atharva, et autres
Publié: (2024)
Planning in Strawberry Fields: Evaluating and Improving the Planning and Scheduling Capabilities of LRM o1
par: Valmeekam, Karthik, et autres
Publié: (2024)
par: Valmeekam, Karthik, et autres
Publié: (2024)
Secret Collusion among AI Agents: Multi-Agent Deception via Steganography
par: Motwani, Sumeet Ramesh, et autres
Publié: (2024)
par: Motwani, Sumeet Ramesh, et autres
Publié: (2024)
Time series forecasting with high stakes: A field study of the air cargo industry
par: Garg, Abhinav, et autres
Publié: (2024)
par: Garg, Abhinav, et autres
Publié: (2024)
An effect of abrupt current disruption
par: Dembovskis, Andis
Publié: (2011)
par: Dembovskis, Andis
Publié: (2011)
Beyond Semantics: The Unreasonable Effectiveness of Reasonless Intermediate Tokens
par: Valmeekam, Karthik, et autres
Publié: (2025)
par: Valmeekam, Karthik, et autres
Publié: (2025)
SIA: Self Improving AI with Harness & Weight Updates
par: Hebbar, Prannay, et autres
Publié: (2026)
par: Hebbar, Prannay, et autres
Publié: (2026)
RL on Incorrect Synthetic Data Scales the Efficiency of LLM Math Reasoning by Eight-Fold
par: Setlur, Amrith, et autres
Publié: (2024)
par: Setlur, Amrith, et autres
Publié: (2024)
Measurement of strange baryon production in charged-particle jets in pp and p-Pb collisions with ALICE
par: van Weelden, Gijs
Publié: (2024)
par: van Weelden, Gijs
Publié: (2024)
Mirage: Unveiling Hidden Artifacts in Synthetic Images with Large Vision-Language Models
par: Sharma, Pranav, et autres
Publié: (2025)
par: Sharma, Pranav, et autres
Publié: (2025)
Recursive Introspection: Teaching Language Model Agents How to Self-Improve
par: Qu, Yuxiao, et autres
Publié: (2024)
par: Qu, Yuxiao, et autres
Publié: (2024)
Robust Planning with LLM-Modulo Framework: Case Study in Travel Planning
par: Gundawar, Atharva, et autres
Publié: (2024)
par: Gundawar, Atharva, et autres
Publié: (2024)
MALT: Improving Reasoning with Multi-Agent LLM Training
par: Motwani, Sumeet Ramesh, et autres
Publié: (2024)
par: Motwani, Sumeet Ramesh, et autres
Publié: (2024)
Open Challenges in Multi-Agent Security: Towards Secure Systems of Interacting AI Agents
par: de Witt, Christian Schroeder, et autres
Publié: (2025)
par: de Witt, Christian Schroeder, et autres
Publié: (2025)
Density results of biharmonic functions on symmetric tensor fields and their applications to inverse problems
par: Agrawal, Divyansh, et autres
Publié: (2025)
par: Agrawal, Divyansh, et autres
Publié: (2025)
GPoS: Geospatially-aware Proof of Stake
par: Motepalli, Shashank, et autres
Publié: (2025)
par: Motepalli, Shashank, et autres
Publié: (2025)
Supplementary data for "More frequent warm and dry spells along persistent cold and wet spells in the Baltics"
par: Kalvāns, Andis, et autres
Publié: (2025)
par: Kalvāns, Andis, et autres
Publié: (2025)
ROER: Regularized Optimal Experience Replay
par: Li, Changling, et autres
Publié: (2024)
par: Li, Changling, et autres
Publié: (2024)
Riesz transforms associated with the twisted Laplacian with drift
par: Garg, Nishta, et autres
Publié: (2024)
par: Garg, Nishta, et autres
Publié: (2024)
Riesz transforms associated with the Grushin operator with drift
par: Garg, Nishta, et autres
Publié: (2026)
par: Garg, Nishta, et autres
Publié: (2026)
Textual Gradients are a Flawed Metaphor for Automatic Prompt Optimization
par: Melcer, Daniel, et autres
Publié: (2025)
par: Melcer, Daniel, et autres
Publié: (2025)
QueST: Self-Supervised Skill Abstractions for Learning Continuous Control
par: Mete, Atharva, et autres
Publié: (2024)
par: Mete, Atharva, et autres
Publié: (2024)
Computing Least Fixed Points with Overwrite Semantics in Parallel and Distributed Systems
par: Garg, Vijay K., et autres
Publié: (2026)
par: Garg, Vijay K., et autres
Publié: (2026)
The Percept-V Challenge: Can Multimodal LLMs Crack Simple Perception Problems?
par: Ghosh, Samrajnee, et autres
Publié: (2025)
par: Ghosh, Samrajnee, et autres
Publié: (2025)
Extending the Determinants of Tax Efforts Through Digitalization and Gender Parity: Empirical Insights From G‐20 Nations
par: Shubham Garg, et autres
Publié: (2026)
par: Shubham Garg, et autres
Publié: (2026)
HorizonMath: Measuring AI Progress Toward Mathematical Discovery with Automatic Verification
par: Wang, Erik Y., et autres
Publié: (2026)
par: Wang, Erik Y., et autres
Publié: (2026)
Application of Data Virtualization
par: Siddhant Garg
Publié: (2021)
par: Siddhant Garg
Publié: (2021)
Equivalence of Finite- and Fixed-time Stability to Asymptotic Stability
par: Garg, Kunal
Publié: (2026)
par: Garg, Kunal
Publié: (2026)
Parameter and Data-Efficient Spectral StyleDCGAN
par: Garg, Aryan
Publié: (2024)
par: Garg, Aryan
Publié: (2024)
On Bob Dylan: A Computational Perspective
par: Garg, Prashant
Publié: (2025)
par: Garg, Prashant
Publié: (2025)
The Road of Adaptive AI for Precision in Cybersecurity
par: Garg, Sahil
Publié: (2025)
par: Garg, Sahil
Publié: (2025)
Heterogeneous participation and allocation skews: when is choice "worth it"?
par: Garg, Nikhil
Publié: (2025)
par: Garg, Nikhil
Publié: (2025)
Exploring Long-Range Interactions in the Atmospheric Neutrino Oscillations at IceCube DeepCore
par: Garg, Gopal
Publié: (2026)
par: Garg, Gopal
Publié: (2026)
Documents similaires
-
Agent Q: Advanced Reasoning and Learning for Autonomous AI Agents
par: Putta, Pranav, et autres
Publié: (2024) -
Unelicitable Backdoors in Language Models via Cryptographic Transformer Circuits
par: Draguns, Andis, et autres
Publié: (2024) -
Mitigating the Influence of Distractor Tasks in LMs with Prior-Aware Decoding
par: Douglas, Raymond, et autres
Publié: (2024) -
Limitations of Agents Simulated by Predictive Models
par: Douglas, Raymond, et autres
Publié: (2024) -
h1: Bootstrapping LLMs to Reason over Longer Horizons via Reinforcement Learning
par: Motwani, Sumeet Ramesh, et autres
Publié: (2025)