Cover Image

A2Perf: Real-World Autonomous Agents Benchmark

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Uchendu, Ikechukwu, Jabbour, Jason, Berghe, Korneel Van den, Runevic, Joel, Stewart, Matthew, Ma, Jeffrey, Krishnan, Srivatsan, Gur, Izzeddin, Huang, Austin, Bishop, Colton, Bailey, Paige, Jiang, Wenjie, Songhori, Ebrahim M., Guadarrama, Sergio, Tan, Jie, Terry, Jordan K., Faust, Aleksandra, Reddi, Vijay Janapa
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

See it to Place it: Evolving Macro Placements with Vision-Language Models
by: Uchendu, Ikechukwu, et al.
Published: (2026)

Multi-Agent Reinforcement Learning for Sample-Efficient Deep Neural Network Mapping
by: Krishnan, Srivatsan, et al.
Published: (2025)

Generative AI Agents in Autonomous Machines: A Safety Perspective
by: Jabbour, Jason, et al.
Published: (2024)

Adaptive Surrogate Gradients for Sequential Reinforcement Learning in Spiking Neural Networks
by: Berghe, Korneel Van den, et al.
Published: (2025)

TinyTorch: Building Machine Learning Systems from First Principles
by: Reddi, Vijay Janapa
Published: (2026)

Exposing Limitations of Language Model Agents in Sequential-Task Compositions on the Web
by: Furuta, Hiroki, et al.
Published: (2023)

SwizzlePerf: Hardware-Aware LLMs for GPU Kernel Performance Optimization
by: Tschand, Arya, et al.
Published: (2025)

SocratiQ: A Generative AI-Powered Learning Companion for Personalized Education and Broader Accessibility
by: Jabbour, Jason, et al.
Published: (2025)

COSMIC: Enabling Full-Stack Co-Design and Optimization of Distributed Machine Learning Systems
by: Raju, Aditi, et al.
Published: (2025)

The Magnificent Seven Challenges and Opportunities in Domain-Specific Accelerator Design for Autonomous Systems
by: Neuman, Sabrina M., et al.
Published: (2024)

A Real-World WebAgent with Planning, Long Context Understanding, and Program Synthesis
by: Gur, Izzeddin, et al.
Published: (2023)

FedStaleWeight: Buffered Asynchronous Federated Learning with Fair Aggregation via Staleness Reweighting
by: Ma, Jeffrey, et al.
Published: (2024)

Modeling and Optimizing Performance Bottlenecks for Neuromorphic Accelerators
by: Yik, Jason, et al.
Published: (2025)

CLUTR: Curriculum Learning via Unsupervised Task Representation Learning
by: Azad, Abdus Salam, et al.
Published: (2022)

Multimodal Web Navigation with Instruction-Finetuned Foundation Models
by: Furuta, Hiroki, et al.
Published: (2023)

Geometric-Averaged Preference Optimization for Soft Preference Labels
by: Furuta, Hiroki, et al.
Published: (2024)

RobotPerf: An Open-Source, Vendor-Agnostic, Benchmarking Suite for Evaluating Robotics Computing System Performance
by: Mayoral-Vilches, Víctor, et al.
Published: (2023)

Tabula: Efficiently Computing Nonlinear Activation Functions for Secure Neural Network Inference
by: Lam, Maximilian, et al.
Published: (2022)

Don't Run with Scissors: Pruning Breaks VLA Models but They Can Be Recovered
by: Jabbour, Jason, et al.
Published: (2025)

Generative AI in Embodied Systems: System-Level Analysis of Performance, Efficiency and Scalability
by: Wan, Zishen, et al.
Published: (2025)

Inference-Aware Fine-Tuning for Best-of-N Sampling in Large Language Models
by: Chow, Yinlam, et al.
Published: (2024)

TinyML Security: Exploring Vulnerabilities in Resource-Constrained Machine Learning Systems
by: Huckelberry, Jacob, et al.
Published: (2024)

QuArch: A Question-Answering Dataset for AI Agents in Computer Architecture
by: Prakash, Shvetank, et al.
Published: (2025)

From Seed to Harvest: Augmenting Human Creativity with AI for Red-teaming Text-to-Image Models
by: Quaye, Jessica, et al.
Published: (2025)

Materiality and Risk in the Age of Pervasive AI Sensors
by: Sloane, Mona, et al.
Published: (2024)

Slm-mux: Orchestrating small language models for reasoning
by: Wang, Chenyu, et al.
Published: (2025)

DIA-HARM: Dialectal Disparities in Harmful Content Detection Across 50 English Dialects
by: Lucas, Jason, et al.
Published: (2026)

SWE-fficiency: Can Language Models Optimize Real-World Repositories on Real Workloads?
by: Ma, Jeffrey Jian, et al.
Published: (2025)

Evaluación microbiológica de aire y superficies en quirófano de un centro de salud público
by: Noja Izzeddin
Published: (2017)

Utilidad de la detección inmunocitoquímica de p16, en el diagnóstico diferencial de lesiones reactivas y neoplásicas en muestras de citología cervical.
by: Rula Izzeddin
Published: (2008)

The Relationship Between EFL Teachers' Self‐Efficacy and Effectiveness: The Mediating Role of Work Engagement
by: Mehdi Haseli Songhori, et al.
Published: (2025)

Efecto del control biológico por antagonistas sobre fitopatógenos en vegetales de consumo humano
by: Noja Izzeddin A
Published: (2011)

DIMENSIÓN ÉTICA EN LA PRÁCTICA ODONTOLÓGICA. VISIÓN PERSONALISTA
by: Roba Izzeddin Abou
Published: (2010)

Evaluación de bioaerosoles en ambientes de centros de salud de la ciudad de Valencia, Venezuela
by: Noja Izzeddin A.
Published: (2011)

Topological Data Analysis Applications in Natural Language Processing: A Survey
by: Uchendu, Adaku, et al.
Published: (2024)

Wake Vision: A Tailored Dataset and Benchmark Suite for TinyML Computer Vision Applications
by: Banbury, Colby, et al.
Published: (2024)

Machine Learning Fleet Efficiency: Analyzing and Optimizing Large-Scale Google TPU Systems with ML Productivity Goodput
by: Wongpanich, Arissa, et al.
Published: (2025)

Characterization of 12th–14th Century Ceramics From Northern Al Jazira Region (Southeastern Anatolia, Türkiye)
by: Murat Bayazit, et al.
Published: (2025)

Deep Learning Agents Trained For Avoidance Behave Like Hawks And Doves
by: Reddi, Aryaman
Published: (2025)

PerfDojo: Automated ML Library Generation for Heterogeneous Architectures
by: Ivanov, Andrei, et al.
Published: (2025)