Cover Image

ITBench: Evaluating AI Agents across Diverse Real-World IT Automation Tasks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Jha, Saurabh, Arora, Rohan, Watanabe, Yuji, Yanagawa, Takumi, Chen, Yinfang, Clark, Jackson, Bhavya, Bhavya, Verma, Mudit, Kumar, Harshit, Kitahara, Hirokuni, Zheutlin, Noah, Takano, Saki, Pathak, Divya, George, Felix, Wu, Xinbo, Turkkan, Bekir O., Vanloo, Gerard, Nidd, Michael, Dai, Ting, Chatterjee, Oishik, Gupta, Pranjal, Samanta, Suranjana, Aggarwal, Pooja, Lee, Rong, Murali, Pavankumar, Ahn, Jae-wook, Kar, Debanjana, Rahane, Ameet, Fonseca, Carlos, Paradkar, Amit, Deng, Yu, Moogi, Pratibha, Mohapatra, Prateeti, Abe, Naoki, Narayanaswami, Chandrasekhar, Xu, Tianyin, Varshney, Lav R., Mahindru, Ruchi, Sailer, Anca, Shwartz, Laura, Sow, Daby, Fuller, Nicholas C. M., Puri, Ruchir
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Distributed, Parallel, and Cluster Computing Multiagent Systems
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal Workload Placement on Multi-Instance GPUs
by: Turkkan, Bekir, et al.
Published: (2024)

Think Locally, Explain Globally: Graph-Guided LLM Investigations via Local Reasoning and Belief Propagation
by: Jha, Saurabh, et al.
Published: (2026)

STRATUS: A Multi-agent System for Autonomous Reliability Engineering of Modern Clouds
by: Chen, Yinfang, et al.
Published: (2025)

ScriptSmith: A Unified LLM Framework for Enhancing IT Operations via Automated Bash Script Generation, Assessment, and Refinement
by: Chatterjee, Oishik, et al.
Published: (2024)

Retrieval Augmented Generation-Based Incident Resolution Recommendation System for IT Support
by: Isaza, Paulina Toro, et al.
Published: (2024)

A Context Engineering Framework for Improving Enterprise AI Agents based on Digital-Twin MDP
by: Yang, Xi, et al.
Published: (2026)

Evaluating India’s Engagement with the Universal Periodic Review: A Focus on Women’s Rights
by: Gupta, Bhavya
Published: (2024)

Chapter 5: Bacterial symbionts host association
by: Papudeshi, Bhavya
Published: (2025)

Book Review
by: Bhavya Jain
Published: (2024)

Identification of circular RNAs in resistant tomato genotype in response to ToLCBaV infection
by: C. Bhavya
Published: (2022)

Effect of auxins on shoot and root growth in an endangered medicinal plant guggal[Commiphora wightii (Arnott.)Bhand.]
by: Bhavya Bandi
Published: (2012)

Quantum de Sitter Entropy and Sphere Partition Functions: A-Hypergeometric Approach to Higher Loop Corrections
by: Bandaru, Bhavya
Published: (2024)

FinOps Agent -- A Use-Case for IT Infrastructure and Cost Optimization
by: Vo, Ngoc Phuoc An, et al.
Published: (2025)

ElectroVizQA: How well do Multi-modal LLMs perform in Electronics Visual Question Answering?
by: Meshram, Pragati Shuddhodhan, et al.
Published: (2024)

PEANUT: Perturbations by Eigenvector Alignment for Attacking Graph Neural Networks Under Topology-Driven Message Passing
by: Kohli, Bhavya, et al.
Published: (2026)

Scalable and Efficient Large-Scale Log Analysis with LLMs: An IT Software Support Case Study
by: Gupta, Pranjal, et al.
Published: (2025)

CodeSift: An LLM-Based Reference-Less Framework for Automatic Code Validation
by: Aggarwal, Pooja, et al.
Published: (2024)

Safe Exploration Using Bayesian World Models and Log-Barrier Optimization
by: As, Yarden, et al.
Published: (2024)

Impact of coronavirus disease 2019 pandemic on dental student's performance across disciplines during community site rotations: A comparative analysis
by: Anubhuti Shukla, et al.
Published: (2024)

A Review of Laws Governing Marital Separation in India: (In)visible Children?
by: Bhavya Jain, et al.
Published: (2025)

Spatially Resolved Kinematics of Post-starburst Galaxies
by: Pardasani, Bhavya, et al.
Published: (2024)

dc-SQUID potential sweep and viewer
by: Paradkar, Achintya
Published: (2026)

Statistical Inference for Linear Functionals of Online SGD in High-dimensional Linear Regression
by: Agrawalla, Bhavya, et al.
Published: (2023)

The André-Quillen cohomology of commutative monoids
by: Agrawalla, Bhavya, et al.
Published: (2022)

Provenance Verification of AI-Generated Images via a Perceptual Hash Registry Anchored on Blockchain
by: Mohit, Apoorv, et al.
Published: (2026)

Characterizing Ligands that have Immunomodulatory potential at the Choroid Plexus in Neurodegenerative Disease
by: Bhavya Bakshi, et al.
Published: (2024)

Masked Diffusion Models are Secretly Learned-Order Autoregressive Models
by: Garg, Prateek, et al.
Published: (2025)

Statistical Inference for Linear Functionals of Online Least-squares SGD when $t \gtrsim d^{1+δ}$
by: Agrawalla, Bhavya, et al.
Published: (2025)

Implicit Bias and Fast Convergence Rates for Self-attention
by: Vasudeva, Bhavya, et al.
Published: (2024)

What Does Flow Matching Bring To TD Learning?
by: Agrawalla, Bhavya, et al.
Published: (2026)

Mental load at the intersection of migration, motherhood and work
by: Priyanka Dwivedi, et al.
Published: (2024)

Entrepreneurial Back‐to‐Landers: How Neo‐Farmers in Turkey Choose Where to Settle
by: Candan Turkkan
Published: (2024)

Evaluation of Inflammatory Hematological Ratios (NLR, PLR, MLR and Monocyte/HDL-Cholesterol Ratio) in Obese Adolescents
by: Emine Türkkan
Published: (2022)

REELECCIONES INFINITAS: EL CASO DE LOS INTENDENTES DEL CONURBANO
by: Mariela Szwarcberg Daby
Published: (2016)

Representing Prompting Patterns with PDL: Compliance Agent Case Study
by: Vaziri, Mandana, et al.
Published: (2025)

Supporting Dynamic Agentic Workloads: How Data and Agents Interact
by: Giurgiu, Ioana, et al.
Published: (2025)

On the Query Complexity of Training Data Reconstruction in Private Learning
by: Mukherjee, Prateeti, et al.
Published: (2023)

Configuration Validation with Large Language Models
by: Lian, Xinyu, et al.
Published: (2023)

Smoothness of Function in Terms of Kernel and Its Relation With K ‐Derivative
by: Suranjana Deb
Published: (2025)

Machine Learning Interventions for Weed Detection using Multispectral Imagery and Unmanned Aerial Vehicles -- A Systematic Review
by: Goel, Drishti, et al.
Published: (2024)