Image de couverture de livre

CRMArena-Pro: Holistic Assessment of LLM Agents Across Diverse Business Scenarios and Interactions

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Huang, Kung-Hsiang, Prabhakar, Akshara, Thorat, Onkar, Agarwal, Divyansh, Choubey, Prafulla Kumar, Mao, Yixin, Savarese, Silvio, Xiong, Caiming, Wu, Chien-Sheng
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environments
par: Huang, Kung-Hsiang, et autres
Publié: (2024)

Agentic Uncertainty Quantification
par: Zhang, Jiaxin, et autres
Publié: (2026)

Benchmarking Deep Search over Heterogeneous Enterprise Data
par: Choubey, Prafulla Kumar, et autres
Publié: (2025)

Embrace Divergence for Richer Insights: A Multi-document Summarization Benchmark and a Case Study on Summarizing Diverse Information from News Articles
par: Huang, Kung-Hsiang, et autres
Publié: (2023)

Unanswerability Evaluation for Retrieval Augmented Generation
par: Peng, Xiangyu, et autres
Publié: (2024)

Do RAG Systems Cover What Matters? Evaluating and Optimizing Responses with Sub-Question Coverage
par: Xie, Kaige, et autres
Publié: (2024)

Shared Imagination: LLMs Hallucinate Alike
par: Zhou, Yilun, et autres
Publié: (2024)

Enterprise Deep Research: Steerable Multi-Agent Deep Research for Enterprise Analytics
par: Prabhakar, Akshara, et autres
Publié: (2025)

Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agents
par: Choubey, Prafulla Kumar, et autres
Publié: (2025)

SummExecEdit: A Factual Consistency Benchmark in Summarization with Executable Edits
par: Thorat, Onkar, et autres
Publié: (2024)

GTA: Generating Long-Horizon Tasks for Web Agents at Scale
par: Huang, Tenghao, et autres
Publié: (2026)

Test-Time Adaptation for LLM Agents via Environment Interaction
par: Chen, Arthur, et autres
Publié: (2025)

GUI-KV: Efficient GUI Agents via KV Cache with Spatio-Temporal Awareness
par: Huang, Kung-Hsiang, et autres
Publié: (2025)

DeepTRACE: Auditing Deep Research AI Systems for Tracking Reliability Across Citations and Evidence
par: Venkit, Pranav Narayanan, et autres
Publié: (2025)

Dont Stop Early: Scalable Enterprise Deep Research with Controlled Information Flow and Evidence-Aware Termination
par: Choubey, Prafulla Kumar, et autres
Publié: (2026)

Nudging the Boundaries of LLM Reasoning
par: Chen, Justin Chih-Yao, et autres
Publié: (2025)

SiReRAG: Indexing Similar and Related Information for Multihop Reasoning
par: Zhang, Nan, et autres
Publié: (2024)

BingoGuard: LLM Content Moderation Tools with Risk Levels
par: Yin, Fan, et autres
Publié: (2025)

Enabling High Data Throughput Reinforcement Learning on GPUs: A Domain Agnostic Framework for Data-Driven Scientific Research
par: Lan, Tian, et autres
Publié: (2024)

Evaluating Cultural and Social Awareness of LLM Web Agents
par: Qiu, Haoyi, et autres
Publié: (2024)

Language Models are Hidden Reasoners: Unlocking Latent Reasoning Capabilities via Self-Rewarding
par: Chen, Haolin, et autres
Publié: (2024)

Why Vision Language Models Struggle with Visual Arithmetic? Towards Enhanced Chart and Geometry Understanding
par: Huang, Kung-Hsiang, et autres
Publié: (2025)

UserBench: An Interactive Gym Environment for User-Centric Agents
par: Qian, Cheng, et autres
Publié: (2025)

AgentLite: A Lightweight Library for Building and Advancing Task-Oriented LLM Agent System
par: Liu, Zhiwei, et autres
Publié: (2024)

Reasoning Curriculum: Bootstrapping Broad LLM Reasoning from Math
par: Pang, Bo, et autres
Publié: (2025)

INDICT: Code Generation with Internal Dialogues of Critiques for Both Security and Helpfulness
par: Le, Hung, et autres
Publié: (2024)

UserRL: Training Interactive User-Centric Agent via Reinforcement Learning
par: Qian, Cheng, et autres
Publié: (2025)

xRouter: Training Cost-Aware LLMs Orchestration System via Reinforcement Learning
par: Qian, Cheng, et autres
Publié: (2025)

Agentic Confidence Calibration
par: Zhang, Jiaxin, et autres
Publié: (2026)

Scaling Knowledge Graph Construction through Synthetic Data Generation and Distillation
par: Choubey, Prafulla Kumar, et autres
Publié: (2024)

DyMU: Dynamic Merging and Virtual Unmerging for Efficient VLMs
par: Wang, Zhenhailong, et autres
Publié: (2025)

BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation
par: Pang, Bo, et autres
Publié: (2025)

Unified Training of Universal Time Series Forecasting Transformers
par: Woo, Gerald, et autres
Publié: (2024)

CodeTree: Agent-guided Tree Search for Code Generation with Large Language Models
par: Li, Jierui, et autres
Publié: (2024)

Hölder regularity of solutions of the steady Boltzmann equation with soft potentials
par: Wu, Kung-Chien, et autres
Publié: (2024)

Whisper-AuT: Domain-Adapted Audio Encoder for Efficient Audio-LLM Training
par: Qiu, Jielin, et autres
Publié: (2026)

Enterprise Sales Copilot: Enabling Real-Time AI Support with Automatic Information Retrieval in Live Sales Calls
par: Qiu, Jielin, et autres
Publié: (2026)

Building Enterprise Realtime Voice Agents from Scratch: A Technical Tutorial
par: Qiu, Jielin, et autres
Publié: (2026)

LAM SIMULATOR: Advancing Data Generation for Large Action Model Training via Online Exploration and Trajectory Feedback
par: Hoang, Thai, et autres
Publié: (2025)

PerfCodeGen: Improving Performance of LLM Generated Code with Execution Feedback
par: Peng, Yun, et autres
Publié: (2024)