Image de couverture de livre

IDA-Bench: Evaluating LLMs on Interactive Guided Data Analysis

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Hanyu, Liu, Haoyu, Zhu, Tingyu, Guo, Tianyu, Zheng, Zeyu, Deng, Xiaotie, Jordan, Michael I.
Format:	Preprint
Publié:	2025
Sujets:	Computation and Language Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

How Large Language Models Need Symbolism
par: Deng, Xiaotie, et autres
Publié: (2025)

Implementing Long Text Style Transfer with LLMs through Dual-Layered Sentence and Paragraph Structure Extraction and Mapping
par: Wu, Yusen, et autres
Publié: (2025)

Discovering Expert-Level Nash Equilibrium Algorithms with Large Language Models
par: Li, Hanyu, et autres
Publié: (2025)

How Social is It? A Benchmark for LLMs' Capabilities in Multi-user Multi-turn Social Agent Tasks
par: Wu, Yusen, et autres
Publié: (2025)

How Do LLMs Perform Two-Hop Reasoning in Context?
par: Guo, Tianyu, et autres
Publié: (2025)

AgentBench: Evaluating LLMs as Agents
par: Liu, Xiao, et autres
Publié: (2023)

An Information-Theoretic Criterion for Efficient Data Synthesis
par: Li, Hanyu, et autres
Publié: (2026)

Will AI Trade? A Computational Inversion of the No-Trade Theorem
par: Li, Hanyu, et autres
Publié: (2025)

TestAgent: Automatic Benchmarking and Exploratory Interaction for Evaluating LLMs in Vertical Domains
par: Wang, Wanying, et autres
Publié: (2024)

Reinforcement Learning for Chain of Thought Compression with One-Domain-to-All Generalization
par: Li, Hanyu, et autres
Publié: (2025)

POLIS-Bench: Towards Multi-Dimensional Evaluation of LLMs for Bilingual Policy Tasks in Governmental Scenarios
par: Yang, Tingyue, et autres
Publié: (2025)

MoralBench: Moral Evaluation of LLMs
par: Ji, Jianchao, et autres
Publié: (2024)

CCR-Bench: A Comprehensive Benchmark for Evaluating LLMs on Complex Constraints, Control Flows, and Real-World Cases
par: Xue, Xiaona, et autres
Publié: (2026)

AQA-Bench: An Interactive Benchmark for Evaluating LLMs' Sequential Reasoning Ability
par: Yang, Siwei, et autres
Publié: (2024)

VF-Eval: Evaluating Multimodal LLMs for Generating Feedback on AIGC Videos
par: Song, Tingyu, et autres
Publié: (2025)

DialogBench: Evaluating LLMs as Human-like Dialogue Systems
par: Ou, Jiao, et autres
Publié: (2023)

ProMoral-Bench: Evaluating Prompting Strategies for Moral Reasoning and Safety in LLMs
par: Thomas, Rohan Subramanian, et autres
Publié: (2026)

Evaluating and Enhancing LLMs Agent based on Theory of Mind in Guandan: A Multi-Player Cooperative Game under Imperfect Information
par: Yim, Yauwai, et autres
Publié: (2024)

MALLES: A Multi-agent LLMs-based Economic Sandbox with Consumer Preference Alignment
par: Wu, Yusen, et autres
Publié: (2026)

BizFinBench: A Business-Driven Real-World Financial Benchmark for Evaluating LLMs
par: Lu, Guilong, et autres
Publié: (2025)

HCAG: Hierarchical Abstraction and Retrieval-Augmented Generation on Theoretical Repositories with LLMs
par: Wu, Yusen, et autres
Publié: (2026)

Evaluating LLMs with Multiple Problems at once
par: Wang, Zhengxiang, et autres
Publié: (2024)

Magis-Bench: Evaluating LLMs on Magistrate-Level Legal Tasks
par: Pires, Ramon, et autres
Publié: (2026)

DentalBench: Benchmarking and Advancing LLMs Capability for Bilingual Dentistry Understanding
par: Zhu, Hengchuan, et autres
Publié: (2025)

Dual-Modality Multi-Stage Adversarial Safety Training: Robustifying Multimodal Web Agents Against Cross-Modal Attacks
par: Liu, Haoyu, et autres
Publié: (2026)

Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preference
par: Chiang, Wei-Lin, et autres
Publié: (2024)

MemBench: Towards More Comprehensive Evaluation on the Memory of LLM-based Agents
par: Tan, Haoran, et autres
Publié: (2025)

CodeScope: An Execution-based Multilingual Multitask Multidimensional Benchmark for Evaluating LLMs on Code Understanding and Generation
par: Yan, Weixiang, et autres
Publié: (2023)

SKA-Bench: A Fine-Grained Benchmark for Evaluating Structured Knowledge Understanding of LLMs
par: Liu, Zhiqiang, et autres
Publié: (2025)

Can LLMs Think Like Consumers? Benchmarking Crowd-Level Reaction Reconstruction with ConsumerSimBench
par: Wang, Tianyu, et autres
Publié: (2026)

ResearchCodeBench: Benchmarking LLMs on Implementing Novel Machine Learning Research Code
par: Hua, Tianyu, et autres
Publié: (2025)

CricBench: A Multilingual Benchmark for Evaluating LLMs in Cricket Analytics
par: Agarwal, Parth, et autres
Publié: (2025)

FB-Bench: A Fine-Grained Multi-Task Benchmark for Evaluating LLMs' Responsiveness to Human Feedback
par: Li, Youquan, et autres
Publié: (2024)

BabelBench: An Omni Benchmark for Code-Driven Analysis of Multimodal and Multistructured Data
par: Wang, Xuwu, et autres
Publié: (2024)

Iterative Data Smoothing: Mitigating Reward Overfitting and Overoptimization in RLHF
par: Zhu, Banghua, et autres
Publié: (2024)

CDTP: A Large-Scale Chinese Data-Text Pair Dataset for Comprehensive Evaluation of Chinese LLMs
par: Wu, Chengwei, et autres
Publié: (2025)

Sudoku-Bench: Evaluating creative reasoning with Sudoku variants
par: Seely, Jeffrey, et autres
Publié: (2025)

A Systematic Evaluation of Preference Aggregation in Federated RLHF for Pluralistic Alignment of LLMs
par: Srewa, Mahmoud, et autres
Publié: (2025)

Data Analysis and Performance Evaluation of Simulation Deduction Based on LLMs
par: Zhang, Shansi, et autres
Publié: (2025)

Does Tone Change the Answer? Evaluating Prompt Politeness Effects on Modern LLMs: GPT, Gemini, and LLaMA
par: Cai, Hanyu, et autres
Publié: (2025)