Cover Image

InsightEval: An Expert-Curated Benchmark for Assessing Insight Discovery in LLM-Driven Data Agents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zhu, Zhenghao, Song, Yuanfeng, Chen, Xin, Liu, Chengzhong, Cui, Yakun, Cao, Caleb Chen, Han, Sirui, Guo, Yike
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

MedInsightBench: Evaluating Medical Analytics Agents Through Multi-Step Insight Discovery in Multimodal Medical Data
by: Zhu, Zhenghao, et al.
Published: (2025)

Perception, Understanding and Reasoning, A Multimodal Benchmark for Video Fake News Detection
by: Yakun, Cui, et al.
Published: (2025)

When Text Hijacks Vision: Benchmarking and Mitigating Text Overlay-Induced Hallucination in Vision Language Models
by: Yakun, Cui, et al.
Published: (2026)

MMFCTUB: Multi-Modal Financial Credit Table Understanding Benchmark
by: Yakun, Cui, et al.
Published: (2026)

DataSage: Multi-agent Collaboration for Insight Discovery with External Knowledge Retrieval, Multi-role Debating, and Multi-path Reasoning
by: Liu, Xiaochuan, et al.
Published: (2025)

Reimagining Legal Fact Verification with GenAI: Toward Effective Human-AI Collaboration
by: Han, Sirui, et al.
Published: (2026)

Automate Strategy Finding with LLM in Quant Investment
by: Kou, Zhizhuo, et al.
Published: (2024)

LLM Agent Swarm for Hypothesis-Driven Drug Discovery
by: Song, Kevin, et al.
Published: (2025)

Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
by: Li, Lujun, et al.
Published: (2025)

DataGovBench: Benchmarking LLM Agents for Real-World Data Governance Workflows
by: Liu, Zhou, et al.
Published: (2025)

An Electrocardiogram Multi-task Benchmark with Comprehensive Evaluations and Insightful Findings
by: Xu, Yuhao, et al.
Published: (2025)

Benchmarking Multi-National Value Alignment for Large Language Models
by: Shi, Weijie, et al.
Published: (2025)

From AI Assistant to AI Scientist: Autonomous Discovery of LLM-RL Algorithms with LLM Agents
by: Xia, Sirui, et al.
Published: (2026)

HKGAI-V1: Towards Regional Sovereign Large Language Model for Hong Kong
by: Han, Sirui, et al.
Published: (2025)

TravelEval: A Comprehensive Benchmarking Framework for Evaluating LLM-Powered Travel Planning Agents
by: Chen, Weiyi, et al.
Published: (2026)

Measuring Hong Kong Massive Multi-Task Language Understanding
by: Cao, Chuxue, et al.
Published: (2025)

Towards Advanced Mathematical Reasoning for LLMs via First-Order Logic Theorem Proving
by: Cao, Chuxue, et al.
Published: (2025)

SafeLawBench: Towards Safe Alignment of Large Language Models
by: Cao, Chuxue, et al.
Published: (2025)

LLM Unlearning Without an Expert Curated Dataset
by: Zhu, Xiaoyuan, et al.
Published: (2025)

Assessing Allele Frequency Information: A Study of Variant Curation Expert Panel Guidelines
by: Xiaoyan Wang, et al.
Published: (2026)

Dual Tuning for Reasoning Efficacy-Driven Data Curation in Multimodal LLM Training
by: Zheng, Ruobing, et al.
Published: (2026)

Towards Autonomous Business Intelligence via Data-to-Insight Discovery Agent
by: Wu, Dongming, et al.
Published: (2026)

ExpertQA: Expert-Curated Questions and Attributed Answers
by: Malaviya, Chaitanya, et al.
Published: (2023)

FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluation
by: Luo, Junyu, et al.
Published: (2025)

AcademicEval: Live Long-Context LLM Benchmark
by: Zhang, Haozhen, et al.
Published: (2025)

LLM-Driven Security Analysis for Cellular Networks: Vulnerability Discovery Agent and Benchmarking
by: Xie, Tian
Published: (2026)

Insight Agents: An LLM-Based Multi-Agent System for Data Insights
by: Bai, Jincheng, et al.
Published: (2026)

Interpretable AI-Driven Discovery of Terrain-Precipitation Relationships for Enhanced Climate Insights
by: Xu, Hao, et al.
Published: (2023)

AntEval: Evaluation of Social Interaction Competencies in LLM-Driven Agents
by: Liang, Yuanzhi, et al.
Published: (2024)

RW-TTT: Batched Serving for Request-Owned Test-Time Training State
by: Yang, Jian, et al.
Published: (2026)

Benchmarking Physics-Informed Time-Series Models for Operational Global Station Weather Forecasting
by: Han, Tao, et al.
Published: (2024)

Automatic Expert Discovery in LLM Upcycling via Sparse Interpolated Mixture-of-Experts
by: Chen, Shengzhuang, et al.
Published: (2025)

Optimizing Sequencing Coverage Depth in DNA Storage: Insights From DNA Storage Data
by: Cao, Ruiying, et al.
Published: (2025)

HarmMetric Eval: Benchmarking Metrics and Judges for LLM Harmfulness Assessment
by: Yang, Langqi, et al.
Published: (2025)

CoopEval: Benchmarking Cooperation-Sustaining Mechanisms and LLM Agents in Social Dilemmas
by: Tewolde, Emanuel, et al.
Published: (2026)

EconEvals: Benchmarks and Litmus Tests for Economic Decision-Making by LLM Agents
by: Fish, Sara, et al.
Published: (2025)

Revolutionizing Bridge Operation and Maintenance with LLM-based Agents: An Overview of Applications and Insights
by: Chen, Xinyu, et al.
Published: (2024)

Beyond SELECT: A Comprehensive Taxonomy-Guided Benchmark for Real-World Text-to-SQL Translation
by: Wang, Hao, et al.
Published: (2025)

Expert-Guided LLM Reasoning for Battery Discovery: From AI-Driven Hypothesis to Synthesis and Characterization
by: Liu, Shengchao, et al.
Published: (2025)

TCM-Eval: An Expert-Level Dynamic and Extensible Benchmark for Traditional Chinese Medicine
by: Cheng, Zihao, et al.
Published: (2025)