Imagen de Portada

DSGym: A Holistic Framework for Evaluating and Training Data Science Agents

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Nie, Fan, Wang, Junlin, Hua, Harper, Bianchi, Federico, Kwon, Yongchan, Qi, Zhenting, Queen, Owen, Zhu, Shang, Zou, James
Formato:	Preprint
Publicado:	2026
Materias:	Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Automated Benchmark Auditing for AI Agents and Large Language Models
por: Wang, Junlin, et al.
Publicado: (2026)

ReasonIF: Large Reasoning Models Fail to Follow Instructions During Reasoning
por: Kwon, Yongchan, et al.
Publicado: (2025)

Exploring the use of AI authors and reviewers at Agents4Science
por: Bianchi, Federico, et al.
Publicado: (2025)

What LLMs Think When You Don't Tell Them What to Think About?
por: Kwon, Yongchan, et al.
Publicado: (2026)

To Err Is Human: Systematic Quantification of Errors in Published AI Papers via LLM Analysis
por: Bianchi, Federico, et al.
Publicado: (2025)

Voice "Cloning" is Style Transfer
por: Zhou, Kaitlyn, et al.
Publicado: (2026)

DataInf: Efficiently Estimating Data Influence in LoRA-tuned LLMs and Diffusion Models
por: Kwon, Yongchan, et al.
Publicado: (2023)

Rethinking Data Shapley for Data Selection Tasks: Misleads and Merits
por: Wang, Jiachen T., et al.
Publicado: (2024)

2D-OOB: Attributing Data Contribution Through Joint Valuation Framework
por: Sun, Yifan, et al.
Publicado: (2024)

ReasonOps: Operator Segmentation for LLM Reasoning Traces
por: Lee, Daniel, et al.
Publicado: (2026)

Proper Dataset Valuation by Pointwise Mutual Information
por: Zheng, Shuran, et al.
Publicado: (2024)

CGBench: Benchmarking Language Model Scientific Reasoning for Clinical Genetics Research
por: Queen, Owen, et al.
Publicado: (2025)

Distributionally Robust Instrumental Variables Estimation
por: Qu, Zhaonan, et al.
Publicado: (2024)

EvoLM: In Search of Lost Language Model Training Dynamics
por: Qi, Zhenting, et al.
Publicado: (2025)

Certified Data Removal Under High-dimensional Settings
por: Zou, Haolin, et al.
Publicado: (2025)

Large Language Models are Vulnerable to Bait-and-Switch Attacks for Generating Harmful Content
por: Bianchi, Federico, et al.
Publicado: (2024)

TimeInf: Time Series Data Contribution via Influence Functions
por: Zhang, Yizi, et al.
Publicado: (2024)

Group Shapley Value and Counterfactual Simulations in a Structural Model
por: Kwon, Yongchan, et al.
Publicado: (2024)

Newfluence: Boosting Model interpretability and Understanding in High Dimensions
por: Zou, Haolin, et al.
Publicado: (2025)

Understanding Impact of Human Feedback via Influence Functions
por: Min, Taywon, et al.
Publicado: (2025)

When Does Divide and Conquer Work for Long Context LLM? A Noise Decomposition Framework
por: Xu, Zhen, et al.
Publicado: (2025)

ContextualLVLM-Agent: A Holistic Framework for Multi-Turn Visually-Grounded Dialogue and Complex Instruction Following
por: Han, Seungmin, et al.
Publicado: (2025)

A Business Education Program for Training Library Technicians.
por: McQueen, Harriett
Publicado: (1981)

Weak-for-Strong: Training Weak Meta-Agent to Harness Strong Executors
por: Nie, Fan, et al.
Publicado: (2025)

Holistic Agent Leaderboard: The Missing Infrastructure for AI Agent Evaluation
por: Kapoor, Sayash, et al.
Publicado: (2025)

Holistic Evaluation and Failure Diagnosis of AI Agents
por: Madvil, Netta, et al.
Publicado: (2026)

TapeAgents: a Holistic Framework for Agent Development and Optimization
por: Bahdanau, Dzmitry, et al.
Publicado: (2024)

Mixture-of-Agents Enhances Large Language Model Capabilities
por: Wang, Junlin, et al.
Publicado: (2024)

AIOpsLab: A Holistic Framework to Evaluate AI Agents for Enabling Autonomous Clouds
por: Chen, Yinfang, et al.
Publicado: (2025)

EcomBench: Towards Holistic Evaluation of Foundation Agents in E-commerce
por: Min, Rui, et al.
Publicado: (2025)

AutoGenesisAgent: Self-Generating Multi-Agent Systems for Complex Tasks
por: Harper, Jeremy
Publicado: (2024)

"Sorry, I Didn't Catch That": How Speech Models Miss What Matters Most
por: Zhou, Kaitlyn, et al.
Publicado: (2026)

ADO: Automatic Data Optimization for Inputs in LLM Prompts
por: Lin, Sam, et al.
Publicado: (2025)

Temperature dependence of energy transport in the $\mathbb{Z}_3$ chiral clock model
por: Yoo, Yongchan, et al.
Publicado: (2023)

Data Agent: A Holistic Architecture for Orchestrating Data+AI Ecosystems
por: Sun, Zhaoyan, et al.
Publicado: (2025)

SecureWebArena: A Holistic Security Evaluation Benchmark for LVLM-based Web Agents
por: Ying, Zonghao, et al.
Publicado: (2025)

Evaluating A/B Testing Methodologies via Sample Splitting: Theory and Practice
por: Kessler, Ryan, et al.
Publicado: (2025)

Toward Emergent Holism: A Mutually Constitutive Account for Systems Science and Holistic Philosophy
por: Qiang Fu, et al.
Publicado: (2026)

Tracing the Roots: A Multi-Agent Framework for Uncovering Data Lineage in Post-Training LLMs
por: Li, Yu, et al.
Publicado: (2026)

An LLM-Powered AI Agent Framework for Holistic IoT Traffic Interpretation
por: Worae, Daniel Adu, et al.
Publicado: (2025)