Imagen de Portada

FML-bench: Benchmarking Machine Learning Agents for Scientific Research

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zou, Qiran, Lam, Hou Hei, Zhao, Wenhao, Tang, Yiming, Chen, Tingting, Yu, Samson, Zhang, Tianyi, Liu, Chang, Ji, Xiangyang, Liu, Dianbo
Formato:	Preprint
Publicado:	2025
Materias:	Computation and Language Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

FML-bench: A Controlled Study of AI Research Agent Strategies from the Perspective of Search Dynamics
por: Zou, Qiran, et al.
Publicado: (2026)

Representation Collapsing Problems in Vector Quantization
por: Zhao, Wenhao, et al.
Publicado: (2024)

Mitigating Premature Discretization with Progressive Quantization for Robust Vector Tokenization
por: Zhao, Wenhao, et al.
Publicado: (2026)

Early Quantization Shrinks Codebook: A Simple Fix for Diversity-Preserving Tokenization
por: Zhao, Wenhao, et al.
Publicado: (2026)

HypoSpace: A Diagnostic Benchmark for Set-Valued Hypothesis Generation under Underdetermination and Sublinear Coverage Bounds
por: Chen, Tingting, et al.
Publicado: (2025)

Auto-Discovery-Bench: Diagnosing Structured State Tracking in Oracle-Guided Discovery
por: Chen, Tingting, et al.
Publicado: (2025)

ParCo: Part-Coordinating Text-to-Motion Synthesis
por: Zou, Qiran, et al.
Publicado: (2024)

How does My Model Fail? Automatic Identification and Interpretation of Physical Plausibility Failure Modes with Matryoshka Transcoders
por: Tang, Yiming, et al.
Publicado: (2025)

Bridging Mechanistic Interpretability and Prompt Engineering with Gradient Ascent for Interpretable Persona Control
por: Saini, Harshvardhan, et al.
Publicado: (2026)

Deconstructing Generative Diversity: An Information Bottleneck Analysis of Discrete Latent Generative Models
por: Wu, Yudi, et al.
Publicado: (2025)

Uncertainty-Based Extensible Codebook for Discrete Federated Learning in Heterogeneous Data Silos
por: Zhang, Tianyi, et al.
Publicado: (2024)

MLE-bench: Evaluating Machine Learning Agents on Machine Learning Engineering
por: Chan, Jun Shern, et al.
Publicado: (2024)

CXR-LanIC: Language-Grounded Interpretable Classifier for Chest X-Ray Diagnosis
por: Tang, Yiming, et al.
Publicado: (2025)

When Language Overwrites Vision: Over-Alignment and Geometric Debiasing in Vision-Language Models
por: Saini, Harshvardhan, et al.
Publicado: (2026)

AI Research Agents for Machine Learning: Search, Exploration, and Generalization in MLE-bench
por: Toledo, Edan, et al.
Publicado: (2025)

OpFML: Pipeline for ML-based Operational Forecasting
por: Alvi, Shahbaz, et al.
Publicado: (2026)

SOLAR: A Self-Optimizing Open-Ended Autonomous Agent for Lifelong Learning and Continual Adaptation
por: Vetcha, Nitin, et al.
Publicado: (2026)

BarlowTwins-CXR : Enhancing Chest X-Ray abnormality localization in heterogeneous data with cross-domain self-supervised learning
por: Sheng, Haoyue, et al.
Publicado: (2024)

Human-like Content Analysis for Generative AI with Language-Grounded Sparse Encoders
por: Tang, Yiming, et al.
Publicado: (2025)

STORI: A Benchmark and Taxonomy for Stochastic Environments
por: Barsainyan, Aryan Amit, et al.
Publicado: (2025)

Multi-SWE-bench: A Multilingual Benchmark for Issue Resolving
por: Zan, Daoguang, et al.
Publicado: (2025)

CL-bench: A Benchmark for Context Learning
por: Dou, Shihan, et al.
Publicado: (2026)

FairFML: Fair Federated Machine Learning with a Case Study on Reducing Gender Disparities in Cardiac Arrest Outcome Prediction
por: Li, Siqi, et al.
Publicado: (2024)

PMFL: Partial Meta-Federated Learning for heterogeneous tasks and its applications on real-world medical records
por: Zhang, Tianyi, et al.
Publicado: (2021)

LOCA-bench: Benchmarking Language Agents Under Controllable and Extreme Context Growth
por: Zeng, Weihao, et al.
Publicado: (2026)

AutoResearchBench: Benchmarking AI Agents on Complex Scientific Literature Discovery
por: Xiong, Lei, et al.
Publicado: (2026)

Data-Dependent Smoothing for Protein Discovery with Walk-Jump Sampling
por: Anumasa, Srinivas, et al.
Publicado: (2025)

EventBench: Towards Comprehensive Benchmarking of Event-based MLLMs
por: Liu, Shaoyu, et al.
Publicado: (2025)

Effect of Foam Filling and Holes on In‐Plane Compressive Failure Behavior of FML Face Sheet Grid Sandwich Structures
por: Fengling Zhao, et al.
Publicado: (2026)

$τ$-bench: A Benchmark for Tool-Agent-User Interaction in Real-World Domains
por: Yao, Shunyu, et al.
Publicado: (2024)

SEC-bench: Automated Benchmarking of LLM Agents on Real-World Software Security Tasks
por: Lee, Hwiwon, et al.
Publicado: (2025)

CodeUnlearn: Amortized Zero-Shot Machine Unlearning in Language Models Using Discrete Concept
por: Wu, YuXuan, et al.
Publicado: (2024)

Rep2Text: Decoding Full Text from a Single LLM Token Representation
por: Zhao, Haiyan, et al.
Publicado: (2025)

SWE-bench-java: A GitHub Issue Resolving Benchmark for Java
por: Zan, Daoguang, et al.
Publicado: (2024)

TimeMachine-bench: A Benchmark for Evaluating Model Capabilities in Repository-Level Migration Tasks
por: Fujii, Ryo, et al.
Publicado: (2026)

AI Research Agents Narrow Scientific Exploration
por: Tang, Yixuan, et al.
Publicado: (2026)

Physical Reasoning and Object Planning for Household Embodied Agents
por: Agrawal, Ayush, et al.
Publicado: (2023)

AInsteinBench: Benchmarking Coding Agents on Scientific Repositories
por: Duston, Titouan, et al.
Publicado: (2025)

Enhance Eye Disease Detection using Learnable Probabilistic Discrete Latents in Machine Learning Architectures
por: Prabhakaran, Anirudh, et al.
Publicado: (2024)

SciVisAgentBench: A Benchmark for Evaluating Scientific Data Analysis and Visualization Agents
por: Ai, Kuangshi, et al.
Publicado: (2026)