Cover Image

BioDSA-1K: Benchmarking Data Science Agents for Biomedical Research

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Wang, Zifeng, Danek, Benjamin, Sun, Jimeng
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Computation and Language
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Can Large Language Models Replace Data Scientists in Biomedical Research?
by: Wang, Zifeng, et al.
Published: (2024)

A Perspective for Adapting Generalist AI to Specialized Medical AI Applications and Their Challenges
by: Wang, Zifeng, et al.
Published: (2024)

BioKGBench: A Knowledge Graph Checking Benchmark of AI Agent for Biomedical Science
by: Lin, Xinna, et al.
Published: (2024)

MindMap: Knowledge Graph Prompting Sparks Graph of Thoughts in Large Language Models
by: Wen, Yilin, et al.
Published: (2023)

s3: You Don't Need That Much Data to Train a Search Agent via RL
by: Jiang, Pengcheng, et al.
Published: (2025)

Panacea: A foundation model for clinical trial search, summarization, design, and recruitment
by: Lin, Jiacheng, et al.
Published: (2024)

GenRES: Rethinking Evaluation for Generative Relation Extraction in the Era of Large Language Models
by: Jiang, Pengcheng, et al.
Published: (2024)

Benchmarking Data Science Agents
by: Zhang, Yuge, et al.
Published: (2024)

Accelerating Clinical Evidence Synthesis with Large Language Models
by: Wang, Zifeng, et al.
Published: (2024)

MedAgentGym: A Scalable Agentic Training Environment for Code-Centric Reasoning in Biomedical Data Science
by: Xu, Ran, et al.
Published: (2025)

InformGen: An AI Copilot for Accurate and Compliant Clinical Research Consent Document Generation
by: Wang, Zifeng, et al.
Published: (2025)

TTM-RE: Memory-Augmented Document-Level Relation Extraction
by: Gao, Chufan, et al.
Published: (2024)

STELLA: Self-Evolving LLM Agent for Biomedical Research
by: Jin, Ruofan, et al.
Published: (2025)

DataSciBench: An LLM Agent Benchmark for Data Science
by: Zhang, Dan, et al.
Published: (2025)

$\texttt{AMEND++}$: Benchmarking Eligibility Criteria Amendments in Clinical Trials
by: Das, Trisha, et al.
Published: (2026)

AutoRD: An Automatic and End-to-End System for Rare Disease Knowledge Graph Construction Based on Ontologies-enhanced Large Language Models
by: Cao, Lang, et al.
Published: (2024)

Beyond Label Attention: Transparency in Language Models for Automated Medical Coding via Dictionary Learning
by: Wu, John, et al.
Published: (2024)

Contextualized Sequence Likelihood: Enhanced Confidence Scores for Natural Language Generation
by: Lin, Zhen, et al.
Published: (2024)

DSAEval: Evaluating Data Science Agents on a Wide Range of Real-World Data Science Problems
by: Sun, Maojun, et al.
Published: (2026)

DA-Code: Agent Data Science Code Generation Benchmark for Large Language Models
by: Huang, Yiming, et al.
Published: (2024)

RDMA: Cost Effective Agent-Driven Rare Disease Mining from Electronic Health Records
by: Wu, John, et al.
Published: (2025)

Matching Patients to Clinical Trials with Large Language Models
by: Jin, Qiao, et al.
Published: (2023)

Automatically Labeling Clinical Trial Outcomes: A Large-Scale Benchmark for Drug Development
by: Gao, Chufan, et al.
Published: (2024)

DSBench: How Far Are Data Science Agents from Becoming Data Science Experts?
by: Jing, Liqiang, et al.
Published: (2024)

BioELX: Cross-lingual Biomedical Entity Linking via Alias-based Retrieval and LLM Ranking
by: Wang, Yi, et al.
Published: (2026)

Harness-1: Reinforcement Learning for Search Agents with State-Externalizing Harnesses
by: Jiang, Pengcheng, et al.
Published: (2026)

Graph Alignment Topology as an Inductive Bias for Grounding Detection
by: Landes, Paul, et al.
Published: (2026)

TaSR-RAG: Taxonomy-guided Structured Reasoning for Retrieval-Augmented Generation
by: Sun, Jiashuo, et al.
Published: (2026)

DAComp: Benchmarking Data Agents across the Full Data Intelligence Lifecycle
by: Lei, Fangyu, et al.
Published: (2025)

BioInstruct: Instruction Tuning of Large Language Models for Biomedical Natural Language Processing
by: Tran, Hieu, et al.
Published: (2023)

BioPars: A Pretrained Biomedical Large Language Model for Persian Biomedical Text Mining
by: Merzah, Baqer M., et al.
Published: (2025)

CaresAI at BioCreative IX Track 1 -- LLM for Biomedical QA
by: Abdel-Salam, Reem, et al.
Published: (2025)

VisScience: An Extensive Benchmark for Evaluating K12 Educational Multi-modal Scientific Reasoning
by: Jiang, Zhihuan, et al.
Published: (2024)

ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences
by: Nguyen, Bang, et al.
Published: (2026)

Synthetic Patient-Physician Dialogue Generation from Clinical Notes Using LLM
by: Das, Trisha, et al.
Published: (2024)

MiroEval: Benchmarking Multimodal Deep Research Agents in Process and Outcome
by: Ye, Fangda, et al.
Published: (2026)

MedConclusion: A Benchmark for Biomedical Conclusion Generation from Structured Abstracts
by: Li, Weiyue, et al.
Published: (2026)

BioClinical ModernBERT: A State-of-the-Art Long-Context Encoder for Biomedical and Clinical NLP
by: Sounack, Thomas, et al.
Published: (2025)

RAG-BioQA: A Retrieval-Augmented Generation Framework for Long-Form Biomedical Question Answering
by: Panchumarthi, Lovely Yeswanth, et al.
Published: (2025)

BioMedLM: A 2.7B Parameter Language Model Trained On Biomedical Text
by: Bolton, Elliot, et al.
Published: (2024)