Cover Image

ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Ye, Christine, Yuan, Sihan, Cooray, Suchetha, Dillmann, Steven, Roque, Ian L. V., Baron, Dalya, Frank, Philipp, Martin-Alvarez, Sergio, Koblischke, Nolan, Qu, Frank J, Yang, Diyi, Wechsler, Risa, Ciuca, Ioana
Format:	Preprint
Published:	2025
Subjects:	Computation and Language Instrumentation and Methods for Astrophysics
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Pediatric lung ultrasound
by: Ioana Ciuca
Published: (2024)

Replicable Uniformity Testing
by: Liu, Sihan, et al.
Published: (2024)

SpectraFM: Tuning into Stellar Foundation Models
by: Koblischke, Nolan, et al.
Published: (2024)

PaperBench: Evaluating AI's Ability to Replicate AI Research
by: Starace, Giulio, et al.
Published: (2025)

Gravity-Bench-v1: A Benchmark on Gravitational Physics Discovery for Agents
by: Koblischke, Nolan, et al.
Published: (2025)

Replicable Distribution Testing
by: Diakonikolas, Ilias, et al.
Published: (2025)

Supernova Event Dataset: Interpreting Large Language Models' Personality through Critical Event Analysis
by: Agarwal, Pranav, et al.
Published: (2025)

ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences
by: Nguyen, Bang, et al.
Published: (2026)

Replicability in High Dimensional Statistics
by: Hopkins, Max, et al.
Published: (2024)

Calibrating and standardizing the Tip of the Red Giant Branch in the Small Magellanic Cloud using small-amplitude red giants
by: Koblischke, Nolan W., et al.
Published: (2024)

SciReplicate-Bench: Benchmarking LLMs in Agent-driven Algorithmic Reproduction from Research Papers
by: Xiang, Yanzheng, et al.
Published: (2025)

From Generative to Episodic: Sample-Efficient Replicable Reinforcement Learning
by: Hopkins, Max, et al.
Published: (2025)

Binding of Precursors to Replicator Assemblies Can Improve Replication Fidelity and Mediate Error Correction
by: Omer Markovitch, et al.
Published: (2024)

Binding of Precursors to Replicator Assemblies Can Improve Replication Fidelity and Mediate Error Correction
by: Omer Markovitch, et al.
Published: (2024)

Small amplitude red giants elucidate the nature of the Tip of the Red Giant Branch as a standard candle
by: Anderson, Richard I., et al.
Published: (2023)

Robust Maximum $L_q$-Likelihood Covariance Estimation for Replicated Spatial Data
by: Chen, Sihan, et al.
Published: (2024)

Replication Data for OSEM IJF Paper (Revision 1)
by: Schwarz
Published: (2025)

sOPTICS: A Modified Density-Based Algorithm for Identifying Galaxy Groups/Clusters and Brightest Cluster Galaxies
by: Ma, Hai-Xia, et al.
Published: (2024)

Non Equilibrium Transitions in a Polymer Replication Ensemble
by: Genthon, Arthur, et al.
Published: (2024)

The Difference Between "Replicable" and "Not replicable" is not Itself Scientifically Replicable
by: Devezer, Berna, et al.
Published: (2026)

Language Models Can Autonomously Hack and Self-Replicate
by: Air, Alena, et al.
Published: (2026)

Exploring gas thermodynamics around galaxies from the Sunyaev-Zel'dovich effects: impact of galaxy-halo connection, 2D projection and velocity field
by: Kadir, Sadaf, et al.
Published: (2026)

Replicability Measures for Longitudinal Information Retrieval Evaluation
by: Keller, Jüri, et al.
Published: (2024)

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents
by: Black, Sid, et al.
Published: (2025)

Replicable Clustering
by: Esfandiari, Hossein, et al.
Published: (2023)

Replicable Composition
by: Banihashem, Kiarash, et al.
Published: (2026)

Replicability of Experiment
by: John D. Norton
Published: (2015)

Sparks of Science: Hypothesis Generation Using Structured Paper Data
by: O'Neill, Charles, et al.
Published: (2025)

A Lightweight Approach for State Machine Replication
by: Cachin, Christian, et al.
Published: (2025)

Stochastic Models for Replication Origin Spacings in Eukaryotic DNA Replication
by: Day, Huw, et al.
Published: (2022)

License to Replicate: Mechanisms of Licensing Eukaryotic Origins for DNA Replication
by: Victoria Frisbie, et al.
Published: (2025)

Picsou: Enabling Replicated State Machines to Communicate Efficiently
by: Frank, Reginald, et al.
Published: (2023)

Can GPT-4 Replicate Empirical Software Engineering Research?
by: Liang, Jenny T., et al.
Published: (2023)

Memoirs of mass accretion: probing the edges of intracluster light in simulated galaxy clusters
by: Dacunha, Tara, et al.
Published: (2025)

VARIES Replication Package
by: Anonymous
Published: (2026)

Replicable Online Learning
by: Ahmadi, Saba, et al.
Published: (2024)

Replicable Constrained Bandits
by: Bollini, Matteo, et al.
Published: (2026)

The Replication of Equivalence Studies
by: Charlotte Micheloud, et al.
Published: (2024)

Replicating Electoral Success
by: Tomlinson, Kiran, et al.
Published: (2024)

Replicating the taste of sugar
by: Dubois, G. E
Published: (2011)