Cover Image

RepliBench: Evaluating the Autonomous Replication Capabilities of Language Model Agents

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Black, Sid, Stickland, Asa Cooper, Pencharz, Jake, Sourbut, Oliver, Schmatz, Michael, Bailey, Jay, Matthews, Ollie, Millwood, Ben, Remedios, Alex, Cooney, Alan
Format:	Preprint
Published:	2025
Subjects:	Cryptography and Security Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

More Capable, Less Cooperative? When LLMs Fail At Zero-Cost Collaboration
by: Yadav, Advait, et al.
Published: (2026)

Do Large Language Models Know What They Are Capable Of?
by: Barkan, Casey O., et al.
Published: (2025)

Async Control: Stress-testing Asynchronous Control Measures for LLM Agents
by: Stickland, Asa Cooper, et al.
Published: (2025)

Does Unlearning Truly Unlearn? A Black Box Evaluation of LLM Unlearning Methods
by: Doshi, Jai, et al.
Published: (2024)

Why Do Language Model Agents Whistleblow?
by: Agrawal, Kushal, et al.
Published: (2025)

Future Events as Backdoor Triggers: Investigating Temporal Vulnerabilities in LLMs
by: Price, Sara, et al.
Published: (2024)

Steering Without Side Effects: Improving Post-Deployment Control of Language Models
by: Stickland, Asa Cooper, et al.
Published: (2024)

MonitoringBench: Semi-Automated Red-Teaming for Agent Monitoring
by: Jotautaitė, Monika, et al.
Published: (2026)

Cooperation and Control in Delegation Games
by: Sourbut, Oliver, et al.
Published: (2024)

The Reversal Curse: LLMs trained on "A is B" fail to learn "B is A"
by: Berglund, Lukas, et al.
Published: (2023)

Propensity Inference: Environmental Contributors to LLM Behaviour
by: Järviniemi, Olli, et al.
Published: (2026)

Age determination of sediment core SHEHEREE, Sheheree Bog, Ireland
by: Cooney, T
Published: (2018)

ReplicationBench: Can AI Agents Replicate Astrophysics Research Papers?
by: Ye, Christine, et al.
Published: (2025)

ReplicatorBench: Benchmarking LLM Agents for Replicability in Social and Behavioral Sciences
by: Nguyen, Bang, et al.
Published: (2026)

Summing Up the Facts: Additive Mechanisms Behind Factual Recall in LLMs
by: Chughtai, Bilal, et al.
Published: (2024)

MojitoProcessor: Postprocessing tools for LISA Mojito L01 data
by: Burke, Ollie
Published: (2026)

MojitoProcessor
by: Burke, Ollie
Published: (2026)

MojitoProcessor
by: Burke, Ollie
Published: (2026)

Automatic Detection of Dark Ship-to-Ship Transfers using Deep Learning and Satellite Imagery
by: Ballinger, Ollie
Published: (2024)

The moduli space of multi-monopoles on a Riemann surface
by: Thakar, Ollie
Published: (2025)

Open Access Battle Damage Detection via Pixel-Wise T-Test on Sentinel-1 Imagery
by: Ballinger, Ollie
Published: (2024)

Entropy-Minimizing Diffeomorphisms on a $G_2$-Manifold
by: Thakar, Ollie
Published: (2026)

Combinatorial Proofs of Properties of Double-Point Enhanced Grid Homology
by: Thakar, Ollie
Published: (2022)

PaperBench: Evaluating AI's Ability to Replicate AI Research
by: Starace, Giulio, et al.
Published: (2025)

Linguistic Uncertainty and Reply Engagement on X: A Cross-Domain Replication of the Uncertainty-Reply Asymmetry
by: Soufan, Mohamed
Published: (2026)

Between‐ and Within‐Person Associations Between Serum Lipids and Adolescent Depressive Symptoms
by: Erika M. Manczak, et al.
Published: (2025)

Farmer Protests and Income Developments in the EU
by: Alan Matthews
Published: (2024)

Promoting Sustainable Agri‐food Trade: What the EU Can Do
by: Alan Matthews
Published: (2026)

Paper XXXVIII - Early-Universe Boundary Conditions under Empirically Constrained Operational Spacetime
by: Cooney, Paul
Published: (2025)

The Certification Manifold - Dark Matter, Dispersion, and Cross-Channel Consistency
by: Cooney, Paul
Published: (2026)

Paper XXVI - Cepheid Period Calibration in History-Dependent Operational Time
by: Cooney, Paul
Published: (2025)

Quantum Mechanics Without Geometry
by: Cooney, Paul
Published: (2026)

Paper XXXIII - Strong Gravitational Lensing Time Delays and Operational Time-Distance Structure
by: Cooney, Paul
Published: (2025)

The Certification Budget of the Universe: Inflation, Dark Energy, and Gauge-Sector Expiry from a Decaying Accessibility Ceiling
by: Cooney, Paul
Published: (2026)

Paper XI - Operational Time Regulation from Ordered Dynamics
by: Cooney, Paul
Published: (2025)

A screened time-drag scalar field: percent-level late-time growth and the cosmic radio dipole excess
by: Cooney, Paul
Published: (2025)

Frame Dissolution, the Certification Ceiling, and Observable Deformations
by: Cooney, Paul
Published: (2026)

Frame Dissolution and the Planck Ceiling
by: Cooney, Paul
Published: (2026)

Paper IV — Local Interactions and Potentials from Operational Locality
by: Cooney, Paul
Published: (2025)

La caza de trofeos, la conservación y los medios de subsistencia rurales La caza de trofeos, la conservación y los medios de subsistencia rurales
by: Cooney, Rosie
Published: (2016)