Robustness tests for biomedical foundation models should tailor to specifications

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Xian, R. Patrick, Baker, Noah R., David, Tom, Cui, Qiming, Holmgren, A. Jay, Bauer, Stefan, Sushil, Madhumita, Abbasi-Asl, Reza
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866908509135699968
author Xian, R. Patrick
Baker, Noah R.
David, Tom
Cui, Qiming
Holmgren, A. Jay
Bauer, Stefan
Sushil, Madhumita
Abbasi-Asl, Reza
author_facet Xian, R. Patrick
Baker, Noah R.
David, Tom
Cui, Qiming
Holmgren, A. Jay
Bauer, Stefan
Sushil, Madhumita
Abbasi-Asl, Reza
contents The rise of biomedical foundation models creates new hurdles in model testing and authorization, given their broad capabilities and susceptibility to complex distribution shifts. We suggest tailoring robustness tests according to task-dependent priorities and propose to integrate granular notions of robustness in a predefined specification to guide implementation. Our approach facilitates the standardization of robustness assessments in the model lifecycle and connects abstract AI regulatory frameworks with concrete testing procedures.
format Preprint
id arxiv_https___arxiv_org_abs_2502_10374
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Robustness tests for biomedical foundation models should tailor to specifications
Xian, R. Patrick
Baker, Noah R.
David, Tom
Cui, Qiming
Holmgren, A. Jay
Bauer, Stefan
Sushil, Madhumita
Abbasi-Asl, Reza
Software Engineering
Computers and Society
The rise of biomedical foundation models creates new hurdles in model testing and authorization, given their broad capabilities and susceptibility to complex distribution shifts. We suggest tailoring robustness tests according to task-dependent priorities and propose to integrate granular notions of robustness in a predefined specification to guide implementation. Our approach facilitates the standardization of robustness assessments in the model lifecycle and connects abstract AI regulatory frameworks with concrete testing procedures.
title Robustness tests for biomedical foundation models should tailor to specifications
topic Software Engineering
Computers and Society
url https://arxiv.org/abs/2502.10374