The Trust Calibration Maturity Model for Characterizing and Communicating Trustworthiness of AI Systems
Fuente:
arXiv
Salvato in:
| Autori principali: | , , , , , , , , |
|---|---|
| Natura: | Preprint |
| Pubblicazione: |
2025
|
| Soggetti: | |
| Accesso online: | |
| Tags: |
Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
|
| _version_ | 1866914163758989312 |
|---|---|
| author | Steinmetz, Scott T Naugle, Asmeret Schutte, Paul Sweitzer, Matt Washburne, Alex Linville, Lisa Krofcheck, Daniel Kucer, Michal Myren, Samuel |
| author_facet | Steinmetz, Scott T Naugle, Asmeret Schutte, Paul Sweitzer, Matt Washburne, Alex Linville, Lisa Krofcheck, Daniel Kucer, Michal Myren, Samuel |
| contents | Recent proliferation of powerful AI systems has created a strong need for capabilities that help users to calibrate trust in those systems. As AI systems grow in scale, information required to evaluate their trustworthiness becomes less accessible, presenting a growing risk of using these systems inappropriately. We propose the Trust Calibration Maturity Model (TCMM) to characterize and communicate information about AI system trustworthiness. The TCMM incorporates five dimensions of analytic maturity: Performance Characterization, Bias & Robustness Quantification, Transparency, Safety & Security, and Usability. The TCMM can be presented along with system performance information to (1) help a user to appropriately calibrate trust, (2) establish requirements and track progress, and (3) identify research needs. Here, we discuss the TCMM and demonstrate it on two target tasks: using ChatGPT for high consequence nuclear science determinations, and using PhaseNet (an ensemble of seismic models) for categorizing sources of seismic events. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2503_15511 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | The Trust Calibration Maturity Model for Characterizing and Communicating Trustworthiness of AI Systems Steinmetz, Scott T Naugle, Asmeret Schutte, Paul Sweitzer, Matt Washburne, Alex Linville, Lisa Krofcheck, Daniel Kucer, Michal Myren, Samuel Human-Computer Interaction Computers and Society Machine Learning Recent proliferation of powerful AI systems has created a strong need for capabilities that help users to calibrate trust in those systems. As AI systems grow in scale, information required to evaluate their trustworthiness becomes less accessible, presenting a growing risk of using these systems inappropriately. We propose the Trust Calibration Maturity Model (TCMM) to characterize and communicate information about AI system trustworthiness. The TCMM incorporates five dimensions of analytic maturity: Performance Characterization, Bias & Robustness Quantification, Transparency, Safety & Security, and Usability. The TCMM can be presented along with system performance information to (1) help a user to appropriately calibrate trust, (2) establish requirements and track progress, and (3) identify research needs. Here, we discuss the TCMM and demonstrate it on two target tasks: using ChatGPT for high consequence nuclear science determinations, and using PhaseNet (an ensemble of seismic models) for categorizing sources of seismic events. |
| title | The Trust Calibration Maturity Model for Characterizing and Communicating Trustworthiness of AI Systems |
| topic | Human-Computer Interaction Computers and Society Machine Learning |
| url | https://arxiv.org/abs/2503.15511 |