Human-AI Complementarity: A Goal for Amplified Oversight
Fuente:
arXiv
Gespeichert in:
| Hauptverfasser: | , , , , , |
|---|---|
| Format: | Preprint |
| Veröffentlicht: |
2025
|
| Schlagworte: | |
| Online-Zugang: | |
| Tags: |
Tag hinzufügen
Keine Tags, Fügen Sie den ersten Tag hinzu!
|
| _version_ | 1866917050419511296 |
|---|---|
| author | Jain, Rishub Bridgers, Sophie Janzer, Lili Greig, Rory Teh, Tian Huey Mikulik, Vladimir |
| author_facet | Jain, Rishub Bridgers, Sophie Janzer, Lili Greig, Rory Teh, Tian Huey Mikulik, Vladimir |
| contents | Human feedback is critical for aligning AI systems to human values. As AI capabilities improve and AI is used to tackle more challenging tasks, verifying quality and safety becomes increasingly challenging. This paper explores how we can leverage AI to improve the quality of human oversight. We focus on an important safety problem that is already challenging for humans: fact-verification of AI outputs. We find that combining AI ratings and human ratings based on AI rater confidence is better than relying on either alone. Giving humans an AI fact-verification assistant further improves their accuracy, but the type of assistance matters. Displaying AI explanation, confidence, and labels leads to over-reliance, but just showing search results and evidence fosters more appropriate trust. These results have implications for Amplified Oversight -- the challenge of combining humans and AI to supervise AI systems even as they surpass human expert performance. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2510_26518 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Human-AI Complementarity: A Goal for Amplified Oversight Jain, Rishub Bridgers, Sophie Janzer, Lili Greig, Rory Teh, Tian Huey Mikulik, Vladimir Artificial Intelligence Human-Computer Interaction Human feedback is critical for aligning AI systems to human values. As AI capabilities improve and AI is used to tackle more challenging tasks, verifying quality and safety becomes increasingly challenging. This paper explores how we can leverage AI to improve the quality of human oversight. We focus on an important safety problem that is already challenging for humans: fact-verification of AI outputs. We find that combining AI ratings and human ratings based on AI rater confidence is better than relying on either alone. Giving humans an AI fact-verification assistant further improves their accuracy, but the type of assistance matters. Displaying AI explanation, confidence, and labels leads to over-reliance, but just showing search results and evidence fosters more appropriate trust. These results have implications for Amplified Oversight -- the challenge of combining humans and AI to supervise AI systems even as they surpass human expert performance. |
| title | Human-AI Complementarity: A Goal for Amplified Oversight |
| topic | Artificial Intelligence Human-Computer Interaction |
| url | https://arxiv.org/abs/2510.26518 |