The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection
Fuente:
arXiv
Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866910807916281856 |
|---|---|
| author | Bhattacharya, Haimanti Dugar, Subhasish Hazra, Sanchaita Majumder, Bodhisattwa Prasad |
| author_facet | Bhattacharya, Haimanti Dugar, Subhasish Hazra, Sanchaita Majumder, Bodhisattwa Prasad |
| contents | We investigate how low-quality AI advisors, lacking quality disclosures, can help spread text-based lies while seeming to help people detect lies. Participants in our experiment discern truth from lies by evaluating transcripts from a game show that mimicked deceptive social media exchanges on topics with objective truths. We find that when relying on low-quality advisors without disclosures, participants' truth-detection rates fall below their own abilities, which recovered once the AI's true effectiveness was revealed. Conversely, high-quality advisor enhances truth detection, regardless of disclosure. We discover that participants' expectations about AI capabilities contribute to their undue reliance on opaque, low-quality advisors. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_23143 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection Bhattacharya, Haimanti Dugar, Subhasish Hazra, Sanchaita Majumder, Bodhisattwa Prasad Computation and Language Artificial Intelligence Computers and Society Human-Computer Interaction Machine Learning We investigate how low-quality AI advisors, lacking quality disclosures, can help spread text-based lies while seeming to help people detect lies. Participants in our experiment discern truth from lies by evaluating transcripts from a game show that mimicked deceptive social media exchanges on topics with objective truths. We find that when relying on low-quality advisors without disclosures, participants' truth-detection rates fall below their own abilities, which recovered once the AI's true effectiveness was revealed. Conversely, high-quality advisor enhances truth detection, regardless of disclosure. We discover that participants' expectations about AI capabilities contribute to their undue reliance on opaque, low-quality advisors. |
| title | The Good, the Bad, and the Ugly: The Role of AI Quality Disclosure in Lie Detection |
| topic | Computation and Language Artificial Intelligence Computers and Society Human-Computer Interaction Machine Learning |
| url | https://arxiv.org/abs/2410.23143 |