Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2508.18715 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914006010167296 |
|---|---|
| author | Yuan, Angela Yifei Li, Haoyi Han, Soyeon Caren Leckie, Christopher |
| author_facet | Yuan, Angela Yifei Li, Haoyi Han, Soyeon Caren Leckie, Christopher |
| contents | The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods often struggle in online conversational settings, reducing the reliability and interpretability essential for trustworthy AI deployment. In customer service scenarios where operators are typically non-expert users, explanation become crucial for trustworthy MGT detection. In this paper, we propose EMMM, an explanation-then-detection framework that balances latency, accuracy, and non-expert-oriented interpretability. Experimental results demonstrate that EMMM provides explanations accessible to non-expert users, with 70\% of human evaluators preferring its outputs, while achieving competitive accuracy compared to state-of-the-art models and maintaining low latency, generating outputs within 1 second. Our code and dataset are open-sourced at https://github.com/AngieYYF/EMMM-explainable-chatbot-detection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2508_18715 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | EMMM, Explain Me My Model! Explainable Machine Generated Text Detection in Dialogues Yuan, Angela Yifei Li, Haoyi Han, Soyeon Caren Leckie, Christopher Computation and Language The rapid adoption of large language models (LLMs) in customer service introduces new risks, as malicious actors can exploit them to conduct large-scale user impersonation through machine-generated text (MGT). Current MGT detection methods often struggle in online conversational settings, reducing the reliability and interpretability essential for trustworthy AI deployment. In customer service scenarios where operators are typically non-expert users, explanation become crucial for trustworthy MGT detection. In this paper, we propose EMMM, an explanation-then-detection framework that balances latency, accuracy, and non-expert-oriented interpretability. Experimental results demonstrate that EMMM provides explanations accessible to non-expert users, with 70\% of human evaluators preferring its outputs, while achieving competitive accuracy compared to state-of-the-art models and maintaining low latency, generating outputs within 1 second. Our code and dataset are open-sourced at https://github.com/AngieYYF/EMMM-explainable-chatbot-detection. |
| title | EMMM, Explain Me My Model! Explainable Machine Generated Text Detection in Dialogues |
| topic | Computation and Language |
| url | https://arxiv.org/abs/2508.18715 |