Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networks
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866915014364889088 |
|---|---|
| author | Li, Panfeng Abouelenien, Mohamed Mihalcea, Rada Ding, Zhicheng Yang, Qikai Zhou, Yiming |
| author_facet | Li, Panfeng Abouelenien, Mohamed Mihalcea, Rada Ding, Zhicheng Yang, Qikai Zhou, Yiming |
| contents | Deception detection is gaining increasing interest due to ethical and security concerns. This paper explores the application of convolutional neural networks for the purpose of multimodal deception detection. We use a dataset built by interviewing 104 subjects about two topics, with one truthful and one falsified response from each subject about each topic. In particular, we make three main contributions. First, we extract linguistic and physiological features from this data to train and construct the neural network models. Second, we propose a fused convolutional neural network model using both modalities in order to achieve an improved overall performance. Third, we compare our new approach with earlier methods designed for multimodal deception detection. We find that our system outperforms regular classification methods; our results indicate the feasibility of using neural networks for deception detection even in the presence of limited amounts of data. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_10944 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networks Li, Panfeng Abouelenien, Mohamed Mihalcea, Rada Ding, Zhicheng Yang, Qikai Zhou, Yiming Computation and Language Artificial Intelligence Machine Learning Deception detection is gaining increasing interest due to ethical and security concerns. This paper explores the application of convolutional neural networks for the purpose of multimodal deception detection. We use a dataset built by interviewing 104 subjects about two topics, with one truthful and one falsified response from each subject about each topic. In particular, we make three main contributions. First, we extract linguistic and physiological features from this data to train and construct the neural network models. Second, we propose a fused convolutional neural network model using both modalities in order to achieve an improved overall performance. Third, we compare our new approach with earlier methods designed for multimodal deception detection. We find that our system outperforms regular classification methods; our results indicate the feasibility of using neural networks for deception detection even in the presence of limited amounts of data. |
| title | Deception Detection from Linguistic and Physiological Data Streams Using Bimodal Convolutional Neural Networks |
| topic | Computation and Language Artificial Intelligence Machine Learning |
| url | https://arxiv.org/abs/2311.10944 |