Sentiment Reasoning for Healthcare

Fuente: arXiv
Guardado en:
Detalles Bibliográficos
Autores principales: Nguyen, Khai-Nguyen, Le-Duc, Khai, Tat, Bach Phan, Le, Duy, Vo-Dang, Long, Hy, Truong-Son
Formato: Preprint
Publicado: 2024
Materias:
Acceso en línea:
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
_version_ 1866908497702027264
author Nguyen, Khai-Nguyen
Le-Duc, Khai
Tat, Bach Phan
Le, Duy
Vo-Dang, Long
Hy, Truong-Son
author_facet Nguyen, Khai-Nguyen
Le-Duc, Khai
Tat, Bach Phan
Le, Duy
Vo-Dang, Long
Hy, Truong-Son
contents Transparency in AI healthcare decision-making is crucial. By incorporating rationales to explain reason for each predicted label, users could understand Large Language Models (LLMs)'s reasoning to make better decision. In this work, we introduce a new task - Sentiment Reasoning - for both speech and text modalities, and our proposed multimodal multitask framework and the world's largest multimodal sentiment analysis dataset. Sentiment Reasoning is an auxiliary task in sentiment analysis where the model predicts both the sentiment label and generates the rationale behind it based on the input transcript. Our study conducted on both human transcripts and Automatic Speech Recognition (ASR) transcripts shows that Sentiment Reasoning helps improve model transparency by providing rationale for model prediction with quality semantically comparable to humans while also improving model's classification performance (+2% increase in both accuracy and macro-F1) via rationale-augmented fine-tuning. Also, no significant difference in the semantic quality of generated rationales between human and ASR transcripts. All code, data (five languages - Vietnamese, English, Chinese, German, and French) and models are published online: https://github.com/leduckhai/Sentiment-Reasoning
format Preprint
id arxiv_https___arxiv_org_abs_2407_21054
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Sentiment Reasoning for Healthcare
Nguyen, Khai-Nguyen
Le-Duc, Khai
Tat, Bach Phan
Le, Duy
Vo-Dang, Long
Hy, Truong-Son
Computation and Language
Artificial Intelligence
Machine Learning
Sound
Audio and Speech Processing
Transparency in AI healthcare decision-making is crucial. By incorporating rationales to explain reason for each predicted label, users could understand Large Language Models (LLMs)'s reasoning to make better decision. In this work, we introduce a new task - Sentiment Reasoning - for both speech and text modalities, and our proposed multimodal multitask framework and the world's largest multimodal sentiment analysis dataset. Sentiment Reasoning is an auxiliary task in sentiment analysis where the model predicts both the sentiment label and generates the rationale behind it based on the input transcript. Our study conducted on both human transcripts and Automatic Speech Recognition (ASR) transcripts shows that Sentiment Reasoning helps improve model transparency by providing rationale for model prediction with quality semantically comparable to humans while also improving model's classification performance (+2% increase in both accuracy and macro-F1) via rationale-augmented fine-tuning. Also, no significant difference in the semantic quality of generated rationales between human and ASR transcripts. All code, data (five languages - Vietnamese, English, Chinese, German, and French) and models are published online: https://github.com/leduckhai/Sentiment-Reasoning
title Sentiment Reasoning for Healthcare
topic Computation and Language
Artificial Intelligence
Machine Learning
Sound
Audio and Speech Processing
url https://arxiv.org/abs/2407.21054