Disentangling Likes and Dislikes in Personalized Generative Explainable Recommendation
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866918042431127552 |
|---|---|
| author | Shimizu, Ryotaro Wada, Takashi Wang, Yu Kruse, Johannes O'Brien, Sean HtaungKham, Sai Song, Linxin Yoshikawa, Yuya Saito, Yuki Tsung, Fugee Goto, Masayuki McAuley, Julian |
| author_facet | Shimizu, Ryotaro Wada, Takashi Wang, Yu Kruse, Johannes O'Brien, Sean HtaungKham, Sai Song, Linxin Yoshikawa, Yuya Saito, Yuki Tsung, Fugee Goto, Masayuki McAuley, Julian |
| contents | Recent research on explainable recommendation generally frames the task as a standard text generation problem, and evaluates models simply based on the textual similarity between the predicted and ground-truth explanations. However, this approach fails to consider one crucial aspect of the systems: whether their outputs accurately reflect the users' (post-purchase) sentiments, i.e., whether and why they would like and/or dislike the recommended items. To shed light on this issue, we introduce new datasets and evaluation methods that focus on the users' sentiments. Specifically, we construct the datasets by explicitly extracting users' positive and negative opinions from their post-purchase reviews using an LLM, and propose to evaluate systems based on whether the generated explanations 1) align well with the users' sentiments, and 2) accurately identify both positive and negative opinions of users on the target items. We benchmark several recent models on our datasets and demonstrate that achieving strong performance on existing metrics does not ensure that the generated explanations align well with the users' sentiments. Lastly, we find that existing models can provide more sentiment-aware explanations when the users' (predicted) ratings for the target items are directly fed into the models as input. The datasets and benchmark implementation are available at: https://github.com/jchanxtarov/sent_xrec. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_13248 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Disentangling Likes and Dislikes in Personalized Generative Explainable Recommendation Shimizu, Ryotaro Wada, Takashi Wang, Yu Kruse, Johannes O'Brien, Sean HtaungKham, Sai Song, Linxin Yoshikawa, Yuya Saito, Yuki Tsung, Fugee Goto, Masayuki McAuley, Julian Machine Learning Artificial Intelligence Computation and Language Information Retrieval Recent research on explainable recommendation generally frames the task as a standard text generation problem, and evaluates models simply based on the textual similarity between the predicted and ground-truth explanations. However, this approach fails to consider one crucial aspect of the systems: whether their outputs accurately reflect the users' (post-purchase) sentiments, i.e., whether and why they would like and/or dislike the recommended items. To shed light on this issue, we introduce new datasets and evaluation methods that focus on the users' sentiments. Specifically, we construct the datasets by explicitly extracting users' positive and negative opinions from their post-purchase reviews using an LLM, and propose to evaluate systems based on whether the generated explanations 1) align well with the users' sentiments, and 2) accurately identify both positive and negative opinions of users on the target items. We benchmark several recent models on our datasets and demonstrate that achieving strong performance on existing metrics does not ensure that the generated explanations align well with the users' sentiments. Lastly, we find that existing models can provide more sentiment-aware explanations when the users' (predicted) ratings for the target items are directly fed into the models as input. The datasets and benchmark implementation are available at: https://github.com/jchanxtarov/sent_xrec. |
| title | Disentangling Likes and Dislikes in Personalized Generative Explainable Recommendation |
| topic | Machine Learning Artificial Intelligence Computation and Language Information Retrieval |
| url | https://arxiv.org/abs/2410.13248 |