Saved in:
| Main Authors: | , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2410.09999 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913544608415744 |
|---|---|
| author | Mukku, Sandeep Sricharan Kanagarajan, Abinesh Ghosh, Pushpendu Aggarwal, Chetan |
| author_facet | Mukku, Sandeep Sricharan Kanagarajan, Abinesh Ghosh, Pushpendu Aggarwal, Chetan |
| contents | Businesses can benefit from customer feedback in different modalities, such as text and images, to enhance their products and services. However, it is difficult to extract actionable and relevant pairs of text segments and images from customer feedback in a single pass. In this paper, we propose a novel multi-modal method that fuses image and text information in a latent space and decodes it to extract the relevant feedback segments using an image-text grounded text decoder. We also introduce a weakly-supervised data generation technique that produces training data for this task. We evaluate our model on unseen data and demonstrate that it can effectively mine actionable insights from multi-modal customer feedback, outperforming the existing baselines by $14$ points in F1 score. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2410_09999 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | Leveraging Customer Feedback for Multi-modal Insight Extraction Mukku, Sandeep Sricharan Kanagarajan, Abinesh Ghosh, Pushpendu Aggarwal, Chetan Computation and Language Artificial Intelligence Computer Vision and Pattern Recognition Information Retrieval Businesses can benefit from customer feedback in different modalities, such as text and images, to enhance their products and services. However, it is difficult to extract actionable and relevant pairs of text segments and images from customer feedback in a single pass. In this paper, we propose a novel multi-modal method that fuses image and text information in a latent space and decodes it to extract the relevant feedback segments using an image-text grounded text decoder. We also introduce a weakly-supervised data generation technique that produces training data for this task. We evaluate our model on unseen data and demonstrate that it can effectively mine actionable insights from multi-modal customer feedback, outperforming the existing baselines by $14$ points in F1 score. |
| title | Leveraging Customer Feedback for Multi-modal Insight Extraction |
| topic | Computation and Language Artificial Intelligence Computer Vision and Pattern Recognition Information Retrieval |
| url | https://arxiv.org/abs/2410.09999 |