Few-shot Personalized Saliency Prediction Based on Interpersonal Gaze Patterns
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2023
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866916973649068032 |
|---|---|
| author | Moroto, Yuya Maeda, Keisuke Ogawa, Takahiro Haseyama, Miki |
| author_facet | Moroto, Yuya Maeda, Keisuke Ogawa, Takahiro Haseyama, Miki |
| contents | This study proposes a few-shot personalized saliency prediction method that leverages interpersonal gaze patterns. Unlike general saliency maps, personalized saliency maps (PSMs) capture individual visual attention and provide insights into individual visual preferences. However, predicting PSMs is challenging because of the complexity of gaze patterns and the difficulty of collecting extensive eye-tracking data from individuals. An effective strategy for predicting PSMs from limited data is the use of eye-tracking data from other persons. To efficiently handle the PSMs of other persons, this study focuses on the selection of images to acquire eye-tracking data and the preservation of the structural information of PSMs. In the proposed method, these images are selected such that they bring more diverse gaze patterns to persons, and structural information is preserved using tensor-based regression. The experimental results demonstrate that these two factors are beneficial for few-shot PSM prediction. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2307_02799 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | Few-shot Personalized Saliency Prediction Based on Interpersonal Gaze Patterns Moroto, Yuya Maeda, Keisuke Ogawa, Takahiro Haseyama, Miki Image and Video Processing Machine Learning This study proposes a few-shot personalized saliency prediction method that leverages interpersonal gaze patterns. Unlike general saliency maps, personalized saliency maps (PSMs) capture individual visual attention and provide insights into individual visual preferences. However, predicting PSMs is challenging because of the complexity of gaze patterns and the difficulty of collecting extensive eye-tracking data from individuals. An effective strategy for predicting PSMs from limited data is the use of eye-tracking data from other persons. To efficiently handle the PSMs of other persons, this study focuses on the selection of images to acquire eye-tracking data and the preservation of the structural information of PSMs. In the proposed method, these images are selected such that they bring more diverse gaze patterns to persons, and structural information is preserved using tensor-based regression. The experimental results demonstrate that these two factors are beneficial for few-shot PSM prediction. |
| title | Few-shot Personalized Saliency Prediction Based on Interpersonal Gaze Patterns |
| topic | Image and Video Processing Machine Learning |
| url | https://arxiv.org/abs/2307.02799 |