Saved in:
| Main Authors: | , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2026
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2604.19019 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866917424914235392 |
|---|---|
| author | Ma, Marcus Zhou, Emily Ludwig, Leonard Hörath, Julia Winkler, Christina Avramidis, Kleanthis Feng, Tiantian Toth, Gabor Bothe, Alina Narayanan, Shrikanth |
| author_facet | Ma, Marcus Zhou, Emily Ludwig, Leonard Hörath, Julia Winkler, Christina Avramidis, Kleanthis Feng, Tiantian Toth, Gabor Bothe, Alina Narayanan, Shrikanth |
| contents | We study when, where, and why 978 Holocaust survivors smile in video testimonies. We create an automatic smile detection model from facial features with an F1 of 85% and annotate detected smiles under two established taxonomies of smiling. We produce narrative features on 1,083,417 transcript sentences as well as emotional valence from three different modalities: audio, eye gaze, and text transcript. Smiling rates are significantly correlated with specific semantic topics, narrative structures, and temporal syntaxes across the entire corpus. Smiles often occur during periods of intense negative affect; these negative-affect smiles improve the valence trajectory of surrounding sentences significantly across all three modalities. Smiling reduces eye dynamics and blink rates, and the strength of both of these effects is also modulated by narrative valence. Taken together, we conclude that smiling plays a critical role in regulating emotion and social interaction during traumatic recollection. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2604_19019 |
| institution | arXiv |
| publishDate | 2026 |
| record_format | arxiv |
| spellingShingle | Smiling Regulates Emotion During Traumatic Recollection Ma, Marcus Zhou, Emily Ludwig, Leonard Hörath, Julia Winkler, Christina Avramidis, Kleanthis Feng, Tiantian Toth, Gabor Bothe, Alina Narayanan, Shrikanth Multimedia We study when, where, and why 978 Holocaust survivors smile in video testimonies. We create an automatic smile detection model from facial features with an F1 of 85% and annotate detected smiles under two established taxonomies of smiling. We produce narrative features on 1,083,417 transcript sentences as well as emotional valence from three different modalities: audio, eye gaze, and text transcript. Smiling rates are significantly correlated with specific semantic topics, narrative structures, and temporal syntaxes across the entire corpus. Smiles often occur during periods of intense negative affect; these negative-affect smiles improve the valence trajectory of surrounding sentences significantly across all three modalities. Smiling reduces eye dynamics and blink rates, and the strength of both of these effects is also modulated by narrative valence. Taken together, we conclude that smiling plays a critical role in regulating emotion and social interaction during traumatic recollection. |
| title | Smiling Regulates Emotion During Traumatic Recollection |
| topic | Multimedia |
| url | https://arxiv.org/abs/2604.19019 |