Trajectory-guided Motion Perception for Facial Expression Quality Assessment in Neurological Disorders

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Duan, Shuchao, Dadashzadeh, Amirhossein, Whone, Alan, Mirmehdi, Majid
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916692780646400
author Duan, Shuchao
Dadashzadeh, Amirhossein
Whone, Alan
Mirmehdi, Majid
author_facet Duan, Shuchao
Dadashzadeh, Amirhossein
Whone, Alan
Mirmehdi, Majid
contents Automated facial expression quality assessment (FEQA) in neurological disorders is critical for enhancing diagnostic accuracy and improving patient care, yet effectively capturing the subtle motions and nuances of facial muscle movements remains a challenge. We propose to analyse facial landmark trajectories, a compact yet informative representation, that encodes these subtle motions from a high-level structural perspective. Hence, we introduce Trajectory-guided Motion Perception Transformer (TraMP-Former), a novel FEQA framework that fuses landmark trajectory features for fine-grained motion capture with visual semantic cues from RGB frames, ultimately regressing the combined features into a quality score. Extensive experiments demonstrate that TraMP-Former achieves new state-of-the-art performance on benchmark datasets with neurological disorders, including PFED5 (up by 6.51%) and an augmented Toronto NeuroFace (up by 7.62%). Our ablation studies further validate the efficiency and effectiveness of landmark trajectories in FEQA. Our code is available at https://github.com/shuchaoduan/TraMP-Former.
format Preprint
id arxiv_https___arxiv_org_abs_2504_09530
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Trajectory-guided Motion Perception for Facial Expression Quality Assessment in Neurological Disorders
Duan, Shuchao
Dadashzadeh, Amirhossein
Whone, Alan
Mirmehdi, Majid
Computer Vision and Pattern Recognition
Automated facial expression quality assessment (FEQA) in neurological disorders is critical for enhancing diagnostic accuracy and improving patient care, yet effectively capturing the subtle motions and nuances of facial muscle movements remains a challenge. We propose to analyse facial landmark trajectories, a compact yet informative representation, that encodes these subtle motions from a high-level structural perspective. Hence, we introduce Trajectory-guided Motion Perception Transformer (TraMP-Former), a novel FEQA framework that fuses landmark trajectory features for fine-grained motion capture with visual semantic cues from RGB frames, ultimately regressing the combined features into a quality score. Extensive experiments demonstrate that TraMP-Former achieves new state-of-the-art performance on benchmark datasets with neurological disorders, including PFED5 (up by 6.51%) and an augmented Toronto NeuroFace (up by 7.62%). Our ablation studies further validate the efficiency and effectiveness of landmark trajectories in FEQA. Our code is available at https://github.com/shuchaoduan/TraMP-Former.
title Trajectory-guided Motion Perception for Facial Expression Quality Assessment in Neurological Disorders
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.09530