MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Cǎtrunǎ, Andy, Cosma, Adrian, Rǎdoi, Emilian
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866908578797846528
author Cǎtrunǎ, Andy
Cosma, Adrian
Rǎdoi, Emilian
author_facet Cǎtrunǎ, Andy
Cosma, Adrian
Rǎdoi, Emilian
contents Gait encodes rich biometric and behavioural information, yet leveraging the manner of walking to infer psychological traits remains a challenging and underexplored problem. We introduce a hierarchical Multi-Stage Mixture of Movement Experts (MoME) architecture for multi-task prediction of psychological attributes from gait sequences represented as 2D poses. MoME processes the walking cycle in four stages of movement complexity, employing lightweight expert models to extract spatio-temporal features and task-specific gating modules to adaptively weight experts across traits and stages. Evaluated on the PsyMo benchmark covering 17 psychological traits, our method outperforms state-of-the-art gait analysis models, achieving a 37.47% weighted F1 score at the run level and 44.6% at the subject level. Our experiments show that integrating auxiliary tasks such as identity recognition, gender prediction, and BMI estimation further improves psychological trait estimation. Our findings demonstrate the viability of multi-task gait-based learning for psychological trait estimation and provide a foundation for future research on movement-informed psychological inference.
format Preprint
id arxiv_https___arxiv_org_abs_2510_04654
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts
Cǎtrunǎ, Andy
Cosma, Adrian
Rǎdoi, Emilian
Computer Vision and Pattern Recognition
Gait encodes rich biometric and behavioural information, yet leveraging the manner of walking to infer psychological traits remains a challenging and underexplored problem. We introduce a hierarchical Multi-Stage Mixture of Movement Experts (MoME) architecture for multi-task prediction of psychological attributes from gait sequences represented as 2D poses. MoME processes the walking cycle in four stages of movement complexity, employing lightweight expert models to extract spatio-temporal features and task-specific gating modules to adaptively weight experts across traits and stages. Evaluated on the PsyMo benchmark covering 17 psychological traits, our method outperforms state-of-the-art gait analysis models, achieving a 37.47% weighted F1 score at the run level and 44.6% at the subject level. Our experiments show that integrating auxiliary tasks such as identity recognition, gender prediction, and BMI estimation further improves psychological trait estimation. Our findings demonstrate the viability of multi-task gait-based learning for psychological trait estimation and provide a foundation for future research on movement-informed psychological inference.
title MoME: Estimating Psychological Traits from Gait with Multi-Stage Mixture of Movement Experts
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2510.04654