MMGait: Towards Multi-Modal Gait Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Wang, Chenye, Cai, Qingyuan, Hou, Saihui, Li, Aoqi, Huang, Yongzhen
Format: Preprint
Published: 2026
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918452355137536
author Wang, Chenye
Cai, Qingyuan
Hou, Saihui
Li, Aoqi
Huang, Yongzhen
author_facet Wang, Chenye
Cai, Qingyuan
Hou, Saihui
Li, Aoqi
Huang, Yongzhen
contents Gait recognition has emerged as a powerful biometric technique for identifying individuals at a distance without requiring user cooperation. Most existing methods focus primarily on RGB-derived modalities, which fall short in real-world scenarios requiring multi-modal collaboration and cross-modal retrieval. To overcome these challenges, we present MMGait, a comprehensive multi-modal gait benchmark integrating data from five heterogeneous sensors, including an RGB camera, a depth camera, an infrared camera, a LiDAR scanner, and a 4D Radar system. MMGait contains twelve modalities and 334,060 sequences from 725 subjects, enabling systematic exploration across geometric, photometric, and motion domains. Based on MMGait, we conduct extensive evaluations on single-modal, cross-modal, and multi-modal paradigms to analyze modality robustness and complementarity. Furthermore, we introduce a new task, Omni Multi-Modal Gait Recognition, which aims to unify the above three gait recognition paradigms within a single model. We also propose a simple yet powerful baseline, OmniGait, which learns a shared embedding space across diverse modalities and achieves promising recognition performance. The MMGait benchmark, codebase, and pretrained checkpoints are publicly available at https://github.com/BNU-IVC/MMGait.
format Preprint
id arxiv_https___arxiv_org_abs_2604_15979
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle MMGait: Towards Multi-Modal Gait Recognition
Wang, Chenye
Cai, Qingyuan
Hou, Saihui
Li, Aoqi
Huang, Yongzhen
Computer Vision and Pattern Recognition
Gait recognition has emerged as a powerful biometric technique for identifying individuals at a distance without requiring user cooperation. Most existing methods focus primarily on RGB-derived modalities, which fall short in real-world scenarios requiring multi-modal collaboration and cross-modal retrieval. To overcome these challenges, we present MMGait, a comprehensive multi-modal gait benchmark integrating data from five heterogeneous sensors, including an RGB camera, a depth camera, an infrared camera, a LiDAR scanner, and a 4D Radar system. MMGait contains twelve modalities and 334,060 sequences from 725 subjects, enabling systematic exploration across geometric, photometric, and motion domains. Based on MMGait, we conduct extensive evaluations on single-modal, cross-modal, and multi-modal paradigms to analyze modality robustness and complementarity. Furthermore, we introduce a new task, Omni Multi-Modal Gait Recognition, which aims to unify the above three gait recognition paradigms within a single model. We also propose a simple yet powerful baseline, OmniGait, which learns a shared embedding space across diverse modalities and achieves promising recognition performance. The MMGait benchmark, codebase, and pretrained checkpoints are publicly available at https://github.com/BNU-IVC/MMGait.
title MMGait: Towards Multi-Modal Gait Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2604.15979