HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Su, Yiyang, Shi, Yunping, Liu, Feng, Liu, Xiaoming
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909754513686528
author Su, Yiyang
Shi, Yunping
Liu, Feng
Liu, Xiaoming
author_facet Su, Yiyang
Shi, Yunping
Liu, Feng
Liu, Xiaoming
contents Recently, research interest in person re-identification (ReID) has increasingly focused on video-based scenarios, which are essential for robust surveillance and security in varied and dynamic environments. However, existing video-based ReID methods often overlook the necessity of identifying and selecting the most discriminative features from both videos in a query-gallery pair for effective matching. To address this issue, we propose a novel Hierarchical and Adaptive Mixture of Biometric Experts (HAMoBE) framework, which leverages multi-layer features from a pre-trained large model (e.g., CLIP) and is designed to mimic human perceptual mechanisms by independently modeling key biometric features--appearance, static body shape, and dynamic gait--and adaptively integrating them. Specifically, HAMoBE includes two levels: the first level extracts low-level features from multi-layer representations provided by the frozen large model, while the second level consists of specialized experts focusing on long-term, short-term, and temporal features. To ensure robust matching, we introduce a new dual-input decision gating network that dynamically adjusts the contributions of each expert based on their relevance to the input scenarios. Extensive evaluations on benchmarks like MEVID demonstrate that our approach yields significant performance improvements (e.g., +13.0% Rank-1 accuracy).
format Preprint
id arxiv_https___arxiv_org_abs_2508_05038
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID
Su, Yiyang
Shi, Yunping
Liu, Feng
Liu, Xiaoming
Computer Vision and Pattern Recognition
Recently, research interest in person re-identification (ReID) has increasingly focused on video-based scenarios, which are essential for robust surveillance and security in varied and dynamic environments. However, existing video-based ReID methods often overlook the necessity of identifying and selecting the most discriminative features from both videos in a query-gallery pair for effective matching. To address this issue, we propose a novel Hierarchical and Adaptive Mixture of Biometric Experts (HAMoBE) framework, which leverages multi-layer features from a pre-trained large model (e.g., CLIP) and is designed to mimic human perceptual mechanisms by independently modeling key biometric features--appearance, static body shape, and dynamic gait--and adaptively integrating them. Specifically, HAMoBE includes two levels: the first level extracts low-level features from multi-layer representations provided by the frozen large model, while the second level consists of specialized experts focusing on long-term, short-term, and temporal features. To ensure robust matching, we introduce a new dual-input decision gating network that dynamically adjusts the contributions of each expert based on their relevance to the input scenarios. Extensive evaluations on benchmarks like MEVID demonstrate that our approach yields significant performance improvements (e.g., +13.0% Rank-1 accuracy).
title HAMoBE: Hierarchical and Adaptive Mixture of Biometric Experts for Video-based Person ReID
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2508.05038