On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Cosma, Adrian, Cǎtrunǎ, Andy, Rǎdoi, Emilian
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866912319567560704
author Cosma, Adrian
Cǎtrunǎ, Andy
Rǎdoi, Emilian
author_facet Cosma, Adrian
Cǎtrunǎ, Andy
Rǎdoi, Emilian
contents Gait recognition from video streams is a challenging problem in computer vision biometrics due to the subtle differences between gaits and numerous confounding factors. Recent advancements in self-supervised pretraining have led to the development of robust gait recognition models that are invariant to walking covariates. While neural scaling laws have transformed model development in other domains by linking performance to data, model size, and compute, their applicability to gait remains unexplored. In this work, we conduct the first empirical study scaling on skeleton-based self-supervised gait recognition to quantify the effect of data quantity, model size and compute on downstream gait recognition performance. We pretrain multiple variants of GaitPT - a transformer-based architecture - on a dataset of 2.7 million walking sequences collected in the wild. We evaluate zero-shot performance across four benchmark datasets to derive scaling laws for data, model size, and compute. Our findings demonstrate predictable power-law improvements in performance with increased scale and confirm that data and compute scaling significantly influence downstream accuracy. We further isolate architectural contributions by comparing GaitPT with GaitFormer under controlled compute budgets. These results provide practical insights into resource allocation and performance estimation for real-world gait recognition systems.
format Preprint
id arxiv_https___arxiv_org_abs_2504_07598
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition
Cosma, Adrian
Cǎtrunǎ, Andy
Rǎdoi, Emilian
Computer Vision and Pattern Recognition
Gait recognition from video streams is a challenging problem in computer vision biometrics due to the subtle differences between gaits and numerous confounding factors. Recent advancements in self-supervised pretraining have led to the development of robust gait recognition models that are invariant to walking covariates. While neural scaling laws have transformed model development in other domains by linking performance to data, model size, and compute, their applicability to gait remains unexplored. In this work, we conduct the first empirical study scaling on skeleton-based self-supervised gait recognition to quantify the effect of data quantity, model size and compute on downstream gait recognition performance. We pretrain multiple variants of GaitPT - a transformer-based architecture - on a dataset of 2.7 million walking sequences collected in the wild. We evaluate zero-shot performance across four benchmark datasets to derive scaling laws for data, model size, and compute. Our findings demonstrate predictable power-law improvements in performance with increased scale and confirm that data and compute scaling significantly influence downstream accuracy. We further isolate architectural contributions by comparing GaitPT with GaitFormer under controlled compute budgets. These results provide practical insights into resource allocation and performance estimation for real-world gait recognition systems.
title On Model and Data Scaling for Skeleton-based Self-Supervised Gait Recognition
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.07598