Saved in:
Bibliographic Details
Main Authors: Nishat, Shanjid Hasan, Deb, Srabonti, Ahmed, Mohiuddin
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2509.02511
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909829507842048
author Nishat, Shanjid Hasan
Deb, Srabonti
Ahmed, Mohiuddin
author_facet Nishat, Shanjid Hasan
Deb, Srabonti
Ahmed, Mohiuddin
contents Fitness movement recognition, a focused subdomain of human activity recognition (HAR), plays a vital role in health monitoring, rehabilitation, and personalized fitness training by enabling automated exercise classification from video data. However, many existing deep learning approaches rely on computationally intensive 3D models, limiting their feasibility in real-time or resource-constrained settings. In this paper, we present a lightweight and effective framework that integrates pre-trained 2D Convolutional Neural Networks (CNNs) such as ResNet50, EfficientNet, and Vision Transformers (ViT) with a Long Short-Term Memory (LSTM) network enhanced by spatial attention. These models efficiently extract spatial features while the LSTM captures temporal dependencies, and the attention mechanism emphasizes informative segments. We evaluate the framework on a curated subset of the UCF101 dataset, achieving a peak accuracy of 93.34\% with the ResNet50-based configuration. Comparative results demonstrate the superiority of our approach over several state-of-the-art HAR systems. The proposed method offers a scalable and real-time-capable solution for fitness activity recognition with broader applications in vision-based health and activity monitoring.
format Preprint
id arxiv_https___arxiv_org_abs_2509_02511
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Enhancing Fitness Movement Recognition with Attention Mechanism and Pre-Trained Feature Extractors
Nishat, Shanjid Hasan
Deb, Srabonti
Ahmed, Mohiuddin
Computer Vision and Pattern Recognition
Fitness movement recognition, a focused subdomain of human activity recognition (HAR), plays a vital role in health monitoring, rehabilitation, and personalized fitness training by enabling automated exercise classification from video data. However, many existing deep learning approaches rely on computationally intensive 3D models, limiting their feasibility in real-time or resource-constrained settings. In this paper, we present a lightweight and effective framework that integrates pre-trained 2D Convolutional Neural Networks (CNNs) such as ResNet50, EfficientNet, and Vision Transformers (ViT) with a Long Short-Term Memory (LSTM) network enhanced by spatial attention. These models efficiently extract spatial features while the LSTM captures temporal dependencies, and the attention mechanism emphasizes informative segments. We evaluate the framework on a curated subset of the UCF101 dataset, achieving a peak accuracy of 93.34\% with the ResNet50-based configuration. Comparative results demonstrate the superiority of our approach over several state-of-the-art HAR systems. The proposed method offers a scalable and real-time-capable solution for fitness activity recognition with broader applications in vision-based health and activity monitoring.
title Enhancing Fitness Movement Recognition with Attention Mechanism and Pre-Trained Feature Extractors
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2509.02511