Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Feng, Yuhu, Maeda, Keisuke, Ogawa, Takahiro, Haseyama, Miki
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915172197597184
author Feng, Yuhu
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
author_facet Feng, Yuhu
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
contents Egocentric video gaze estimation requires models to capture individual gaze patterns while adapting to diverse user data. Our approach leverages a transformer-based architecture, integrating it into a PFL framework where only the most significant parameters, those exhibiting the highest rate of change during training, are selected and frozen for personalization in client models. Through extensive experimentation on the EGTEA Gaze+ and Ego4D datasets, we demonstrate that FedCPF significantly outperforms previously reported federated learning methods, achieving superior recall, precision, and F1-score. These results confirm the effectiveness of our comprehensive parameters freezing strategy in enhancing model personalization, making FedCPF a promising approach for tasks requiring both adaptability and accuracy in federated learning settings.
format Preprint
id arxiv_https___arxiv_org_abs_2502_18123
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing
Feng, Yuhu
Maeda, Keisuke
Ogawa, Takahiro
Haseyama, Miki
Computer Vision and Pattern Recognition
Egocentric video gaze estimation requires models to capture individual gaze patterns while adapting to diverse user data. Our approach leverages a transformer-based architecture, integrating it into a PFL framework where only the most significant parameters, those exhibiting the highest rate of change during training, are selected and frozen for personalization in client models. Through extensive experimentation on the EGTEA Gaze+ and Ego4D datasets, we demonstrate that FedCPF significantly outperforms previously reported federated learning methods, achieving superior recall, precision, and F1-score. These results confirm the effectiveness of our comprehensive parameters freezing strategy in enhancing model personalization, making FedCPF a promising approach for tasks requiring both adaptability and accuracy in federated learning settings.
title Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing
topic Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2502.18123