Saved in:
Bibliographic Details
Main Authors: Ferrero, Mariano, Chelotti, José Omar, Martinez-Rau, Luciano Sebastián, Vignolo, Leandro, Pires, Martín, Galli, Julio Ricardo, Giovanini, Leonardo Luis, Rufiner, Hugo Leonardo
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2505.10198
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916737537015808
author Ferrero, Mariano
Chelotti, José Omar
Martinez-Rau, Luciano Sebastián
Vignolo, Leandro
Pires, Martín
Galli, Julio Ricardo
Giovanini, Leonardo Luis
Rufiner, Hugo Leonardo
author_facet Ferrero, Mariano
Chelotti, José Omar
Martinez-Rau, Luciano Sebastián
Vignolo, Leandro
Pires, Martín
Galli, Julio Ricardo
Giovanini, Leonardo Luis
Rufiner, Hugo Leonardo
contents Monitoring feeding behaviour is a relevant task for efficient herd management and the effective use of available resources in grazing cattle. The ability to automatically recognise animals' feeding activities through the identification of specific jaw movements allows for the improvement of diet formulation, as well as early detection of metabolic problems and symptoms of animal discomfort, among other benefits. The use of sensors to obtain signals for such monitoring has become popular in the last two decades. The most frequently employed sensors include accelerometers, microphones, and cameras, each with its own set of advantages and drawbacks. An unexplored aspect is the simultaneous use of multiple sensors with the aim of combining signals in order to enhance the precision of the estimations. In this direction, this work introduces a deep neural network based on the fusion of acoustic and inertial signals, composed of convolutional, recurrent, and dense layers. The main advantage of this model is the combination of signals through the automatic extraction of features independently from each of them. The model has emerged from an exploration and comparison of different neural network architectures proposed in this work, which carry out information fusion at different levels. Feature-level fusion has outperformed data and decision-level fusion by at least a 0.14 based on the F1-score metric. Moreover, a comparison with state-of-the-art machine learning methods is presented, including traditional and deep learning approaches. The proposed model yielded an F1-score value of 0.802, representing a 14% increase compared to previous methods. Finally, results from an ablation study and post-training quantization evaluation are also reported.
format Preprint
id arxiv_https___arxiv_org_abs_2505_10198
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle A multi-head deep fusion model for recognition of cattle foraging events using sound and movement signals
Ferrero, Mariano
Chelotti, José Omar
Martinez-Rau, Luciano Sebastián
Vignolo, Leandro
Pires, Martín
Galli, Julio Ricardo
Giovanini, Leonardo Luis
Rufiner, Hugo Leonardo
Machine Learning
Monitoring feeding behaviour is a relevant task for efficient herd management and the effective use of available resources in grazing cattle. The ability to automatically recognise animals' feeding activities through the identification of specific jaw movements allows for the improvement of diet formulation, as well as early detection of metabolic problems and symptoms of animal discomfort, among other benefits. The use of sensors to obtain signals for such monitoring has become popular in the last two decades. The most frequently employed sensors include accelerometers, microphones, and cameras, each with its own set of advantages and drawbacks. An unexplored aspect is the simultaneous use of multiple sensors with the aim of combining signals in order to enhance the precision of the estimations. In this direction, this work introduces a deep neural network based on the fusion of acoustic and inertial signals, composed of convolutional, recurrent, and dense layers. The main advantage of this model is the combination of signals through the automatic extraction of features independently from each of them. The model has emerged from an exploration and comparison of different neural network architectures proposed in this work, which carry out information fusion at different levels. Feature-level fusion has outperformed data and decision-level fusion by at least a 0.14 based on the F1-score metric. Moreover, a comparison with state-of-the-art machine learning methods is presented, including traditional and deep learning approaches. The proposed model yielded an F1-score value of 0.802, representing a 14% increase compared to previous methods. Finally, results from an ablation study and post-training quantization evaluation are also reported.
title A multi-head deep fusion model for recognition of cattle foraging events using sound and movement signals
topic Machine Learning
url https://arxiv.org/abs/2505.10198