Quantifying Uncertainty in Machine Learning-Based Pervasive Systems: Application to Human Activity Recognition

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Balditsyn, Vladimir, Lalanda, Philippe, Vega, German, Chollet, Stéphanie
Format: Preprint
Publié: 2025
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866912756947484672
author Balditsyn, Vladimir
Lalanda, Philippe
Vega, German
Chollet, Stéphanie
author_facet Balditsyn, Vladimir
Lalanda, Philippe
Vega, German
Chollet, Stéphanie
contents The recent convergence of pervasive computing and machine learning has given rise to numerous services, impacting almost all areas of economic and social activity. However, the use of AI techniques precludes certain standard software development practices, which emphasize rigorous testing to ensure the elimination of all bugs and adherence to well-defined specifications. ML models are trained on numerous high-dimensional examples rather than being manually coded. Consequently, the boundaries of their operating range are uncertain, and they cannot guarantee absolute error-free performance. In this paper, we propose to quantify uncertainty in ML-based systems. To achieve this, we propose to adapt and jointly utilize a set of selected techniques to evaluate the relevance of model predictions at runtime. We apply and evaluate these proposals in the highly heterogeneous and evolving domain of Human Activity Recognition (HAR). The results presented demonstrate the relevance of the approach, and we discuss in detail the assistance provided to domain experts.
format Preprint
id arxiv_https___arxiv_org_abs_2512_09775
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Quantifying Uncertainty in Machine Learning-Based Pervasive Systems: Application to Human Activity Recognition
Balditsyn, Vladimir
Lalanda, Philippe
Vega, German
Chollet, Stéphanie
Software Engineering
Artificial Intelligence
The recent convergence of pervasive computing and machine learning has given rise to numerous services, impacting almost all areas of economic and social activity. However, the use of AI techniques precludes certain standard software development practices, which emphasize rigorous testing to ensure the elimination of all bugs and adherence to well-defined specifications. ML models are trained on numerous high-dimensional examples rather than being manually coded. Consequently, the boundaries of their operating range are uncertain, and they cannot guarantee absolute error-free performance. In this paper, we propose to quantify uncertainty in ML-based systems. To achieve this, we propose to adapt and jointly utilize a set of selected techniques to evaluate the relevance of model predictions at runtime. We apply and evaluate these proposals in the highly heterogeneous and evolving domain of Human Activity Recognition (HAR). The results presented demonstrate the relevance of the approach, and we discuss in detail the assistance provided to domain experts.
title Quantifying Uncertainty in Machine Learning-Based Pervasive Systems: Application to Human Activity Recognition
topic Software Engineering
Artificial Intelligence
url https://arxiv.org/abs/2512.09775