Multivariate Temporal Regression at Scale: A Three-Pillar Framework Combining ML, XAI, and NLP

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Francis, Jiztom Kavalakkatt, Darr, Matthew J
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866916781625442304
author Francis, Jiztom Kavalakkatt
Darr, Matthew J
author_facet Francis, Jiztom Kavalakkatt
Darr, Matthew J
contents This paper introduces a novel framework that accelerates the discovery of actionable relationships in high-dimensional temporal data by integrating machine learning (ML), explainable AI (XAI), and natural language processing (NLP) to enhance data quality and streamline workflows. Traditional methods often fail to recognize complex temporal relationships, leading to noisy, redundant, or biased datasets. Our approach combines ML-driven pruning to identify and mitigate low-quality samples, XAI-based interpretability to validate critical feature interactions, and NLP for future contextual validation, reducing the time required to uncover actionable insights by 40-60%. Evaluated on real-world agricultural and synthetic datasets, the framework significantly improves performance metrics (e.g., MSE, R2, MAE) and computational efficiency, with hardware-agnostic scalability across diverse platforms. While long-term real-world impacts (e.g., cost savings, sustainability gains) are pending, this methodology provides an immediate pathway to accelerate data-centric AI in dynamic domains like agriculture and energy, enabling faster iteration cycles for domain experts.
format Preprint
id arxiv_https___arxiv_org_abs_2504_02151
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Multivariate Temporal Regression at Scale: A Three-Pillar Framework Combining ML, XAI, and NLP
Francis, Jiztom Kavalakkatt
Darr, Matthew J
Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
This paper introduces a novel framework that accelerates the discovery of actionable relationships in high-dimensional temporal data by integrating machine learning (ML), explainable AI (XAI), and natural language processing (NLP) to enhance data quality and streamline workflows. Traditional methods often fail to recognize complex temporal relationships, leading to noisy, redundant, or biased datasets. Our approach combines ML-driven pruning to identify and mitigate low-quality samples, XAI-based interpretability to validate critical feature interactions, and NLP for future contextual validation, reducing the time required to uncover actionable insights by 40-60%. Evaluated on real-world agricultural and synthetic datasets, the framework significantly improves performance metrics (e.g., MSE, R2, MAE) and computational efficiency, with hardware-agnostic scalability across diverse platforms. While long-term real-world impacts (e.g., cost savings, sustainability gains) are pending, this methodology provides an immediate pathway to accelerate data-centric AI in dynamic domains like agriculture and energy, enabling faster iteration cycles for domain experts.
title Multivariate Temporal Regression at Scale: A Three-Pillar Framework Combining ML, XAI, and NLP
topic Machine Learning
Artificial Intelligence
Computer Vision and Pattern Recognition
url https://arxiv.org/abs/2504.02151