Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?

Fuente: arXiv
Saved in:
Bibliographic Details
Main Authors: Fujimura, Takuya, Dohi, Kota, Yamashita, Natsuo, Kawaguchi, Yohei
Format: Preprint
Published: 2025
Subjects:
Online Access:
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866918151419068416
author Fujimura, Takuya
Dohi, Kota
Yamashita, Natsuo
Kawaguchi, Yohei
author_facet Fujimura, Takuya
Dohi, Kota
Yamashita, Natsuo
Kawaguchi, Yohei
contents Time-series question answering (TSQA) tasks face significant challenges due to the lack of labeled data. Alternatively, with recent advancements in large-scale models, vision-language models (VLMs) have demonstrated the potential to analyze time-series signals in a zero-shot manner. In this paper, we propose a training approach that uses pseudo labels generated by a VLM. Although VLMs can produce incorrect labels, TSQA models can still be effectively trained based on the property that deep neural networks are inherently robust to such noisy labels. Our experimental results demonstrate that TSQA models are not only successfully trained with pseudo labels, but also surpass the performance of the VLM itself by leveraging a large amount of unlabeled data.
format Preprint
id arxiv_https___arxiv_org_abs_2509_25696
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?
Fujimura, Takuya
Dohi, Kota
Yamashita, Natsuo
Kawaguchi, Yohei
Machine Learning
Computation and Language
Signal Processing
Time-series question answering (TSQA) tasks face significant challenges due to the lack of labeled data. Alternatively, with recent advancements in large-scale models, vision-language models (VLMs) have demonstrated the potential to analyze time-series signals in a zero-shot manner. In this paper, we propose a training approach that uses pseudo labels generated by a VLM. Although VLMs can produce incorrect labels, TSQA models can still be effectively trained based on the property that deep neural networks are inherently robust to such noisy labels. Our experimental results demonstrate that TSQA models are not only successfully trained with pseudo labels, but also surpass the performance of the VLM itself by leveraging a large amount of unlabeled data.
title Can VLM Pseudo-Labels Train a Time-Series QA Model That Outperforms the VLM?
topic Machine Learning
Computation and Language
Signal Processing
url https://arxiv.org/abs/2509.25696