REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learning
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866914991249031168 |
|---|---|
| author | Xu, Maxwell A. Moreno, Alexander Wei, Hui Marlin, Benjamin M. Rehg, James M. |
| author_facet | Xu, Maxwell A. Moreno, Alexander Wei, Hui Marlin, Benjamin M. Rehg, James M. |
| contents | The success of self-supervised contrastive learning hinges on identifying positive data pairs, such that when they are pushed together in embedding space, the space encodes useful information for subsequent downstream tasks. Constructing positive pairs is non-trivial as the pairing must be similar enough to reflect a shared semantic meaning, but different enough to capture within-class variation. Classical approaches in vision use augmentations to exploit well-established invariances to construct positive pairs, but invariances in the time-series domain are much less obvious. In our work, we propose a novel method of using a learned measure for identifying positive pairs. Our Retrieval-Based Reconstruction (REBAR) measure measures the similarity between two sequences as the reconstruction error that results from reconstructing one sequence with retrieved information from the other. Then, if the two sequences have high REBAR similarity, we label them as a positive pair. Through validation experiments, we show that the REBAR error is a predictor of mutual class membership. Once integrated into a contrastive learning framework, our REBAR method learns an embedding that achieves state-of-the-art performance on downstream tasks across various modalities. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2311_00519 |
| institution | arXiv |
| publishDate | 2023 |
| record_format | arxiv |
| spellingShingle | REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learning Xu, Maxwell A. Moreno, Alexander Wei, Hui Marlin, Benjamin M. Rehg, James M. Machine Learning The success of self-supervised contrastive learning hinges on identifying positive data pairs, such that when they are pushed together in embedding space, the space encodes useful information for subsequent downstream tasks. Constructing positive pairs is non-trivial as the pairing must be similar enough to reflect a shared semantic meaning, but different enough to capture within-class variation. Classical approaches in vision use augmentations to exploit well-established invariances to construct positive pairs, but invariances in the time-series domain are much less obvious. In our work, we propose a novel method of using a learned measure for identifying positive pairs. Our Retrieval-Based Reconstruction (REBAR) measure measures the similarity between two sequences as the reconstruction error that results from reconstructing one sequence with retrieved information from the other. Then, if the two sequences have high REBAR similarity, we label them as a positive pair. Through validation experiments, we show that the REBAR error is a predictor of mutual class membership. Once integrated into a contrastive learning framework, our REBAR method learns an embedding that achieves state-of-the-art performance on downstream tasks across various modalities. |
| title | REBAR: Retrieval-Based Reconstruction for Time-series Contrastive Learning |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2311.00519 |