Evaluating Rank-N-Contrast: Continuous and Robust Representations for Regression

Fuente: arXiv
Enregistré dans:
Détails bibliographiques
Auteurs principaux: Six, Valentin, Chidiac, Alexandre, Worlikar, Arkin
Format: Preprint
Publié: 2024
Sujets:
Accès en ligne:
Tags: Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
_version_ 1866909655000678400
author Six, Valentin
Chidiac, Alexandre
Worlikar, Arkin
author_facet Six, Valentin
Chidiac, Alexandre
Worlikar, Arkin
contents This document is an evaluation of the original "Rank-N-Contrast" (arXiv:2210.01189v2) paper published in 2023. This evaluation is done for academic purposes. Deep regression models often fail to capture the continuous nature of sample orders, creating fragmented representations and suboptimal performance. To address this, we reproduced the Rank-N-Contrast (RNC) framework, which learns continuous representations by contrasting samples by their rankings in the target space. Our study validates RNC's theoretical and empirical benefits, including improved performance and robustness. We extended the evaluation to an additional regression dataset and conducted robustness tests using a holdout method, where a specific range of continuous data was excluded from the training set. This approach assessed the model's ability to generalize to unseen data and achieve state-of-the-art performance. This replication study validates the original findings and broadens the understanding of RNC's applicability and robustness.
format Preprint
id arxiv_https___arxiv_org_abs_2411_16298
institution arXiv
publishDate 2024
record_format arxiv
spellingShingle Evaluating Rank-N-Contrast: Continuous and Robust Representations for Regression
Six, Valentin
Chidiac, Alexandre
Worlikar, Arkin
Machine Learning
This document is an evaluation of the original "Rank-N-Contrast" (arXiv:2210.01189v2) paper published in 2023. This evaluation is done for academic purposes. Deep regression models often fail to capture the continuous nature of sample orders, creating fragmented representations and suboptimal performance. To address this, we reproduced the Rank-N-Contrast (RNC) framework, which learns continuous representations by contrasting samples by their rankings in the target space. Our study validates RNC's theoretical and empirical benefits, including improved performance and robustness. We extended the evaluation to an additional regression dataset and conducted robustness tests using a holdout method, where a specific range of continuous data was excluded from the training set. This approach assessed the model's ability to generalize to unseen data and achieve state-of-the-art performance. This replication study validates the original findings and broadens the understanding of RNC's applicability and robustness.
title Evaluating Rank-N-Contrast: Continuous and Robust Representations for Regression
topic Machine Learning
url https://arxiv.org/abs/2411.16298