TabDeco: A Comprehensive Contrastive Framework for Decoupled Representations in Tabular Data
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2024
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866909394260721664 |
|---|---|
| author | Chen, Suiyao Wu, Jing Wang, Yunxiao Ji, Cheng Xie, Tianpei Cociorva, Daniel Sharps, Michael Levasseur, Cecile Brunzell, Hakan |
| author_facet | Chen, Suiyao Wu, Jing Wang, Yunxiao Ji, Cheng Xie, Tianpei Cociorva, Daniel Sharps, Michael Levasseur, Cecile Brunzell, Hakan |
| contents | Representation learning is a fundamental aspect of modern artificial intelligence, driving substantial improvements across diverse applications. While selfsupervised contrastive learning has led to significant advancements in fields like computer vision and natural language processing, its adaptation to tabular data presents unique challenges. Traditional approaches often prioritize optimizing model architecture and loss functions but may overlook the crucial task of constructing meaningful positive and negative sample pairs from various perspectives like feature interactions, instance-level patterns and batch-specific contexts. To address these challenges, we introduce TabDeco, a novel method that leverages attention-based encoding strategies across both rows and columns and employs contrastive learning framework to effectively disentangle feature representations at multiple levels, including features, instances and data batches. With the innovative feature decoupling hierarchies, TabDeco consistently surpasses existing deep learning methods and leading gradient boosting algorithms, including XG-Boost, CatBoost, and LightGBM, across various benchmark tasks, underscoring its effectiveness in advancing tabular data representation learning. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_11148 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | TabDeco: A Comprehensive Contrastive Framework for Decoupled Representations in Tabular Data Chen, Suiyao Wu, Jing Wang, Yunxiao Ji, Cheng Xie, Tianpei Cociorva, Daniel Sharps, Michael Levasseur, Cecile Brunzell, Hakan Machine Learning Artificial Intelligence Representation learning is a fundamental aspect of modern artificial intelligence, driving substantial improvements across diverse applications. While selfsupervised contrastive learning has led to significant advancements in fields like computer vision and natural language processing, its adaptation to tabular data presents unique challenges. Traditional approaches often prioritize optimizing model architecture and loss functions but may overlook the crucial task of constructing meaningful positive and negative sample pairs from various perspectives like feature interactions, instance-level patterns and batch-specific contexts. To address these challenges, we introduce TabDeco, a novel method that leverages attention-based encoding strategies across both rows and columns and employs contrastive learning framework to effectively disentangle feature representations at multiple levels, including features, instances and data batches. With the innovative feature decoupling hierarchies, TabDeco consistently surpasses existing deep learning methods and leading gradient boosting algorithms, including XG-Boost, CatBoost, and LightGBM, across various benchmark tasks, underscoring its effectiveness in advancing tabular data representation learning. |
| title | TabDeco: A Comprehensive Contrastive Framework for Decoupled Representations in Tabular Data |
| topic | Machine Learning Artificial Intelligence |
| url | https://arxiv.org/abs/2411.11148 |