Image de couverture de livre

Deep Fusion: Capturing Dependencies in Contrastive Learning via Transformer Projection Heads

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Li, Huanran, Pimentel-Alarcón, Daniel
Format:	Preprint
Publié:	2024
Sujets:	Machine Learning Artificial Intelligence
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Preventing Collapse in Contrastive Learning with Orthonormal Prototypes (CLOP)
par: Li, Huanran, et autres
Publié: (2024)

High Rank Matrix Completion via Grassmannian Proxy Fusion
par: Li, Huanran, et autres
Publié: (2026)

Subspace Clustering on Incomplete Data with Self-Supervised Contrastive Learning
par: Li, Huanran, et autres
Publié: (2026)

Semi-Supervised Contrastive Learning with Orthonormal Prototypes
par: Li, Huanran, et autres
Publié: (2025)

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion
par: Chen, Yilong, et autres
Publié: (2024)

DN-CL: Deep Symbolic Regression against Noise via Contrastive Learning
par: Liu, Jingyi, et autres
Publié: (2024)

ASPECT: Node-Level Adaptive Spectral Fusion for Graph Contrastive Learning
par: Li, Zhuolong, et autres
Publié: (2026)

Watch Your Head: Assembling Projection Heads to Save the Reliability of Federated Models
par: Chen, Jinqian, et autres
Publié: (2024)

Deep Contrastive Graph Learning with Clustering-Oriented Guidance
par: Chen, Mulin, et autres
Publié: (2024)

Alignment Dynamics in LLM Fine-Tuning
par: Huang, Yuhan, et autres
Publié: (2026)

The Weight Gram Matrix Captures Sequential Feature Linearization in Deep Networks
par: Cha, Taehun, et autres
Publié: (2026)

Differentiation and Specialization of Attention Heads via the Refined Local Learning Coefficient
par: Wang, George, et autres
Publié: (2024)

Dual-perspective Cross Contrastive Learning in Graph Transformers
par: Yao, Zelin, et autres
Publié: (2024)

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection
par: Shen, Yixian, et autres
Publié: (2024)

MaCP: Minimal yet Mighty Adaptation via Hierarchical Cosine Projection
par: Shen, Yixian, et autres
Publié: (2025)

Time Series Representation Learning with Supervised Contrastive Temporal Transformer
par: Liu, Yuansan, et autres
Publié: (2024)

Harnessing Contrastive Learning and Neural Transformation for Time Series Anomaly Detection
par: Chen, Katrina, et autres
Publié: (2023)

Brain Network Classification Based on Graph Contrastive Learning and Graph Transformer
par: Zhu, ZhiTeng, et autres
Publié: (2025)

MVCL-DAF++: Enhancing Multimodal Intent Recognition via Prototype-Aware Contrastive Alignment and Coarse-to-Fine Dynamic Attention Fusion
par: Huang, Haofeng, et autres
Publié: (2025)

Deep Learning for Cross-Domain Data Fusion in Urban Computing: Taxonomy, Advances, and Outlook
par: Zou, Xingchen, et autres
Publié: (2024)

Contrastive Learning and Abstract Concepts: The Case of Natural Numbers
par: Nissani, Daniel N.
Publié: (2024)

Federated Continual Learning via Knowledge Fusion: A Survey
par: Yang, Xin, et autres
Publié: (2023)

Bypassing the Exponential Dependency: Looped Transformers Efficiently Learn In-context by Multi-step Gradient Descent
par: Chen, Bo, et autres
Publié: (2024)

DeepCell: Self-Supervised Multiview Fusion for Circuit Representation Learning
par: Shi, Zhengyuan, et autres
Publié: (2025)

Pruning-based Data Selection and Network Fusion for Efficient Deep Learning
par: Kousar, Humaira, et autres
Publié: (2025)

Reliable Unlearning Harmful Information in LLMs with Metamorphosis Representation Projection
par: Wu, Chengcan, et autres
Publié: (2025)

Enhancing Adversarial Robustness of Deep Neural Networks Through Supervised Contrastive Learning
par: Wang, Longwei, et autres
Publié: (2024)

Deep Variational Contrastive Learning for Joint Risk Stratification and Time-to-Event Estimation
par: Erbil, Pinar, et autres
Publié: (2026)

GRE^2-MDCL: Graph Representation Embedding Enhanced via Multidimensional Contrastive Learning
par: Fan, Kaizhe, et autres
Publié: (2024)

Multivariate Time Series Anomaly Detection by Capturing Coarse-Grained Intra- and Inter-Variate Dependencies
par: Xie, Yongzheng, et autres
Publié: (2025)

Semi-Supervised Federated Learning via Dual Contrastive Learning and Soft Labeling for Intelligent Fault Diagnosis
par: Dai, Yajiao, et autres
Publié: (2025)

A Systematic Review of Intermediate Fusion in Multimodal Deep Learning for Biomedical Applications
par: Guarrasi, Valerio, et autres
Publié: (2024)

Robust Adversarial Quantification via Conflict-Aware Evidential Deep Learning
par: Barker, Charmaine, et autres
Publié: (2025)

ProtoECGNet: Case-Based Interpretable Deep Learning for Multi-Label ECG Classification with Contrastive Learning
par: Sethi, Sahil, et autres
Publié: (2025)

Positive Unlabeled Contrastive Learning
par: Acharya, Anish, et autres
Publié: (2022)

Energy-Efficient Deep Reinforcement Learning with Spiking Transformers
par: Uddin, Mohammad Irfan, et autres
Publié: (2025)

A Survey of Deep Learning: From Activations to Transformers
par: Schneider, Johannes, et autres
Publié: (2023)

Smoothed Graph Contrastive Learning via Seamless Proximity Integration
par: Behmanesh, Maysam, et autres
Publié: (2024)

Contrastive Learning Via Equivariant Representation
par: Song, Sifan, et autres
Publié: (2024)

Learning to Model Graph Structural Information on MLPs via Graph Structure Self-Contrasting
par: Wu, Lirong, et autres
Publié: (2024)