Cover Image

Investigating the Benefits of Projection Head for Representation Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Xue, Yihao, Gan, Eric, Ni, Jiayi, Joshi, Siddharth, Mirzasoleiman, Baharan
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Data-Efficient Contrastive Language-Image Pretraining: Prioritizing Data Quality over Quantity
by: Joshi, Siddharth, et al.
Published: (2024)

Few-shot Adaptation to Distribution Shifts By Mixing Source and Target Embeddings
by: Xue, Yihao, et al.
Published: (2023)

Identifying Spurious Biases Early in Training through the Lens of Simplicity Bias
by: Yang, Yu, et al.
Published: (2023)

Changing the Training Data Distribution to Reduce Simplicity Bias Improves In-distribution Generalization
by: Nguyen, Dang, et al.
Published: (2024)

MM-GEN: Enhancing Task Performance Through Targeted Multimodal Data Curation
by: Joshi, Siddharth, et al.
Published: (2025)

Do We Need All the Synthetic Data? Targeted Image Augmentation via Diffusion Models
by: Nguyen, Dang, et al.
Published: (2025)

Dataset Distillation via Knowledge Distillation: Towards Efficient Self-Supervised Pre-Training of Deep Networks
by: Joshi, Siddharth, et al.
Published: (2024)

Better Safe than Sorry: Pre-training CLIP against Targeted Data Poisoning and Backdoor Attacks
by: Yang, Wenhan, et al.
Published: (2023)

Understanding the Robustness of Multi-modal Contrastive Learning to Distribution Shift
by: Xue, Yihao, et al.
Published: (2023)

Data Selection for Fine-tuning Vision Language Models via Cross Modal Alignment Trajectories
by: Naharas, Nilay, et al.
Published: (2025)

Data-Efficient Contrastive Self-supervised Learning: Most Beneficial Examples for Supervised Learning Contribute the Least
by: Joshi, Siddharth, et al.
Published: (2023)

Investigating the Impact of Model Width and Density on Generalization in Presence of Label Noise
by: Xue, Yihao, et al.
Published: (2022)

Representations Shape Weak-to-Strong Generalization: Theoretical Insights and Empirical Predictions
by: Xue, Yihao, et al.
Published: (2025)

Challenges and Opportunities in Improving Worst-Group Generalization in Presence of Spurious Features
by: Joshi, Siddharth, et al.
Published: (2023)

When Does Perceptual Alignment Benefit Vision Representations?
by: Sundaram, Shobhita, et al.
Published: (2024)

Investigating Permutation-Invariant Discrete Representation Learning for Spatially Aligned Images
by: Stirling, Jamie S. J., et al.
Published: (2026)

ProFeAT: Projected Feature Adversarial Training for Self-Supervised Learning of Robust Representations
by: Addepalli, Sravanti, et al.
Published: (2024)

Generalizable Blood Cell Detection via Unified Dataset and Faster R-CNN
by: Sahay, Siddharth
Published: (2025)

FORLA: Federated Object-centric Representation Learning with Slot Attention
by: Liao, Guiqiu, et al.
Published: (2025)

Learning Representations on the Unit Sphere: Investigating Angular Gaussian and von Mises-Fisher Distributions for Online Continual Learning
by: Michel, Nicolas, et al.
Published: (2023)

Do Pre-trained Models Benefit Equally in Continual Learning?
by: Lee, Kuan-Ying, et al.
Published: (2022)

TRAJGANR: Trajectory-Centric Urban Multimodal Learning via Geospatially Aligned Neural Representations
by: Siampou, Maria Despoina, et al.
Published: (2026)

GD doesn't make the cut: Three ways that non-differentiability affects neural network training
by: Kumar, Siddharth Krishna
Published: (2024)

LT-Soups: Bridging Head and Tail Classes via Subsampled Model Soups
by: Aminbeidokhti, Masih, et al.
Published: (2025)

Semi-Supervised Learning with Multi-Head Co-Training
by: Chen, Mingcai, et al.
Published: (2021)

Preview-based Category Contrastive Learning for Knowledge Distillation
by: Ding, Muhe, et al.
Published: (2024)

AutoRegressive Generation with B-rep Holistic Token Sequence Representation
by: Li, Jiahao, et al.
Published: (2026)

An Investigation into Pre-Training Object-Centric Representations for Reinforcement Learning
by: Yoon, Jaesik, et al.
Published: (2023)

Dual-Head Knowledge Distillation: Enhancing Logits Utilization with an Auxiliary Head
by: Yang, Penghui, et al.
Published: (2024)

Matryoshka Representation Learning
by: Kusupati, Aditya, et al.
Published: (2022)

Random Representations Outperform Online Continually Learned Representations
by: Prabhu, Ameya, et al.
Published: (2024)

Age-Diverse Deepfake Dataset: Bridging the Age Gap in Deepfake Detection
by: Joshi, Unisha
Published: (2025)

Research on Image Recognition Technology Based on Multimodal Deep Learning
by: Wang, Jinyin, et al.
Published: (2024)

A Fast and Efficient Modern BERT based Text-Conditioned Diffusion Model for Medical Image Segmentation
by: Dhara, Venkata Siddharth, et al.
Published: (2025)

NLML-HPE: Head Pose Estimation with Limited Data via Manifold Learning
by: Ghafourian, Mahdi, et al.
Published: (2025)

Learning Color Equivariant Representations
by: Yang, Yulong, et al.
Published: (2024)

Denoising Autoregressive Representation Learning
by: Li, Yazhe, et al.
Published: (2024)

Diffusion-Based Representation Learning
by: Mittal, Sarthak, et al.
Published: (2021)

MOFI: Learning Image Representations from Noisy Entity Annotated Images
by: Wu, Wentao, et al.
Published: (2023)

Bridging the Gap: Learning Pace Synchronization for Open-World Semi-Supervised Learning
by: Ye, Bo, et al.
Published: (2023)