Copertina

Analysis of Using Sigmoid Loss for Contrastive Learning

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lee, Chungpa, Chang, Joonhwan, Sohn, Jy-yong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

On the Similarities of Embeddings in Contrastive Learning
di: Lee, Chungpa, et al.
Pubblicazione: (2025)

Fine-Tuning Without Forgetting In-Context Learning: A Theoretical Analysis of Linear Attention Models
di: Lee, Chungpa, et al.
Pubblicazione: (2026)

A Theoretical Framework for Preventing Class Collapse in Supervised Contrastive Learning
di: Lee, Chungpa, et al.
Pubblicazione: (2025)

How to Correctly Report LLM-as-a-Judge Evaluations
di: Lee, Chungpa, et al.
Pubblicazione: (2025)

Measuring Representational Shifts in Continual Learning: A Linear Transformation Perspective
di: Kim, Joonkyu, et al.
Pubblicazione: (2025)

Transformers in the Dark: Navigating Unknown Search Spaces via Bandit Feedback
di: Kim, Jungtaek, et al.
Pubblicazione: (2026)

Memorization Capacity for Additive Fine-Tuning with Small ReLU Networks
di: Sohn, Jy-yong, et al.
Pubblicazione: (2024)

Soft Task-Aware Routing of Experts for Equivariant Representation Learning
di: Jeon, Jaebyeong, et al.
Pubblicazione: (2025)

Global Minimizers of Sigmoid Contrastive Loss
di: Bangachev, Kiril, et al.
Pubblicazione: (2025)

ERD: A Framework for Improving LLM Reasoning for Cognitive Distortion Classification
di: Lim, Sehee, et al.
Pubblicazione: (2024)

Buffer-based Gradient Projection for Continual Federated Learning
di: Dai, Shenghong, et al.
Pubblicazione: (2024)

Contrastive Learning for Multi Label ECG Classification with Jaccard Score Based Sigmoid Loss
di: Takahashi, Junichiro, et al.
Pubblicazione: (2026)

Distributional Alignment as a Criterion for Designing Task Vectors in In-Context Learning
di: Kwon, Jihoon, et al.
Pubblicazione: (2026)

SigCLR: Sigmoid Contrastive Learning of Visual Representations
di: Çağatan, Ömer Veysel
Pubblicazione: (2024)

A Generalized Theory of Mixup for Structure-Preserving Synthetic Data
di: Lee, Chungpa, et al.
Pubblicazione: (2025)

Improving Multi-lingual Alignment Through Soft Contrastive Learning
di: Park, Minsu, et al.
Pubblicazione: (2024)

Enhancing Compositional Reasoning in CLIP via Reconstruction and Alignment of Text Descriptions
di: Kwon, Jihoon, et al.
Pubblicazione: (2025)

Theory, Analysis, and Best Practices for Sigmoid Self-Attention
di: Ramapuram, Jason, et al.
Pubblicazione: (2024)

SCS-SupCon: Sigmoid-based Common and Style Supervised Contrastive Learning with Adaptive Decision Boundaries
di: Wang, Bin, et al.
Pubblicazione: (2025)

Efficient Logistic Regression with Mixture of Sigmoids
di: Di Gennaro, Federico, et al.
Pubblicazione: (2026)

Temperature-Free Loss Function for Contrastive Learning
di: Kim, Bum Jun, et al.
Pubblicazione: (2025)

Aligning Large Language Models for Enhancing Psychiatric Interviews Through Symptom Delineation and Summarization: Pilot Study
di: So, Jae-hee, et al.
Pubblicazione: (2024)

Beyond Gaussian Initializations: Signal Preserving Weight Initialization for Odd-Sigmoid Activations
di: Lee, Hyunwoo, et al.
Pubblicazione: (2025)

Prediction Loss Guided Decision-Focused Learning
di: Jeon, Haeun, et al.
Pubblicazione: (2025)

Re-Ex: Revising after Explanation Reduces the Factual Errors in LLM Responses
di: Kim, Juyeon, et al.
Pubblicazione: (2024)

Adaptive Friction in Deep Learning: Enhancing Optimizers with Sigmoid and Tanh Function
di: Zheng, Hongye, et al.
Pubblicazione: (2024)

Rethinking Multinomial Logistic Mixture of Experts with Sigmoid Gating Function
di: Pham, Tuan Minh, et al.
Pubblicazione: (2026)

Achieving the Tightest Relaxation of Sigmoids for Formal Verification
di: Chevalier, Samuel, et al.
Pubblicazione: (2024)

Taming the Sigmoid Bottleneck: Provably Argmaxable Sparse Multi-Label Classification
di: Grivas, Andreas, et al.
Pubblicazione: (2023)

Long-Tail Learning with Rebalanced Contrastive Loss
di: De Alvis, Charika, et al.
Pubblicazione: (2023)

Comparing Contrastive and Triplet Loss: Variance Analysis and Optimization Behavior
di: Zeng, Donghuo
Pubblicazione: (2025)

SimO Loss: Anchor-Free Contrastive Loss for Fine-Grained Supervised Contrastive Learning
di: Bouhsine, Taha, et al.
Pubblicazione: (2024)

Activation Bottleneck: Sigmoidal Neural Networks Cannot Forecast a Straight Line
di: Toller, Maximilian, et al.
Pubblicazione: (2024)

Sigmoid Gating is More Sample Efficient than Softmax Gating in Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2024)

Estimation of the Learning Coefficient Using Empirical Loss
di: Takio, Tatsuyoshi, et al.
Pubblicazione: (2025)

On DeepSeekMoE: Statistical Benefits of Shared Experts and Normalized Sigmoid Gating
di: Nguyen, Huy, et al.
Pubblicazione: (2025)

$\mathbb{X}$-Sample Contrastive Loss: Improving Contrastive Learning with Sample Similarity Graphs
di: Sobal, Vlad, et al.
Pubblicazione: (2024)

FedAnchor: Enhancing Federated Semi-Supervised Learning with Label Contrastive Loss for Unlabeled Clients
di: Qiu, Xinchi, et al.
Pubblicazione: (2024)

Understanding Self-supervised Contrastive Learning through Supervised Objectives
di: Lee, Byeongchan
Pubblicazione: (2025)

Generalization Analysis for Deep Contrastive Representation Learning
di: Hieu, Nong Minh, et al.
Pubblicazione: (2024)