Image de couverture de livre

Visualizing the loss landscape of Self-supervised Vision Transformer

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Lee, Youngwan, Willette, Jeffrey Ryan, Kim, Jonghee, Hwang, Sung Ju
Format:	Preprint
Publié:	2024
Sujets:	Computer Vision and Pattern Recognition Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

EVEREST: Efficient Masked Video Autoencoder by Removing Redundant Spatiotemporal Tokens
par: Hwang, Sunil, et autres
Publié: (2022)

Concept-skill Transferability-based Data Selection for Large Vision-Language Models
par: Lee, Jaewoo, et autres
Publié: (2024)

Simple yet Effective Semi-supervised Knowledge Distillation from Vision-Language Models via Dual-Head Optimization
par: Kang, Seongjae, et autres
Publié: (2025)

A Training-free Sub-quadratic Cost Transformer Model Serving Framework With Hierarchically Pruned Attention
par: Lee, Heejun, et autres
Publié: (2024)

Training-Free Exponential Context Extension via Cascading KV Cache
par: Willette, Jeffrey, et autres
Publié: (2024)

BECoTTA: Input-dependent Online Blending of Experts for Continual Test-time Adaptation
par: Lee, Daeun, et autres
Publié: (2024)

Visualizing high-dimensional loss landscapes with Hessian directions
par: Böttcher, Lucas, et autres
Publié: (2022)

STELLA: Continual Audio-Video Pre-training with Spatio-Temporal Localized Alignment
par: Lee, Jaewoo, et autres
Publié: (2023)

Self-supervised Transformation Learning for Equivariant Representations
par: Yu, Jaemyung, et autres
Publié: (2025)

Self-Refining Video Sampling
par: Jang, Sangwon, et autres
Publié: (2026)

MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
par: Lee, Youngwan, et autres
Publié: (2026)

Artificial intelligence application in lymphoma diagnosis with Vision Transformer using weakly supervised training
par: Nghia, et autres
Publié: (2026)

Diversify and Conquer: Open-set Disagreement for Robust Semi-supervised Learning with Outliers
par: Kong, Heejo, et autres
Publié: (2025)

Mixed Autoencoder for Self-supervised Visual Representation Learning
par: Chen, Kai, et autres
Publié: (2023)

HoliSafe: Holistic Safety Benchmarking and Modeling for Vision-Language Model
par: Lee, Youngwan, et autres
Publié: (2025)

VideoICL: Confidence-based Iterative In-context Learning for Out-of-Distribution Video Understanding
par: Kim, Kangsan, et autres
Publié: (2024)

Advanced Knowledge Transfer: Refined Feature Distillation for Zero-Shot Quantization in Edge Computing
par: Hong, Inpyo, et autres
Publié: (2024)

Self-supervised Monocular Depth Estimation Robust to Reflective Surface Leveraged by Triplet Mining
par: Choi, Wonhyeok, et autres
Publié: (2025)

KOALA: Empirical Lessons Toward Memory-Efficient and Fast Diffusion Models for Text-to-Image Synthesis
par: Lee, Youngwan, et autres
Publié: (2023)

Self-supervised Vision Transformer are Scalable Generative Models for Domain Generalization
par: Doerrich, Sebastian, et autres
Publié: (2024)

Maximizing the Position Embedding for Vision Transformers with Global Average Pooling
par: Lee, Wonjun, et autres
Publié: (2025)

Intrinsic Image Decomposition for Robust Self-supervised Monocular Depth Estimation on Reflective Surfaces
par: Choi, Wonhyeok, et autres
Publié: (2025)

MUST: Modality-Specific Representation-Aware Transformer for Diffusion-Enhanced Survival Prediction with Missing Modality
par: Kim, Kyungwon, et autres
Publié: (2026)

SEA: Sparse Linear Attention with Estimated Attention Mask
par: Lee, Heejun, et autres
Publié: (2023)

On Vision Transformers for Classification Tasks in Side-Scan Sonar Imagery
par: Sheffield, BW, et autres
Publié: (2024)

Self-Supervised Vision Transformers for Writer Retrieval
par: Raven, Tim, et autres
Publié: (2024)

Transfer Learning with Self-Supervised Vision Transformers for Snake Identification
par: Miyaguchi, Anthony, et autres
Publié: (2024)

Inference-Time Scaling for Flow Models via Stochastic Generation and Rollover Budget Forcing
par: Kim, Jaihoon, et autres
Publié: (2025)

Investigating generalization capabilities of neural networks by means of loss landscapes and Hessian analysis
par: Gabdullin, Nikita
Publié: (2024)

Efficient LLaMA-3.2-Vision by Trimming Cross-attended Visual Features
par: Lee, Jewon, et autres
Publié: (2025)

VG3T: Visual Geometry Grounded Gaussian Transformer
par: Kim, Junho, et autres
Publié: (2025)

BRIDLE: Generalized Self-supervised Learning with Quantization
par: Nguyen, Hoang M., et autres
Publié: (2025)

Occupancy-Based Dual Contouring
par: Hwang, Jisung, et autres
Publié: (2024)

The Role of Masking for Efficient Supervised Knowledge Distillation of Vision Transformers
par: Son, Seungwoo, et autres
Publié: (2023)

Self-Evolving Visual Concept Library using Vision-Language Critics
par: Sehgal, Atharva, et autres
Publié: (2025)

Self-supervised Fusarium Head Blight Detection with Hyperspectral Image and Feature Mining
par: Lin, Yu-Fan, et autres
Publié: (2024)

Moment- and Power-Spectrum-Based Gaussianity Regularization for Text-to-Image Models
par: Hwang, Jisung, et autres
Publié: (2025)

Investigating Pre-Training Objectives for Generalization in Vision-Based Reinforcement Learning
par: Kim, Donghu, et autres
Publié: (2024)

Instance-Aware Group Quantization for Vision Transformers
par: Moon, Jaehyeon, et autres
Publié: (2024)

Self-supervised visual learning from interactions with objects
par: Aubret, Arthur, et autres
Publié: (2024)