Cover Image

BiSSL: Enhancing the Alignment Between Self-Supervised Pretraining and Downstream Fine-Tuning via Bilevel Optimization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Zakarias, Gustav Wagner, Hansen, Lars Kai, Tan, Zheng-Hua
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

TinySSL: Distilled Self-Supervised Pretraining for Sub-Megabyte MCU Models
by: Wilson, Bibin
Published: (2026)

PyG-SSL: A Graph Self-Supervised Learning Toolkit
by: Zheng, Lecheng, et al.
Published: (2024)

Fine-grained Analysis of Stability and Generalization for Stochastic Bilevel Optimization
by: Zhang, Xuelin, et al.
Published: (2026)

TIPAA-SSL: Text Independent Phone-to-Audio Alignment based on Self-Supervised Learning and Knowledge Transfer
by: Tits, Noé, et al.
Published: (2024)

Intuitive Fine-Tuning: Towards Simplifying Alignment into a Single Process
by: Hua, Ermo, et al.
Published: (2024)

Rethinking Cross-Modal Fine-Tuning: Optimizing the Interaction Between Feature Alignment and Target Fitting
by: Tran, Trong Khiem, et al.
Published: (2026)

SPEED: Scalable Preprocessing of EEG Data for Self-Supervised Learning
by: Gjølbye, Anders, et al.
Published: (2024)

Neur2BiLO: Neural Bilevel Optimization
by: Dumouchelle, Justin, et al.
Published: (2024)

Label-Efficient School Detection from Aerial Imagery via Weakly Supervised Pretraining and Fine-Tuning
by: Elmimouni, Zakarya, et al.
Published: (2026)

Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations
by: Yadav, Sarthak, et al.
Published: (2024)

Finetune-Informed Pretraining Boosts Downstream Performance
by: Faysal, Atik, et al.
Published: (2026)

IA2: Alignment with ICL Activations Improves Supervised Fine-Tuning
by: Mishra, Aayush, et al.
Published: (2025)

Beyond Generation: Unlocking Universal Editing via Self-Supervised Fine-Tuning
by: Chen, Harold Haodong, et al.
Published: (2024)

ASFT: Aligned Supervised Fine-Tuning through Absolute Likelihood
by: Wang, Ruoyu, et al.
Published: (2024)

Routing-Aligned Fine-Tuning for Multilingual Downstream Tasks in Mixture-of-Experts Models
by: Deng, Guanzhi, et al.
Published: (2026)

Learn from Downstream and Be Yourself in Multimodal Large Language Model Fine-Tuning
by: Huang, Wenke, et al.
Published: (2024)

U-Mamba2-SSL for Semi-Supervised Tooth and Pulp Segmentation in CBCT
by: Tan, Zhi Qin, et al.
Published: (2025)

Data Mixing Optimization for Supervised Fine-Tuning of Large Language Models
by: Li, Yuan, et al.
Published: (2025)

GPS-SSL: Guided Positive Sampling to Inject Prior Into Self-Supervised Learning
by: Feizi, Aarash, et al.
Published: (2024)

SSL-SSAW: Self-Supervised Learning with Sigmoid Self-Attention Weighting for Question-Based Sign Language Translation
by: Liu, Zekang, et al.
Published: (2025)

Bilevel Optimization of Agent Skills via Monte Carlo Tree Search
by: Huang, Chenyi, et al.
Published: (2026)

VARAN: Variational Inference for Self-Supervised Speech Models Fine-Tuning on Downstream Tasks
by: Diatlova, Daria, et al.
Published: (2025)

Benchmarking Robust Self-Supervised Learning Across Diverse Downstream Tasks
by: Kowalczuk, Antoni, et al.
Published: (2024)

Proximal Supervised Fine-Tuning
by: Zhu, Wenhong, et al.
Published: (2025)

Connecting Concept Convexity and Human-Machine Alignment in Deep Neural Networks
by: Dorszewski, Teresa, et al.
Published: (2024)

Self-Supervision in Time for Satellite Images(S3-TSS): A novel method of SSL technique in Satellite images
by: Maurya, Akansh, et al.
Published: (2024)

TE-SSL: Time and Event-aware Self Supervised Learning for Alzheimer's Disease Progression Analysis
by: Thrasher, Jacob, et al.
Published: (2024)

Rotation-Preserving Supervised Fine-Tuning
by: Jin, Hangzhan, et al.
Published: (2026)

ArmSSL: Adversarial Robust Black-Box Watermarking for Self-Supervised Learning Pre-trained Encoders
by: Jiang, Yongqi, et al.
Published: (2026)

UMB@PerAnsSumm 2025: Enhancing Perspective-Aware Summarization with Prompt Optimization and Supervised Fine-Tuning
by: Qi, Kristin, et al.
Published: (2025)

Alignment Dynamics in LLM Fine-Tuning
by: Huang, Yuhan, et al.
Published: (2026)

Rethinking Supervised Fine-Tuning: Emphasizing Key Answer Tokens for Improved LLM Accuracy
by: Shi, Xiaofeng, et al.
Published: (2025)

A New Pipeline For Generating Instruction Dataset via RAG and Self Fine-Tuning
by: Song, Chih-Wei, et al.
Published: (2024)

A Mechanistic Investigation of Supervised Fine Tuning
by: Chopra, Ruhaan
Published: (2026)

On-Policy Supervised Fine-Tuning for Efficient Reasoning
by: Zhao, Anhao, et al.
Published: (2026)

SFT-GO: Supervised Fine-Tuning with Group Optimization for Large Language Models
by: Kim, Gyuhak, et al.
Published: (2025)

Self-Supervised Visual Preference Alignment
by: Zhu, Ke, et al.
Published: (2024)

Portable Reward Tuning: Towards Reusable Fine-Tuning across Different Pretrained Models
by: Chijiwa, Daiki, et al.
Published: (2025)

Trust-SSL: Additive-Residual Selective Invariance for Robust Aerial Self-Supervised Learning
by: Boulila, Wadii, et al.
Published: (2026)

Morph-SSL: Self-Supervision with Longitudinal Morphing to Predict AMD Progression from OCT
by: Chakravarty, Arunava, et al.
Published: (2023)