Decomposing the Depth Profile of Fine-Tuning

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Billa, Jayadev
Formato:	Preprint
Publicado:	2026
Materias:	Machine Learning
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Predicting Where Steering Vectors Succeed
por: Billa, Jayadev
Publicado: (2026)

Modality Collapse as Mismatched Decoding: Information-Theoretic Limits of Multimodal LLMs
por: Billa, Jayadev
Publicado: (2026)

The Geometric Anatomy of Capability Acquisition in Transformers
por: Billa, Jayadev
Publicado: (2026)

The Cascade Equivalence Hypothesis: When Do Speech LLMs Behave Like ASR$\rightarrow$LLM Pipelines?
por: Billa, Jayadev
Publicado: (2026)

When Audio-LLMs Don't Listen: A Cross-Linguistic Study of Modality Arbitration
por: Billa, Jayadev
Publicado: (2026)

Selective Mixup Fine-Tuning for Optimizing Non-Decomposable Objectives
por: Ramasubramanian, Shrinivas, et al.
Publicado: (2024)

DePT: Decomposed Prompt Tuning for Parameter-Efficient Fine-tuning
por: Shi, Zhengxiang, et al.
Publicado: (2023)

LaMDA: Large Model Fine-Tuning via Spectrally Decomposed Low-Dimensional Adaptation
por: Azizi, Seyedarmin, et al.
Publicado: (2024)

Interpretable ML Under the Microscope: Performance, Meta-Features, and the Regression-Classification Predictability Gap
por: Billa, Mattia, et al.
Publicado: (2026)

Feature Dynamics as Implicit Data Augmentation: A Depth-Decomposed View on Deep Neural Network Generalization
por: Ruan, Tianyu, et al.
Publicado: (2025)

Applying Fine-Tuned LLMs for Reducing Data Needs in Load Profile Analysis
por: Hu, Yi, et al.
Publicado: (2024)

R-Tuning: Wavelet-Decomposed Replay and Semantic Alignment for Continual Adaptation of Pretrained Time-Series Models
por: Yin, Tianyi, et al.
Publicado: (2025)

Iterative Tilting for Diffusion Fine-Tuning
por: Pachebat, Jean, et al.
Publicado: (2025)

Transfer Learning in Physics-Informed Neural Networks: Full Fine-Tuning, Lightweight Fine-Tuning, and Low-Rank Adaptation
por: Wang, Yizheng, et al.
Publicado: (2025)

X-PEFT: eXtremely Parameter-Efficient Fine-Tuning for Extreme Multi-Profile Scenarios
por: Kwak, Namju, et al.
Publicado: (2024)

Decomposable Neuro Symbolic Regression
por: Morales, Giorgio, et al.
Publicado: (2025)

Decomposable Transformer Point Processes
por: Panos, Aristeidis
Publicado: (2024)

Diagnosing Capability Gaps in Fine-Tuning Data
por: Taghanaki, Saeid Asgari, et al.
Publicado: (2026)

Gradual Fine-Tuning for Flow Matching Models
por: Thorkelsdottir, Gudrun, et al.
Publicado: (2026)

Exploring Fine-Tuning for Tabular Foundation Models
por: Tanna, Aditya, et al.
Publicado: (2026)

Tilt Matching for Scalable Sampling and Fine-Tuning
por: Potaptchik, Peter, et al.
Publicado: (2025)

Retrieval & Fine-Tuning for In-Context Tabular Models
por: Thomas, Valentin, et al.
Publicado: (2024)

Optimizing DDPM Sampling with Shortcut Fine-Tuning
por: Fan, Ying, et al.
Publicado: (2023)

Smooth Model Compression without Fine-Tuning
por: Runkel, Christina, et al.
Publicado: (2025)

Improving Fine-Tuning with Latent Cluster Correction
por: Thanh, Cédric Ho
Publicado: (2025)

Anchored Supervised Fine-Tuning
por: Zhu, He, et al.
Publicado: (2025)

A Comparative Study of Model Selection Criteria for Symbolic Regression
por: Soltani, Ali, et al.
Publicado: (2026)

Profiling LoRA/QLoRA Fine-Tuning Efficiency on Consumer GPUs: An RTX 4060 Case Study
por: Avinash, MSR
Publicado: (2025)

Theoretical Performance Guarantees for Partial Domain Adaptation via Partial Optimal Transport
por: Naram, Jayadev, et al.
Publicado: (2025)

Decomposing The Dark Matter of Sparse Autoencoders
por: Engels, Joshua, et al.
Publicado: (2024)

Decomposing Prediction Mechanisms for In-Context Recall
por: Daniels, Sultan, et al.
Publicado: (2025)

Meta-Learning Hyperparameters for Parameter Efficient Fine-Tuning
por: Tian, Zichen, et al.
Publicado: (2026)

Robust Graph Fine-Tuning with Adversarial Graph Prompting
por: Zhang, Ziyan, et al.
Publicado: (2026)

LLM Zeroth-Order Fine-Tuning is an Inference Workload
por: Li, Zelin, et al.
Publicado: (2026)

Fine-Tuning Dynamics of In-Context Factual Recall in Transformers
por: Huang, Ruomin, et al.
Publicado: (2026)

Parameter-Efficient Fine-Tuning with Circulant and Diagonal Vectors
por: Ding, Xinyu, et al.
Publicado: (2025)

Curvature-Aware Safety Restoration In LLMs Fine-Tuning
por: Bach, Thong, et al.
Publicado: (2025)

Efficient Orthogonal Fine-Tuning with Principal Subspace Adaptation
por: Wu, Fei, et al.
Publicado: (2025)

Iterative Foundation Model Fine-Tuning on Multiple Rewards
por: Ghari, Pouya M., et al.
Publicado: (2025)

An Optimization Framework for Differentially Private Sparse Fine-Tuning
por: Makni, Mehdi, et al.
Publicado: (2025)