:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Qiu, Shikai, Chen, Zixi, Phan, Hoang, Lei, Qi, Wilson, Andrew Gordon
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2512.05620
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Controllable Prompt Tuning For Balancing Group Distributional Robustness
by: Phan, Hoang, et al.
Published: (2024)

Scaling Collapse Reveals Universal Dynamics in Compute-Optimally Trained Neural Networks
by: Qiu, Shikai, et al.
Published: (2025)

Large Language Models Are Zero-Shot Time Series Forecasters
by: Gruver, Nate, et al.
Published: (2023)

Transferring Knowledge from Large Foundation Models to Small Downstream Models
by: Qiu, Shikai, et al.
Published: (2024)

Forgetting in Language Models: Capacity, Optimization, and Self-Generated Replay
by: Marek, Martin, et al.
Published: (2026)

Searching for Efficient Linear Layers over a Continuous Space of Structured Matrices
by: Potapczynski, Andres, et al.
Published: (2024)

Compute Better Spent: Replacing Dense Layers with Structured Matrices
by: Qiu, Shikai, et al.
Published: (2024)

Customizing the Inductive Biases of Softmax Attention using Structured Matrices
by: Kuang, Yilun, et al.
Published: (2025)

From Entropy to Epiplexity: Rethinking Information for Computationally Bounded Intelligence
by: Finzi, Marc, et al.
Published: (2026)

On the Width Scaling of Neural Optimizers Under Matrix Operator Norms I: Row/Column Normalization and Hyperparameter Transfer
by: Xu, Ruihan, et al.
Published: (2026)

Elucidating the Preconditioning in Consistency Distillation
by: Zheng, Kaiwen, et al.
Published: (2025)

PolarGrad: A Class of Matrix-Gradient Optimizers from a Unifying Preconditioning Perspective
by: Lau, Tim Tsz-Kit, et al.
Published: (2025)

Out-of-Distribution Detection Methods Answer the Wrong Questions
by: Li, Yucen Lily, et al.
Published: (2025)

RMNP: Row-Momentum Normalized Preconditioning for Scalable Matrix-Based Optimization
by: Deng, Shenyang, et al.
Published: (2026)

Sketchy Moment Matching: Toward Fast and Provable Data Selection for Finetuning
by: Dong, Yijun, et al.
Published: (2024)

Principled Architecture-aware Scaling of Hyperparameters
by: Chen, Wuyang, et al.
Published: (2024)

Deep Learning is Not So Mysterious or Different
by: Wilson, Andrew Gordon
Published: (2025)

Learning Cross-Domain Representations for Transferable Drug Perturbations on Single-Cell Transcriptional Responses
by: Liu, Hui, et al.
Published: (2024)

Deriving Hyperparameter Scaling Laws via Modern Optimization Theory
by: Shulgin, Egor, et al.
Published: (2026)

Hyperparameter Transfer for Dense Associative Memories
by: Holtzman, Roi, et al.
Published: (2026)

Hyperparameter Transfer with Mixture-of-Expert Layers
by: Jiang, Tianze, et al.
Published: (2026)

Overtuning in Hyperparameter Optimization
by: Schneider, Lennart, et al.
Published: (2025)

Toward a Holistic Approach to Continual Model Merging
by: Phan, Hoang, et al.
Published: (2025)

Beyond Reasoning Gains: Mitigating General Capabilities Forgetting in Large Reasoning Models
by: Phan, Hoang, et al.
Published: (2025)

Hyperparameter Optimization in Machine Learning
by: Franceschi, Luca, et al.
Published: (2024)

Understanding the Mechanisms of Fast Hyperparameter Transfer
by: Ghosh, Nikhil, et al.
Published: (2025)

Dynamic Priors in Bayesian Optimization for Hyperparameter Optimization
by: Fehring, Lukas, et al.
Published: (2025)

On Optimal Hyperparameters for Differentially Private Deep Transfer Learning
by: Rehn, Aki, et al.
Published: (2025)

Convergence Rate in Nonlinear Two-Time-Scale Stochastic Approximation with State (Time)-Dependence
by: Chen, Zixi, et al.
Published: (2025)

Hyperparameter Transfer Laws for Non-Recurrent Multi-Path Neural Networks
by: Wu, Shenxi, et al.
Published: (2026)

AGD: an Auto-switchable Optimizer using Stepwise Gradient Difference for Preconditioning Matrix
by: Yue, Yun, et al.
Published: (2023)

A Study of Bayesian Neural Network Surrogates for Bayesian Optimization
by: Li, Yucen Lily, et al.
Published: (2023)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
by: Rakotoarison, Herilalaina, et al.
Published: (2024)

Preconditioned Gradient Descent for Over-Parameterized Nonconvex Matrix Factorization
by: Zhang, Gavin, et al.
Published: (2025)

The Power of Preconditioning in Overparameterized Low-Rank Matrix Sensing
by: Xu, Xingyu, et al.
Published: (2023)

A New Linear Scaling Rule for Private Adaptive Hyperparameter Optimization
by: Panda, Ashwinee, et al.
Published: (2022)

LLM Circuit Analyses Are Consistent Across Training and Scale
by: Tigges, Curt, et al.
Published: (2024)

Exploring the Optimized Value of Each Hyperparameter in Various Gradient Descent Algorithms
by: Chen, Abel C. H.
Published: (2022)

Enhancing Performance and Calibration in Quantile Hyperparameter Optimization
by: Doyle, Riccardo
Published: (2025)

Adaptive Hyperparameter Optimization for Continual Learning Scenarios
by: Semola, Rudy, et al.
Published: (2024)