Cover Image

Improving Deep Learning Optimization through Constrained Parameter Regularization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Franke, Jörg K. H., Hefenbrock, Michael, Koehler, Gregor, Hutter, Frank
Format:	Preprint
Published:	2023
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Learning in Compact Spaces with Approximately Normalized Transformer
by: Franke, Jörg K. H., et al.
Published: (2025)

Increasing LLM Coding Capabilities through Diverse Synthetic Coding Tasks
by: Abed, Amal, et al.
Published: (2025)

Balancing Synthetic Data and Replay for Enhancing Task-Specific Capabilities
by: Spiegelhalter, Urs, et al.
Published: (2025)

Fast Optimizer Benchmark
by: Blauth, Simon, et al.
Published: (2024)

Rethinking Performance Measures of RNA Secondary Structure Problems
by: Runge, Frederic, et al.
Published: (2023)

Towards Scaling Laws for Symbolic Regression
by: Otte, David, et al.
Published: (2025)

Transfer Learning for Finetuning Large Language Models
by: Strangmann, Tobias, et al.
Published: (2024)

Self-Correcting Bayesian Optimization through Bayesian Active Learning
by: Hvarfner, Carl, et al.
Published: (2023)

Practitioner Motives to Use Different Hyperparameter Optimization Methods
by: Kannengießer, Niclas, et al.
Published: (2022)

Multi-objective Hyperparameter Optimization in the Age of Deep Learning
by: Basu, Soham, et al.
Published: (2025)

Tiny Deep Ensemble: Uncertainty Estimation in Edge AI Accelerators via Ensembling Normalization Layers with Shared Weights
by: Ahmed, Soyed Tuhin, et al.
Published: (2024)

Unlocking State-Tracking in Linear RNNs Through Negative Eigenvalues
by: Grazzi, Riccardo, et al.
Published: (2024)

Regularized Neural Ensemblers
by: Arango, Sebastian Pineda, et al.
Published: (2024)

Improving Learning to Optimize Using Parameter Symmetries
by: Zamir, Guy, et al.
Published: (2025)

A General Framework for User-Guided Bayesian Optimization
by: Hvarfner, Carl, et al.
Published: (2023)

c-TPE: Tree-structured Parzen Estimator with Inequality Constraints for Expensive Hyperparameter Optimization
by: Watanabe, Shuhei, et al.
Published: (2022)

Scale-Dropout: Estimating Uncertainty in Deep Neural Networks Using Stochastic Scale
by: Ahmed, Soyed Tuhin, et al.
Published: (2023)

Embedding Hardware Approximations in Discrete Genetic-based Training for Printed MLPs
by: Afentaki, Florentia, et al.
Published: (2024)

AdaCubic: An Adaptive Cubic Regularization Optimizer for Deep Learning
by: Tsingalis, Ioannis, et al.
Published: (2026)

Estimating Implicit Regularization in Deep Learning
by: Rudoler, Joseph H., et al.
Published: (2026)

Early Stopping Tabular In-Context Learning
by: Küken, Jaris, et al.
Published: (2025)

Bayes' Power for Explaining In-Context Learning Generalizations
by: Müller, Samuel, et al.
Published: (2024)

Robustness and Regularization in Hierarchical Re-Basin
by: Franke, Benedikt, et al.
Published: (2025)

Improving LLM-based Global Optimization with Search Space Partitioning
by: Schwanke, Andrej, et al.
Published: (2025)

Learning Constrained Optimization with Deep Augmented Lagrangian Methods
by: Kotary, James, et al.
Published: (2024)

Cooper: A Library for Constrained Optimization in Deep Learning
by: Gallego-Posada, Jose, et al.
Published: (2025)

Speeding Up Multi-Objective Hyperparameter Optimization by Task Similarity-Based Meta-Learning for the Tree-Structured Parzen Estimator
by: Watanabe, Shuhei, et al.
Published: (2022)

HW-GPT-Bench: Hardware-Aware Architecture Benchmark for Language Models
by: Sukthanker, Rhea Sanjay, et al.
Published: (2024)

Regularized Meta-Learning for Improved Generalization
by: Mohammad, Noor Islam S., et al.
Published: (2026)

In-Context Freeze-Thaw Bayesian Optimization for Hyperparameter Optimization
by: Rakotoarison, Herilalaina, et al.
Published: (2024)

AlignIQL: Policy Alignment in Implicit Q-Learning through Constrained Optimization
by: He, Longxiang, et al.
Published: (2024)

Learning Regularizers: Learning Optimizers that can Regularize
by: Sahoo, Suraj Kumar, et al.
Published: (2025)

Multi-Objective Hierarchical Optimization with Large Language Models
by: Schwanke, Andrej, et al.
Published: (2026)

Decoupled Orthogonal Dynamics: Regularization for Deep Network Optimizers
by: Chen, Hao, et al.
Published: (2026)

DeepCAVE: A Visualization and Analysis Tool for Automated Machine Learning
by: Segel, Sarah, et al.
Published: (2025)

Soft Diamond Regularizers for Deep Learning
by: Adigun, Olaoluwa, et al.
Published: (2024)

Nuclear Norm Regularization for Deep Learning
by: Scarvelis, Christopher, et al.
Published: (2024)

EquiTabPFN: A Target-Permutation Equivariant Prior Fitted Networks
by: Arbel, Michael, et al.
Published: (2025)

Optimizing 2D+1 Packing in Constrained Environments Using Deep Reinforcement Learning
by: Pugliese, Victor Ulisses, et al.
Published: (2025)

Score Regularized Policy Optimization through Diffusion Behavior
by: Chen, Huayu, et al.
Published: (2023)