Copertina

Transfer Learning in $\ell_1$ Regularized Regression: Hyperparameter Selection Strategy based on Sharp Asymptotic Analysis

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Okajima, Koki, Obuchi, Tomoyuki
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Disordered Systems and Neural Networks Statistical Mechanics
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Exact Replica Symmetric solution for transverse field Hopfield model under finite Trotter size
di: Okajima, Koki, et al.
Pubblicazione: (2024)

Graphical model for factorization and completion of relatively high rank tensors by sparse sampling
di: Cavaliere, Angelo Giorgio, et al.
Pubblicazione: (2025)

Asymptotic Dynamics of Alternating Minimization for Bilinear Regression
di: Okajima, Koki, et al.
Pubblicazione: (2024)

Rare Event Analysis of Large Language Models
di: Dorman, Jake McAllister, et al.
Pubblicazione: (2026)

A theoretical framework for overfitting in energy-based modeling
di: Catania, Giovanni, et al.
Pubblicazione: (2025)

Cascade of phase transitions in the training of Energy-based models
di: Bachtis, Dimitrios, et al.
Pubblicazione: (2024)

The Copycat Perceptron: Smashing Barriers Through Collective Learning
di: Catania, Giovanni, et al.
Pubblicazione: (2023)

The Physics of Data and Tasks: Theories of Locality and Compositionality in Deep Learning
di: Favero, Alessandro
Pubblicazione: (2025)

Optimal Protocols for Continual Learning via Statistical Physics and Control Theory
di: Mori, Francesco, et al.
Pubblicazione: (2024)

Sharp feature-learning transitions and Bayes-optimal neural scaling laws in extensive-width networks
di: Nguyen, Minh-Toan, et al.
Pubblicazione: (2026)

Analytic theory of dropout regularization
di: Mori, Francesco, et al.
Pubblicazione: (2025)

Fundamental operating regimes, hyper-parameter fine-tuning and glassiness: towards an interpretable replica-theory for trained restricted Boltzmann machines
di: Fachechi, Alberto, et al.
Pubblicazione: (2024)

The autoregressive neural network architecture of the Boltzmann distribution of pairwise interacting spins systems
di: Biazzo, Indaco
Pubblicazione: (2023)

Distinct mechanisms underlying in-context learning in transformers
di: Gibson, Cole, et al.
Pubblicazione: (2026)

Interpreting the Synchronization Gap: The Hidden Mechanism Inside Diffusion Transformers
di: Albrychiewicz, Emil, et al.
Pubblicazione: (2026)

Universal Scaling Laws of Absorbing Phase Transitions in Artificial Deep Neural Networks
di: Tamai, Keiichi, et al.
Pubblicazione: (2023)

Two failure modes of deep transformers and how to avoid them: a unified theory of signal propagation at initialisation
di: Giorlandino, Alessio, et al.
Pubblicazione: (2025)

Inferring Higher-Order Couplings with Neural Networks
di: Decelle, Aurélien, et al.
Pubblicazione: (2025)

Explaining the effects of non-convergent sampling in the training of Energy-Based Models
di: Agoritsas, Elisabeth, et al.
Pubblicazione: (2023)

Discrete generative diffusion models without stochastic differential equations: a tensor network approach
di: Causer, Luke, et al.
Pubblicazione: (2024)

Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
di: Giorlandino, Alessio, et al.
Pubblicazione: (2026)

Sampling with flows, diffusion and autoregressive neural networks: A spin-glass perspective
di: Ghio, Davide, et al.
Pubblicazione: (2023)

Stochastic Gradient Descent-like relaxation is equivalent to Metropolis dynamics in discrete optimization and inference problems
di: Angelini, Maria Chiara, et al.
Pubblicazione: (2023)

Escape dynamics and implicit bias of one-pass SGD in overparameterized quadratic networks
di: Bocchi, Dario, et al.
Pubblicazione: (2026)

Inferring effective couplings with Restricted Boltzmann Machines
di: Decelle, Aurélien, et al.
Pubblicazione: (2023)

From Classical to Quantum: Extending Prometheus for Unsupervised Discovery of Phase Transitions in Three Dimensions and Quantum Systems
di: Yee, Brandon, et al.
Pubblicazione: (2026)

Uncertainty in AI-driven Monte Carlo simulations
di: Tzivrailis, Dimitrios, et al.
Pubblicazione: (2025)

Dynamic neuron approach to deep neural networks: Decoupling neurons for renormalization group analysis
di: Lee, Donghee, et al.
Pubblicazione: (2024)

Generalization vs. Specialization under Concept Shift
di: Nguyen, Alex, et al.
Pubblicazione: (2024)

Gaussian Universality in Neural Network Dynamics with Generalized Structured Input Distributions
di: Bae, Jaeyong, et al.
Pubblicazione: (2024)

Coding schemes in neural networks learning classification tasks
di: van Meegen, Alexander, et al.
Pubblicazione: (2024)

Nonequilbrium physics of generative diffusion models
di: Yu, Zhendong, et al.
Pubblicazione: (2024)

The Symmetric Perceptron: a Teacher-Student Scenario
di: Catania, Giovanni, et al.
Pubblicazione: (2026)

Pseudo-likelihood produces associative memories able to generalize, even for asymmetric couplings
di: D'Amico, Francesco, et al.
Pubblicazione: (2025)

On the role of non-linear latent features in bipartite generative neural networks
di: Bonnaire, Tony, et al.
Pubblicazione: (2025)

A replica analysis of under-bagging
di: Takahashi, Takashi
Pubblicazione: (2024)

Spring-block theory of feature learning in deep neural networks
di: Shi, Cheng, et al.
Pubblicazione: (2024)

Weight fluctuations in (deep) linear neural networks and a derivation of the inverse-variance flatness relation
di: Gross, Markus, et al.
Pubblicazione: (2023)

Fast training and sampling of Restricted Boltzmann Machines
di: Béreux, Nicolas, et al.
Pubblicazione: (2024)

Dissecting the Interplay of Attention Paths in a Statistical Mechanics Theory of Transformers
di: Tiberi, Lorenzo, et al.
Pubblicazione: (2024)