Saved in:
| Main Authors: | Eschenhagen, Runa, Immer, Alexander, Turner, Richard E., Schneider, Frank, Hennig, Philipp |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2311.00636 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Kronecker-factored Approximate Curvature (KFAC) From Scratch
by: Dangel, Felix, et al.
Published: (2025)
by: Dangel, Felix, et al.
Published: (2025)
Better Hessians Matter: Studying the Impact of Curvature Approximations in Influence Functions
by: Hong, Steve, et al.
Published: (2025)
by: Hong, Steve, et al.
Published: (2025)
Influence Functions for Scalable Data Attribution in Diffusion Models
by: Mlodozeniec, Bruno, et al.
Published: (2024)
by: Mlodozeniec, Bruno, et al.
Published: (2024)
Spectral-factorized Positive-definite Curvature Learning for NN Training
by: Lin, Wu, et al.
Published: (2025)
by: Lin, Wu, et al.
Published: (2025)
Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks
by: Dangel, Felix, et al.
Published: (2024)
by: Dangel, Felix, et al.
Published: (2024)
Position: Curvature Matrices Should Be Democratized via Linear Operators
by: Dangel, Felix, et al.
Published: (2025)
by: Dangel, Felix, et al.
Published: (2025)
Accelerating Neural Network Training: An Analysis of the AlgoPerf Competition
by: Kasimbeg, Priya, et al.
Published: (2025)
by: Kasimbeg, Priya, et al.
Published: (2025)
Can We Remove the Square-Root in Adaptive Gradient Methods? A Second-Order Perspective
by: Lin, Wu, et al.
Published: (2024)
by: Lin, Wu, et al.
Published: (2024)
Purifying Shampoo: Investigating Shampoo's Heuristics by Decomposing its Preconditioner
by: Eschenhagen, Runa, et al.
Published: (2025)
by: Eschenhagen, Runa, et al.
Published: (2025)
Structured Inverse-Free Natural Gradient: Memory-Efficient & Numerically-Stable KFAC
by: Lin, Wu, et al.
Published: (2023)
by: Lin, Wu, et al.
Published: (2023)
A New Way: Kronecker-Factored Approximate Curvature Deep Hedging and its Benefits
by: Enkhbayar, Tsogt-Ochir
Published: (2024)
by: Enkhbayar, Tsogt-Ochir
Published: (2024)
Benchmarking Neural Network Training Algorithms
by: Dahl, George E., et al.
Published: (2023)
by: Dahl, George E., et al.
Published: (2023)
Clarifying Shampoo: Adapting Spectral Descent to Stochasticity and the Parameter Trajectory
by: Eschenhagen, Runa, et al.
Published: (2026)
by: Eschenhagen, Runa, et al.
Published: (2026)
Accelerating Non-Conjugate Gaussian Processes By Trading Off Computation For Uncertainty
by: Tatzel, Lukas, et al.
Published: (2023)
by: Tatzel, Lukas, et al.
Published: (2023)
Connecting Parameter Magnitudes and Hessian Eigenspaces at Scale using Sketched Methods
by: Fernandez, Andres, et al.
Published: (2025)
by: Fernandez, Andres, et al.
Published: (2025)
Shaving Weights with Occam's Razor: Bayesian Sparsification for Neural Networks Using the Marginal Likelihood
by: Dhahri, Rayen, et al.
Published: (2024)
by: Dhahri, Rayen, et al.
Published: (2024)
Sketching Low-Rank Plus Diagonal Matrices
by: Fernandez, Andres, et al.
Published: (2025)
by: Fernandez, Andres, et al.
Published: (2025)
Rethinking Approximate Gaussian Inference in Classification
by: Mucsányi, Bálint, et al.
Published: (2025)
by: Mucsányi, Bálint, et al.
Published: (2025)
Understanding and Improving Shampoo and SOAP via Kullback-Leibler Minimization
by: Lin, Wu, et al.
Published: (2025)
by: Lin, Wu, et al.
Published: (2025)
Approximately Equivariant Neural Processes
by: Ashman, Matthew, et al.
Published: (2024)
by: Ashman, Matthew, et al.
Published: (2024)
Improving Neural Additive Models with Bayesian Principles
by: Bouchiat, Kouroche, et al.
Published: (2023)
by: Bouchiat, Kouroche, et al.
Published: (2023)
Low-Rank Filtering and Smoothing for Sequential Deep Learning
by: Sliwa, Joanna, et al.
Published: (2024)
by: Sliwa, Joanna, et al.
Published: (2024)
Mitigating Forgetting in Low Rank Adaptation
by: Sliwa, Joanna, et al.
Published: (2025)
by: Sliwa, Joanna, et al.
Published: (2025)
Weaver: Kronecker Product Approximations of Spatiotemporal Attention for Traffic Network Forecasting
by: Cheong, Christopher, et al.
Published: (2025)
by: Cheong, Christopher, et al.
Published: (2025)
The Rank-Reduced Kalman Filter: Approximate Dynamical-Low-Rank Filtering In High Dimensions
by: Schmidt, Jonathan, et al.
Published: (2023)
by: Schmidt, Jonathan, et al.
Published: (2023)
Geometric Gaussian Approximations of Probability Distributions
by: Da Costa, Nathaël, et al.
Published: (2025)
by: Da Costa, Nathaël, et al.
Published: (2025)
KFCPO: Kronecker-Factored Approximated Constrained Policy Optimization
by: Lim, Joonyoung, et al.
Published: (2025)
by: Lim, Joonyoung, et al.
Published: (2025)
Rethinking Bregman Divergences in Kronecker-Factored Optimizers
by: Liu, Bing, et al.
Published: (2026)
by: Liu, Bing, et al.
Published: (2026)
Ginger: An Efficient Curvature Approximation with Linear Complexity for General Neural Networks
by: Hao, Yongchang, et al.
Published: (2024)
by: Hao, Yongchang, et al.
Published: (2024)
Analysis and Approximate Inference of Large Random Kronecker Graphs
by: Liao, Zhenyu, et al.
Published: (2023)
by: Liao, Zhenyu, et al.
Published: (2023)
Spatio-Temporal Graph Convolutional Networks: Optimised Temporal Architecture
by: Turner, Edward
Published: (2025)
by: Turner, Edward
Published: (2025)
FSP-Laplace: Function-Space Priors for the Laplace Approximation in Bayesian Deep Learning
by: Cinquin, Tristan, et al.
Published: (2024)
by: Cinquin, Tristan, et al.
Published: (2024)
Generalized Fisher-Weighted SVD: Scalable Kronecker-Factored Fisher Approximation for Compressing Large Language Models
by: Chekalina, Viktoriia, et al.
Published: (2025)
by: Chekalina, Viktoriia, et al.
Published: (2025)
Uncertainty-Penalized Direct Preference Optimization
by: Houliston, Sam, et al.
Published: (2024)
by: Houliston, Sam, et al.
Published: (2024)
Deep Kronecker Network
by: Feng, Long, et al.
Published: (2022)
by: Feng, Long, et al.
Published: (2022)
Scalable Bayesian Inference for Nonlinear Conservation Laws
by: Weiland, Tim, et al.
Published: (2026)
by: Weiland, Tim, et al.
Published: (2026)
laplax -- Laplace Approximations with JAX
by: Weber, Tobias, et al.
Published: (2025)
by: Weber, Tobias, et al.
Published: (2025)
Kronecker Factorization Improves Efficiency and Interpretability of Sparse Autoencoders
by: Kurochkin, Vadim, et al.
Published: (2025)
by: Kurochkin, Vadim, et al.
Published: (2025)
Topology of Out-of-Distribution Examples in Deep Neural Networks
by: Datta, Esha, et al.
Published: (2025)
by: Datta, Esha, et al.
Published: (2025)
Quantum Speedup for Spectral Approximation of Kronecker Products
by: Gao, Yeqi, et al.
Published: (2024)
by: Gao, Yeqi, et al.
Published: (2024)
Similar Items
-
Kronecker-factored Approximate Curvature (KFAC) From Scratch
by: Dangel, Felix, et al.
Published: (2025) -
Better Hessians Matter: Studying the Impact of Curvature Approximations in Influence Functions
by: Hong, Steve, et al.
Published: (2025) -
Influence Functions for Scalable Data Attribution in Diffusion Models
by: Mlodozeniec, Bruno, et al.
Published: (2024) -
Spectral-factorized Positive-definite Curvature Learning for NN Training
by: Lin, Wu, et al.
Published: (2025) -
Kronecker-Factored Approximate Curvature for Physics-Informed Neural Networks
by: Dangel, Felix, et al.
Published: (2024)