Cover Image

Debiasing Mini-Batch Quadratics for Applications in Deep Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tatzel, Lukas, Mucsányi, Bálint, Hackel, Osane, Hennig, Philipp
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Rethinking Approximate Gaussian Inference in Classification
by: Mucsányi, Bálint, et al.
Published: (2025)

Geometric Gaussian Approximations of Probability Distributions
by: Da Costa, Nathaël, et al.
Published: (2025)

Accelerating Non-Conjugate Gaussian Processes By Trading Off Computation For Uncertainty
by: Tatzel, Lukas, et al.
Published: (2023)

laplax -- Laplace Approximations with JAX
by: Weber, Tobias, et al.
Published: (2025)

Benchmarking Uncertainty Disentanglement: Specialized Uncertainties for Specialized Tasks
by: Mucsányi, Bálint, et al.
Published: (2024)

Reparameterization invariance in approximate Bayesian inference
by: Roy, Hrittik, et al.
Published: (2024)

Logit Reweighting for Topic-Focused Summarization
by: Braun, Joschka, et al.
Published: (2025)

Kronecker-factored Approximate Curvature (KFAC) From Scratch
by: Dangel, Felix, et al.
Published: (2025)

Dynamics Reveals Structure: Challenging the Linear Propagation Assumption
by: Chang, Hoyeon, et al.
Published: (2026)

Skill Learning via Policy Diversity Yields Identifiable Representations for Reinforcement Learning
by: Reizinger, Patrik, et al.
Published: (2025)

Muon is Not That Special: Random or Inverted Spectra Work Just as Well
by: Shumaylov, Zakhar, et al.
Published: (2026)

Mini-Batch Robustness Verification of Deep Neural Networks
by: Tzour-Shaday, Saar, et al.
Published: (2025)

Low-Rank Filtering and Smoothing for Sequential Deep Learning
by: Sliwa, Joanna, et al.
Published: (2024)

Position: Curvature Matrices Should Be Democratized via Linear Operators
by: Dangel, Felix, et al.
Published: (2025)

Perfect Parallelization in Mini-Batch SGD with Classical Momentum Acceleration
by: Garg, Sachin, et al.
Published: (2026)

Mini-Batch Kernel $k$-means
by: Jourdan, Ben, et al.
Published: (2024)

Mini-Batch Class Composition Bias in Link Prediction
by: Maguire, Kieran, et al.
Published: (2026)

BADM: Batch ADMM for Deep Learning
by: Wang, Ouya, et al.
Published: (2024)

Can Microcanonical Langevin Dynamics Leverage Mini-Batch Gradient Noise?
by: Sommer, Emanuel, et al.
Published: (2026)

Diverse Mini-Batch Selection in Reinforcement Learning for Efficient Chemical Exploration in de novo Drug Design
by: Svensson, Hampus Gummesson, et al.
Published: (2025)

FSP-Laplace: Function-Space Priors for the Laplace Approximation in Bayesian Deep Learning
by: Cinquin, Tristan, et al.
Published: (2024)

Full-Graph vs. Mini-Batch Training: Comprehensive Analysis from a Batch Size and Fan-Out Size Perspective
by: Liu, Mengfan, et al.
Published: (2026)

Hierarchical Rectified Flow Matching with Mini-Batch Couplings
by: Zhang, Yichi, et al.
Published: (2025)

Faster Stochastic Optimization with Arbitrary Delays via Asynchronous Mini-Batching
by: Attia, Amit, et al.
Published: (2024)

Efficient GNN Training Through Structure-Aware Randomized Mini-Batching
by: Balaji, Vignesh, et al.
Published: (2025)

Scalable Bayesian Inference for Nonlinear Conservation Laws
by: Weiland, Tim, et al.
Published: (2026)

The Effect of Mini-Batch Noise on the Implicit Bias of Adam
by: Cattaneo, Matias D., et al.
Published: (2026)

Hidden State Differential Private Mini-Batch Block Coordinate Descent for Multi-convexity Optimization
by: Chen, Ding, et al.
Published: (2024)

Scalable Graph Attention-based Instance Selection via Mini-Batch Sampling and Hierarchical Hashing
by: Rustamov, Zahiriddin, et al.
Published: (2025)

Towards Leveraging AutoML for Sustainable Deep Learning: A Multi-Objective HPO Approach on Deep Shift Neural Networks
by: Hennig, Leona, et al.
Published: (2024)

From One-Pass SGD to Data Reuse: Mini-Batch Scaling Laws in Sketched Linear Regression
by: Chen, Ziyan, et al.
Published: (2026)

ZC-Swish: Stabilizing Deep BN-Free Networks for Edge and Micro-Batch Applications
by: Basak, Suvinava
Published: (2026)

Optimizing Predictive AI in Physical Design Flows with Mini Pixel Batch Gradient Descent
by: Yang, Haoyu, et al.
Published: (2024)

Debiasing Synthetic Data Generated by Deep Generative Models
by: Decruyenaere, Alexander, et al.
Published: (2024)

A Quadratic Synchronization Rule for Distributed Deep Learning
by: Gu, Xinran, et al.
Published: (2023)

Making Batch Normalization Great in Federated Deep Learning
by: Zhong, Jike, et al.
Published: (2023)

Bridging Mini-Batch and Asymptotic Analysis in Contrastive Learning: From InfoNCE to Kernel-Based Losses
by: Koromilas, Panagiotis, et al.
Published: (2024)

DYNAMITE: Dynamic Interplay of Mini-Batch Size and Aggregation Frequency for Federated Learning with Static and Streaming Dataset
by: Liu, Weijie, et al.
Published: (2023)

Towards Batch-to-Streaming Deep Reinforcement Learning for Continuous Control
by: De Monte, Riccardo, et al.
Published: (2026)

Scaling up Probabilistic PDE Simulators with Structured Volumetric Information
by: Weiland, Tim, et al.
Published: (2024)