Cover Image

Gradient Descent as a Shrinkage Operator for Spectral Bias

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Lucey, Simon
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

From Tables to Signals: Revealing Spectral Adaptivity in TabPFN
by: Zheng, Jianqiao, et al.
Published: (2025)

Inductive Gradient Adjustment For Spectral Bias In Implicit Neural Representations
by: Shi, Kexuan, et al.
Published: (2024)

Rethinking the Role of Spatial Mixing
by: Cazenavette, George, et al.
Published: (2025)

Leaner Transformers: More Heads, Less Depth
by: Saratchandran, Hemanth, et al.
Published: (2025)

From Activation to Initialization: Scaling Insights for Optimizing Neural Fields
by: Saratchandran, Hemanth, et al.
Published: (2024)

Preconditioners for the Stochastic Training of Neural Fields
by: Chng, Shin-Fang, et al.
Published: (2024)

Always Skip Attention
by: Ji, Yiping, et al.
Published: (2025)

Bias Leaves a Gradient Trail: Label-Free Bias Identification via Gradient Probes on Concept Decompositions
by: Vitry, Thomas, et al.
Published: (2026)

Rethinking Attention: Polynomial Alternatives to Softmax in Transformers
by: Saratchandran, Hemanth, et al.
Published: (2024)

D'OH: Decoder-Only Random Hypernetworks for Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2024)

Stop Walking in Circles! Bailing Out Early in Projected Gradient Descent
by: Doldo, Philip, et al.
Published: (2025)

Inverse-Free Fast Natural Gradient Descent Method for Deep Learning
by: Ou, Xinwei, et al.
Published: (2024)

On the Relationship Between Double Descent of CNNs and Shape/Texture Bias Under Learning Process
by: Iwase, Shun, et al.
Published: (2025)

3D-LFM: Lifting Foundation Model
by: Dabhi, Mosam, et al.
Published: (2023)

Projected Stochastic Gradient Descent with Quantum Annealed Binary Gradients
by: Krahn, Maximilian, et al.
Published: (2023)

Natural Gradient Descent for Online Continual Learning
by: Khawand, Joe, et al.
Published: (2026)

Mitigating Visual Knowledge Forgetting in MLLM Instruction-tuning via Modality-decoupled Gradient Descent
by: Wu, Junda, et al.
Published: (2025)

Integrating Intermediate Layer Optimization and Projected Gradient Descent for Solving Inverse Problems with Diffusion Models
by: Zheng, Yang, et al.
Published: (2025)

Spectral Gradient Surgery for Domain-Generalizable Dataset Distillation
by: Oh, Minyoung, et al.
Published: (2026)

LLM as a Complementary Optimizer to Gradient Descent: A Case Study in Prompt Tuning
by: Guo, Zixian, et al.
Published: (2024)

Flatness and Gradient Alignment Are Both Necessary: Spectral-Aware Gradient-Aligned Exploration for Multi-Distribution Learning
by: Ballas, Aristotelis, et al.
Published: (2026)

Designing Instance-Level Sampling Schedules via REINFORCE with James-Stein Shrinkage
by: Yu, Peiyu, et al.
Published: (2025)

Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024)

Coordinate Descent for Network Linearization
by: Rakhlin, Vlad, et al.
Published: (2025)

Bias Analysis in Unconditional Image Generative Models
by: Zhang, Xiaofeng, et al.
Published: (2025)

On Spectral Properties of Gradient-based Explanation Methods
by: Mehrpanah, Amir, et al.
Published: (2025)

Schrodinger AI: A Unified Spectral-Dynamical Framework for Classification, Reasoning, and Operator-Based Generalization
by: Nguyen, Truong Son
Published: (2025)

Understanding the Double Descent Phenomenon in Deep Learning
by: Lafon, Marc, et al.
Published: (2024)

Milestone Determination for Autonomous Railway Operation
by: Hunter, Josh, et al.
Published: (2025)

Bias In, Bias Out? Finding Unbiased Subnetworks in Vanilla Models
by: Matos, Ivan Luiz De Moura, et al.
Published: (2026)

Two Effects, One Trigger: On the Modality Gap, Object Bias, and Information Imbalance in Contrastive Vision-Language Models
by: Schrodi, Simon, et al.
Published: (2024)

Anchor-based Multi-view Subspace Clustering with Hierarchical Feature Descent
by: Ou, Qiyuan, et al.
Published: (2023)

How I Met Your Bias: Investigating Bias Amplification in Diffusion Models
by: Roos, Nathan, et al.
Published: (2025)

It's Not a Lottery, It's a Race: Understanding How Gradient Descent Adapts the Network's Capacity to the Task
by: Pinson, Hannah
Published: (2026)

Arc Gradient Descent: A Geometrically Motivated Gradient Descent-based Optimiser with Phase-Aware, User-Controlled Step Dynamics (proof-of-concept)
by: Verma, Nikhil, et al.
Published: (2025)

CityGuard: Graph-Aware Private Descriptors for Bias-Resilient Identity Search Across Urban Cameras
by: Fu, Rong, et al.
Published: (2026)

TimberVision: A Multi-Task Dataset and Framework for Log-Component Segmentation and Tracking in Autonomous Forestry Operations
by: Steininger, Daniel, et al.
Published: (2025)

Deep Spectral Clustering via Joint Spectral Embedding and Kmeans
by: Guo, Wengang, et al.
Published: (2024)

Hierarchical Simplicity Bias of Neural Networks
by: Du, Zhehang
Published: (2023)

Spectral Image Tokenizer
by: Esteves, Carlos, et al.
Published: (2024)