Cover Image

Understanding Nonlinear Implicit Bias via Region Counts in Input Space

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Li, Jingwei, Xu, Jing, Wang, Zifan, Zhang, Huishuai, Zhang, Jingzhao
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Capacity-Aware Mixture Law Enables Efficient LLM Data Optimization
by: Li, Jingwei, et al.
Published: (2026)

Scalable Model Merging with Progressive Layer-wise Distillation
by: Xu, Jing, et al.
Published: (2025)

OLion: Approaching the Hadamard Ideal by Intersecting Spectral and $\ell_{\infty}$ Implicit Biases
by: Wang, Zixiao, et al.
Published: (2026)

Random Masking Finds Winning Tickets for Parameter Efficient Fine-tuning
by: Xu, Jing, et al.
Published: (2024)

Towards Black-Box Membership Inference Attack for Diffusion Models
by: Li, Jingwei, et al.
Published: (2024)

De-Anonymization at Scale via Tournament-Style Attribution
by: Zhang, Lirui, et al.
Published: (2026)

On Finding Small Hyper-Gradients in Bilevel Optimization: Hardness Results and Improved Analysis
by: Chen, Lesi, et al.
Published: (2023)

Functionally Constrained Algorithm Solves Convex Simple Bilevel Problems
by: Zhang, Huaqing, et al.
Published: (2024)

Beyond Parameter Count: Implicit Bias in Soft Mixture of Experts
by: Chung, Youngseog, et al.
Published: (2024)

Rewarded Region Replay (R3) for Policy Learning with Discrete Action Space
by: Li, Bangzheng, et al.
Published: (2024)

Learning to Generate Formally Verifiable Step-by-Step Logic Reasoning via Structured Formal Intermediaries
by: Chen, Luoxin, et al.
Published: (2026)

Fast and Multiphase Rates for Nearest Neighbor Classifiers
by: Yang, Pengkun, et al.
Published: (2023)

Understanding Multimodal Hallucination with Parameter-Free Representation Alignment
by: Wang, Yueqian, et al.
Published: (2024)

The Implicit Bias of Adam on Separable Data
by: Zhang, Chenyang, et al.
Published: (2024)

AdamS: Momentum Itself Can Be A Normalizer for LLM Pretraining and Post-training
by: Zhang, Huishuai, et al.
Published: (2025)

On the Generalization Properties of Diffusion Models
by: Li, Puheng, et al.
Published: (2023)

Efficient Sampling on Riemannian Manifolds via Langevin MCMC
by: Cheng, Xiang, et al.
Published: (2024)

On the Condition Number Dependency in Bilevel Optimization
by: Chen, Lesi, et al.
Published: (2025)

Implicit Bias in Deep Linear Discriminant Analysis
by: Li, Jiawen
Published: (2026)

The Implicit Bias of Structured State Space Models Can Be Poisoned With Clean Labels
by: Slutzky, Yonatan, et al.
Published: (2024)

Gradient Descent with Polyak's Momentum Finds Flatter Minima via Large Catapults
by: Phunyaphibarn, Prin, et al.
Published: (2023)

Molecular Representations in Implicit Functional Space via Hyper-Networks
by: Wang, Zehong, et al.
Published: (2026)

Research and Implementation of Data Enhancement Techniques for Graph Neural Networks
by: Gu, Jingzhao, et al.
Published: (2024)

Fast Conditional Mixing of MCMC Algorithms for Non-log-concave Distributions
by: Cheng, Xiang, et al.
Published: (2023)

The Implicit Bias of Logit Regularization
by: Beck, Alon, et al.
Published: (2026)

Learning Implicit Bias in Generative Spaces for Accelerating Protein Dynamics Emulation
by: Cheng, Kaihui, et al.
Published: (2026)

How Implicit Bias Accumulates and Propagates in LLM Long-term Memory
by: Ma, Yiming, et al.
Published: (2026)

Optimal Implicit Bias in Linear Regression
by: Varma, Kanumuri Nithin, et al.
Published: (2025)

From Sparse Dependence to Sparse Attention: Unveiling How Chain-of-Thought Enhances Transformer Sample Efficiency
by: Wen, Kaiyue, et al.
Published: (2024)

The Implicit Bias of Gradient Descent on Separable Multiclass Data
by: Ravi, Hrithik, et al.
Published: (2024)

Online Preference Alignment for Language Models via Count-based Exploration
by: Bai, Chenjia, et al.
Published: (2025)

Discovering Bias in Latent Space: An Unsupervised Debiasing Approach
by: Adila, Dyah, et al.
Published: (2024)

Data Difficulty and the Generalization--Extrapolation Tradeoff in LLM Fine-Tuning
by: Liu, Siyuan, et al.
Published: (2026)

The Implicit Bias of Steepest Descent with Mini-batch Stochastic Gradient
by: Li, Jichu, et al.
Published: (2026)

OmniBridge: Unified Multimodal Understanding, Generation, and Retrieval via Latent Space Alignment
by: Xiao, Teng, et al.
Published: (2025)

Faster Gradient Methods for Highly-Smooth Stochastic Bilevel Optimization
by: Chen, Lesi, et al.
Published: (2025)

Hyperbolic Aware Minimization: Implicit Bias for Sparsity
by: Jacobs, Tom, et al.
Published: (2025)

The Price of Implicit Bias in Adversarially Robust Generalization
by: Tsilivis, Nikolaos, et al.
Published: (2024)

Can Implicit Bias Imply Adversarial Robustness?
by: Min, Hancheng, et al.
Published: (2024)

The Implicit Bias of Gradient Descent on Separable Data
by: Soudry, Daniel, et al.
Published: (2017)