:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Li, Siquan, Tong, Yao, Wang, Haonan, Hu, Tianyang
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2602.05927
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

The Good, The Efficient and the Inductive Biases: Exploring Efficiency in Deep Learning Through the Use of Inductive Biases
by: Romero, David W.
Published: (2024)

The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity
by: Li, Siquan, et al.
Published: (2026)

Instilling Inductive Biases with Subnetworks
by: Zhang, Enyan, et al.
Published: (2023)

Customizing the Inductive Biases of Softmax Attention using Structured Matrices
by: Kuang, Yilun, et al.
Published: (2025)

Language Models Need Inductive Biases to Count Inductively
by: Chang, Yingshan, et al.
Published: (2024)

Incorporating Inductive Biases to Energy-based Generative Models
by: Li, Yukun, et al.
Published: (2025)

Theoretical Analysis of Inductive Biases in Deep Convolutional Networks
by: Wang, Zihao, et al.
Published: (2023)

Architectural and Inferential Inductive Biases For Exchangeable Sequence Modeling
by: Mittal, Daksh, et al.
Published: (2025)

Clustering Inductive Biases with Unrolled Networks
by: Huml, Jonathan, et al.
Published: (2023)

Integrating Inductive Biases in Transformers via Distillation for Financial Time Series Forecasting
by: Den, Yu-Chen, et al.
Published: (2026)

Characterising the Inductive Biases of Neural Networks on Boolean Data
by: Mingard, Chris, et al.
Published: (2025)

Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning
by: Comminiello, Danilo, et al.
Published: (2024)

Priors in Time: Missing Inductive Biases for Language Model Interpretability
by: Lubana, Ekdeep Singh, et al.
Published: (2025)

Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture
by: Movahedi, Sajad, et al.
Published: (2024)

From Kepler to Newton: Inductive Biases Guide Learned World Models in Transformers
by: Liu, Ziming, et al.
Published: (2026)

Lyapunov Stability Learning with Nonlinear Control via Inductive Biases
by: Lu, Yupu, et al.
Published: (2025)

Physics-Informed Inductive Biases for Voltage Prediction in Distribution Grids
by: Okoyomon, Ehimare, et al.
Published: (2025)

Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases
by: Vafidis, Pantelis, et al.
Published: (2024)

SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases
by: Liu, Yang, et al.
Published: (2023)

Energy-Gated Attention and Wavelet Positional Encoding: Complementary Inductive Biases for Transformer Attention
by: Zeris, Athanasios
Published: (2026)

Tripod: Three Complementary Inductive Biases for Disentangled Representation Learning
by: Hsu, Kyle, et al.
Published: (2024)

On the Inductive Biases of Demographic Parity-based Fair Learning Algorithms
by: Lei, Haoyu, et al.
Published: (2024)

SeedPrints: Fingerprints Can Even Tell Which Seed Your Large Language Model Was Trained From
by: Tong, Yao, et al.
Published: (2025)

Enhancing the Inductive Biases of Graph Neural ODE for Modeling Dynamical Systems
by: Bishnoi, Suresh, et al.
Published: (2022)

The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning
by: Goldblum, Micah, et al.
Published: (2023)

Leveraging Geometric Visual Illusions as Perceptual Inductive Biases for Vision Models
by: Yang, Haobo, et al.
Published: (2025)

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication
by: Kuciński, Łukasz, et al.
Published: (2021)

Object-Centric Temporal Consistency via Conditional Autoregressive Inductive Biases
by: Meo, Cristian, et al.
Published: (2024)

Temporal Task Diversity: Inductive Biases Under Non-Stationarity in Synthetic Sequence Modelling
by: Aswadi, Afiq Abdillah Effiezal, et al.
Published: (2026)

Biased Dueling Bandits with Stochastic Delayed Feedback
by: Yi, Bongsoo, et al.
Published: (2024)

Character-level Tokenizations as Powerful Inductive Biases for RNA Foundational Models
by: Morales-Pastor, Adrián, et al.
Published: (2024)

Inductive Biases for Zero-shot Systematic Generalization in Language-informed Reinforcement Learning
by: Dijujin, Negin Hashemi, et al.
Published: (2025)

Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases
by: Zhang, Ziyi, et al.
Published: (2024)

From Molecules to Mixtures: Learning Representations of Olfactory Mixture Similarity using Inductive Biases
by: Tom, Gary, et al.
Published: (2025)

Benchmarking Inductive Biases for Multivariate Time-Series Anomaly Detection with a Robust Multi-View Channel-Graph Detector
by: Wei, Junhao, et al.
Published: (2026)

When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets
by: Zeno, Chen, et al.
Published: (2025)

Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild
by: Teney, Damien, et al.
Published: (2025)

Effects of Initialization Biases on Deep Neural Network Training Dynamics
by: Pellegrino, Nicholas, et al.
Published: (2025)

Generalization vs. Memorization in the Presence of Statistical Biases in Transformers
by: Mitros, John
Published: (2024)

Graph-KV: Breaking Sequence via Injecting Structural Biases into Large Language Models
by: Wang, Haoyu, et al.
Published: (2025)