Towards Exact Computation of Inductive Bias
Fuente:
arXiv
Saved in:
| Main Authors: | Boopathy, Akhilan, Yue, William, Hwang, Jaedong, Iyer, Abhiram, Fiete, Ila |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Breaking Neural Network Scaling Laws with Modularity
by: Boopathy, Akhilan, et al.
Published: (2024)
by: Boopathy, Akhilan, et al.
Published: (2024)
Unified Neural Network Scaling Laws and Scale-time Equivalence
by: Boopathy, Akhilan, et al.
Published: (2024)
by: Boopathy, Akhilan, et al.
Published: (2024)
Resampling-free Particle Filters in High-dimensions
by: Boopathy, Akhilan, et al.
Published: (2024)
by: Boopathy, Akhilan, et al.
Published: (2024)
Permutation Invariant Learning with High-Dimensional Particle Filters
by: Boopathy, Akhilan, et al.
Published: (2024)
by: Boopathy, Akhilan, et al.
Published: (2024)
Large Pre-Training Datasets Don't Always Guarantee Robustness after Fine-Tuning
by: Hwang, Jaedong, et al.
Published: (2024)
by: Hwang, Jaedong, et al.
Published: (2024)
Grid Cell-Inspired Fragmentation and Recall for Efficient Map Building
by: Hwang, Jaedong, et al.
Published: (2023)
by: Hwang, Jaedong, et al.
Published: (2023)
Uncovering Latent Memories: Assessing Data Leakage and Memorization Patterns in Frontier AI Models
by: Duan, Sunny, et al.
Published: (2024)
by: Duan, Sunny, et al.
Published: (2024)
Learn Globally, Speak Locally: Bridging the Gaps in Multilingual Reasoning
by: Hwang, Jaedong, et al.
Published: (2025)
by: Hwang, Jaedong, et al.
Published: (2025)
Delay Embedding Theory of Neural Sequence Models
by: Ostrow, Mitchell, et al.
Published: (2024)
by: Ostrow, Mitchell, et al.
Published: (2024)
Modular connectivity in neural networks emerges from Poisson noise-motivated regularisation, and promotes robustness and compositional generalisation
by: Qian, Daoyuan, et al.
Published: (2025)
by: Qian, Daoyuan, et al.
Published: (2025)
Do Diffusion Models Learn Semantically Meaningful and Efficient Representations?
by: Liang, Qiyao, et al.
Published: (2024)
by: Liang, Qiyao, et al.
Published: (2024)
Key-value memory in the brain
by: Gershman, Samuel J., et al.
Published: (2025)
by: Gershman, Samuel J., et al.
Published: (2025)
Compositional Generalization via Forced Rendering of Disentangled Latents
by: Liang, Qiyao, et al.
Published: (2025)
by: Liang, Qiyao, et al.
Published: (2025)
How Diffusion Models Learn to Factorize and Compose
by: Liang, Qiyao, et al.
Published: (2024)
by: Liang, Qiyao, et al.
Published: (2024)
On the Inductive Bias of Stacking Towards Improving Reasoning
by: Saunshi, Nikunj, et al.
Published: (2024)
by: Saunshi, Nikunj, et al.
Published: (2024)
Dataset Difficulty and the Role of Inductive Bias
by: Kwok, Devin, et al.
Published: (2024)
by: Kwok, Devin, et al.
Published: (2024)
Interpolated-MLPs: Controllable Inductive Bias
by: Wu, Sean, et al.
Published: (2024)
by: Wu, Sean, et al.
Published: (2024)
Theoretical Investigation on Inductive Bias of Isolation Forest
by: Zheng, Qin-Cheng, et al.
Published: (2025)
by: Zheng, Qin-Cheng, et al.
Published: (2025)
The Blessing of Dimensionality in LLM Fine-tuning: A Variance-Curvature Perspective
by: Liang, Qiyao, et al.
Published: (2026)
by: Liang, Qiyao, et al.
Published: (2026)
Algorithmic Task Capture, Computational Complexity, and Inductive Bias of Infinite Transformers
by: Davidovich, Orit, et al.
Published: (2026)
by: Davidovich, Orit, et al.
Published: (2026)
Improving Protein Optimization with Smoothed Fitness Landscapes
by: Kirjner, Andrew, et al.
Published: (2023)
by: Kirjner, Andrew, et al.
Published: (2023)
Graph Classification with GNNs: Optimisation, Representation and Inductive Bias
by: a, P. Krishna Kumar, et al.
Published: (2024)
by: a, P. Krishna Kumar, et al.
Published: (2024)
Data Distributional Properties As Inductive Bias for Systematic Generalization
by: del Rio, Felipe, et al.
Published: (2025)
by: del Rio, Felipe, et al.
Published: (2025)
Explaining Grokking in Transformers through the Lens of Inductive Bias
by: Singh, Jaisidh, et al.
Published: (2026)
by: Singh, Jaisidh, et al.
Published: (2026)
Towards Understanding Inductive Bias in Transformers: A View From Infinity
by: Lavie, Itay, et al.
Published: (2024)
by: Lavie, Itay, et al.
Published: (2024)
Rethinking Inductive Bias in Geographically Neural Network Weighted Regression
by: Chen, Zhenyuan
Published: (2025)
by: Chen, Zhenyuan
Published: (2025)
Structural Disentanglement in Bilinear MLPs via Architectural Inductive Bias
by: Nema, Ojasva, et al.
Published: (2026)
by: Nema, Ojasva, et al.
Published: (2026)
InputDSA: Demixing then Comparing Recurrent and Externally Driven Dynamics
by: Huang, Ann, et al.
Published: (2025)
by: Huang, Ann, et al.
Published: (2025)
Disentangling Granularity: An Implicit Inductive Bias in Factorized VAEs
by: Chen, Zihao, et al.
Published: (2025)
by: Chen, Zihao, et al.
Published: (2025)
Soft Geometric Inductive Bias for Object Centric Dynamics
by: Linander, Hampus, et al.
Published: (2025)
by: Linander, Hampus, et al.
Published: (2025)
Compositional Sparsity as an Inductive Bias for Neural Architecture Design
by: Lin, Hongyu, et al.
Published: (2026)
by: Lin, Hongyu, et al.
Published: (2026)
Constraint Breeds Generalization: Temporal Dynamics as an Inductive Bias
by: Chen, Xia
Published: (2025)
by: Chen, Xia
Published: (2025)
A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning
by: Anguita, Nicolas, et al.
Published: (2026)
by: Anguita, Nicolas, et al.
Published: (2026)
Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks
by: Lu, Jiahao
Published: (2025)
by: Lu, Jiahao
Published: (2025)
Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum
by: Geifman, Amnon, et al.
Published: (2023)
by: Geifman, Amnon, et al.
Published: (2023)
Efficient Data Subset Selection to Generalize Training Across Models: Transductive and Inductive Networks
by: Jain, Eeshaan, et al.
Published: (2024)
by: Jain, Eeshaan, et al.
Published: (2024)
DeepOSets: Non-Autoregressive In-Context Learning with Permutation-Invariance Inductive Bias
by: Chiu, Shao-Ting, et al.
Published: (2024)
by: Chiu, Shao-Ting, et al.
Published: (2024)
A Locality Radius Framework for Understanding Relational Inductive Bias in Database Learning
by: Joshi, Aadi, et al.
Published: (2026)
by: Joshi, Aadi, et al.
Published: (2026)
Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networks
by: Caralt, Ferran Hernandez, et al.
Published: (2024)
by: Caralt, Ferran Hernandez, et al.
Published: (2024)
A Relational Inductive Bias for Dimensional Abstraction in Neural Networks
by: Campbell, Declan, et al.
Published: (2024)
by: Campbell, Declan, et al.
Published: (2024)
Similar Items
-
Breaking Neural Network Scaling Laws with Modularity
by: Boopathy, Akhilan, et al.
Published: (2024) -
Unified Neural Network Scaling Laws and Scale-time Equivalence
by: Boopathy, Akhilan, et al.
Published: (2024) -
Resampling-free Particle Filters in High-dimensions
by: Boopathy, Akhilan, et al.
Published: (2024) -
Permutation Invariant Learning with High-Dimensional Particle Filters
by: Boopathy, Akhilan, et al.
Published: (2024) -
Large Pre-Training Datasets Don't Always Guarantee Robustness after Fine-Tuning
by: Hwang, Jaedong, et al.
Published: (2024)