Interpolated-MLPs: Controllable Inductive Bias
Fuente:
arXiv
Saved in:
| Main Authors: | Wu, Sean, Hong, Jordan, Bai, Keyu, Bachmann, Gregor |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Structural Disentanglement in Bilinear MLPs via Architectural Inductive Bias
by: Nema, Ojasva, et al.
Published: (2026)
by: Nema, Ojasva, et al.
Published: (2026)
Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum
by: Geifman, Amnon, et al.
Published: (2023)
by: Geifman, Amnon, et al.
Published: (2023)
Dataset Difficulty and the Role of Inductive Bias
by: Kwok, Devin, et al.
Published: (2024)
by: Kwok, Devin, et al.
Published: (2024)
Towards Exact Computation of Inductive Bias
by: Boopathy, Akhilan, et al.
Published: (2024)
by: Boopathy, Akhilan, et al.
Published: (2024)
DeepOSets: Non-Autoregressive In-Context Learning with Permutation-Invariance Inductive Bias
by: Chiu, Shao-Ting, et al.
Published: (2024)
by: Chiu, Shao-Ting, et al.
Published: (2024)
Theoretical Investigation on Inductive Bias of Isolation Forest
by: Zheng, Qin-Cheng, et al.
Published: (2025)
by: Zheng, Qin-Cheng, et al.
Published: (2025)
Graph Classification with GNNs: Optimisation, Representation and Inductive Bias
by: a, P. Krishna Kumar, et al.
Published: (2024)
by: a, P. Krishna Kumar, et al.
Published: (2024)
Data Distributional Properties As Inductive Bias for Systematic Generalization
by: del Rio, Felipe, et al.
Published: (2025)
by: del Rio, Felipe, et al.
Published: (2025)
Explaining Grokking in Transformers through the Lens of Inductive Bias
by: Singh, Jaisidh, et al.
Published: (2026)
by: Singh, Jaisidh, et al.
Published: (2026)
Shaping Inductive Bias in Diffusion Models through Frequency-Based Noise Control
by: Jiralerspong, Thomas, et al.
Published: (2025)
by: Jiralerspong, Thomas, et al.
Published: (2025)
Converting MLPs into Polynomials in Closed Form
by: Belrose, Nora, et al.
Published: (2025)
by: Belrose, Nora, et al.
Published: (2025)
Edge-free but Structure-aware: Prototype-Guided Knowledge Distillation from GNNs to MLPs
by: Wu, Taiqiang, et al.
Published: (2023)
by: Wu, Taiqiang, et al.
Published: (2023)
MLPs at the EOC: Spectrum of the NTK
by: Terjék, Dávid, et al.
Published: (2025)
by: Terjék, Dávid, et al.
Published: (2025)
MLPs at the EOC: Concentration of the NTK
by: Terjék, Dávid, et al.
Published: (2025)
by: Terjék, Dávid, et al.
Published: (2025)
Rethinking Inductive Bias in Geographically Neural Network Weighted Regression
by: Chen, Zhenyuan
Published: (2025)
by: Chen, Zhenyuan
Published: (2025)
Provable FDR Control for Deep Feature Selection: Deep MLPs and Beyond
by: Sawaya, Kazuma
Published: (2025)
by: Sawaya, Kazuma
Published: (2025)
Benchmarking Optimizers for MLPs in Tabular Deep Learning
by: Gorishniy, Yury, et al.
Published: (2026)
by: Gorishniy, Yury, et al.
Published: (2026)
Disentangling Granularity: An Implicit Inductive Bias in Factorized VAEs
by: Chen, Zihao, et al.
Published: (2025)
by: Chen, Zihao, et al.
Published: (2025)
Soft Geometric Inductive Bias for Object Centric Dynamics
by: Linander, Hampus, et al.
Published: (2025)
by: Linander, Hampus, et al.
Published: (2025)
Compositional Sparsity as an Inductive Bias for Neural Architecture Design
by: Lin, Hongyu, et al.
Published: (2026)
by: Lin, Hongyu, et al.
Published: (2026)
Constraint Breeds Generalization: Temporal Dynamics as an Inductive Bias
by: Chen, Xia
Published: (2025)
by: Chen, Xia
Published: (2025)
A Theory of How Pretraining Shapes Inductive Bias in Fine-Tuning
by: Anguita, Nicolas, et al.
Published: (2026)
by: Anguita, Nicolas, et al.
Published: (2026)
Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks
by: Lu, Jiahao
Published: (2025)
by: Lu, Jiahao
Published: (2025)
The pitfalls of next-token prediction
by: Bachmann, Gregor, et al.
Published: (2024)
by: Bachmann, Gregor, et al.
Published: (2024)
Bilinear MLPs enable weight-based mechanistic interpretability
by: Pearce, Michael T., et al.
Published: (2024)
by: Pearce, Michael T., et al.
Published: (2024)
Hyperparameter Tuning MLPs for Probabilistic Time Series Forecasting
by: Madhusudhanan, Kiran, et al.
Published: (2024)
by: Madhusudhanan, Kiran, et al.
Published: (2024)
On the Inductive Bias of Stacking Towards Improving Reasoning
by: Saunshi, Nikunj, et al.
Published: (2024)
by: Saunshi, Nikunj, et al.
Published: (2024)
Mimetic Initialization of MLPs
by: Trockman, Asher, et al.
Published: (2026)
by: Trockman, Asher, et al.
Published: (2026)
A Locality Radius Framework for Understanding Relational Inductive Bias in Database Learning
by: Joshi, Aadi, et al.
Published: (2026)
by: Joshi, Aadi, et al.
Published: (2026)
Joint Diffusion Processes as an Inductive Bias in Sheaf Neural Networks
by: Caralt, Ferran Hernandez, et al.
Published: (2024)
by: Caralt, Ferran Hernandez, et al.
Published: (2024)
A Relational Inductive Bias for Dimensional Abstraction in Neural Networks
by: Campbell, Declan, et al.
Published: (2024)
by: Campbell, Declan, et al.
Published: (2024)
Structured Diffusion Bridges: Inductive Bias for Denoising Diffusion Bridges
by: Kosman, Eitan, et al.
Published: (2026)
by: Kosman, Eitan, et al.
Published: (2026)
Eliminating Inductive Bias in Reward Models with Information-Theoretic Guidance
by: Li, Zhuo, et al.
Published: (2025)
by: Li, Zhuo, et al.
Published: (2025)
Constructing Efficient Fact-Storing MLPs for Transformers
by: Dugan, Owen, et al.
Published: (2025)
by: Dugan, Owen, et al.
Published: (2025)
Team up GBDTs and DNNs: Advancing Efficient and Effective Tabular Prediction with Tree-hybrid MLPs
by: Yan, Jiahuan, et al.
Published: (2024)
by: Yan, Jiahuan, et al.
Published: (2024)
Structural Abstraction as an Inductive Bias for Non-Stationary Language Model Training
by: Rahmati, Elnaz, et al.
Published: (2026)
by: Rahmati, Elnaz, et al.
Published: (2026)
MechPert: Mechanistic Consensus as an Inductive Bias for Unseen Perturbation Prediction
by: Martell, Marc Boubnovski, et al.
Published: (2026)
by: Martell, Marc Boubnovski, et al.
Published: (2026)
MLPs Learn In-Context on Regression and Classification Tasks
by: Tong, William L., et al.
Published: (2024)
by: Tong, William L., et al.
Published: (2024)
How Good is a Single Basin?
by: Lion, Kai, et al.
Published: (2024)
by: Lion, Kai, et al.
Published: (2024)
Hedonic Neurons: A Mechanistic Mapping of Latent Coalitions in Transformer MLPs
by: Chowdhury, Tanya, et al.
Published: (2025)
by: Chowdhury, Tanya, et al.
Published: (2025)
Similar Items
-
Structural Disentanglement in Bilinear MLPs via Architectural Inductive Bias
by: Nema, Ojasva, et al.
Published: (2026) -
Controlling the Inductive Bias of Wide Neural Networks by Modifying the Kernel's Spectrum
by: Geifman, Amnon, et al.
Published: (2023) -
Dataset Difficulty and the Role of Inductive Bias
by: Kwok, Devin, et al.
Published: (2024) -
Towards Exact Computation of Inductive Bias
by: Boopathy, Akhilan, et al.
Published: (2024) -
DeepOSets: Non-Autoregressive In-Context Learning with Permutation-Invariance Inductive Bias
by: Chiu, Shao-Ting, et al.
Published: (2024)