Characterising the Inductive Biases of Neural Networks on Boolean Data
Fuente:
arXiv
Saved in:
| Main Authors: | Mingard, Chris, Seier, Lukas, Göring, Niclas, Badelita, Andrei-Vlad, London, Charles, Louis, Ard |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
A simple mean field model of feature learning
by: Göring, Niclas, et al.
Published: (2025)
by: Göring, Niclas, et al.
Published: (2025)
Feature learning is decoupled from generalization in high capacity neural networks
by: Göring, Niclas Alexander, et al.
Published: (2025)
by: Göring, Niclas Alexander, et al.
Published: (2025)
Decoupling Dynamical Richness from Representation Learning: Towards Practical Measurement
by: Nam, Yoonsoo, et al.
Published: (2024)
by: Nam, Yoonsoo, et al.
Published: (2024)
Deep neural networks have an inbuilt Occam's razor
by: Mingard, Chris, et al.
Published: (2023)
by: Mingard, Chris, et al.
Published: (2023)
An exactly solvable model for emergence and scaling laws in the multitask sparse parity problem
by: Nam, Yoonsoo, et al.
Published: (2024)
by: Nam, Yoonsoo, et al.
Published: (2024)
Exploiting the equivalence between quantum neural networks and perceptrons
by: Mingard, Chris, et al.
Published: (2024)
by: Mingard, Chris, et al.
Published: (2024)
Position: Solve Layerwise Linear Models First to Understand Neural Dynamical Phenomena (Neural Collapse, Emergence, Lazy/Rich Regime, and Grokking)
by: Nam, Yoonsoo, et al.
Published: (2025)
by: Nam, Yoonsoo, et al.
Published: (2025)
Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture
by: Movahedi, Sajad, et al.
Published: (2024)
by: Movahedi, Sajad, et al.
Published: (2024)
SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases
by: Liu, Yang, et al.
Published: (2023)
by: Liu, Yang, et al.
Published: (2023)
Theoretical Analysis of Inductive Biases in Deep Convolutional Networks
by: Wang, Zihao, et al.
Published: (2023)
by: Wang, Zihao, et al.
Published: (2023)
Clustering Inductive Biases with Unrolled Networks
by: Huml, Jonathan, et al.
Published: (2023)
by: Huml, Jonathan, et al.
Published: (2023)
The Good, The Efficient and the Inductive Biases: Exploring Efficiency in Deep Learning Through the Use of Inductive Biases
by: Romero, David W.
Published: (2024)
by: Romero, David W.
Published: (2024)
Position: Many generalization measures for deep learning are fragile
by: Zhang, Shuofeng, et al.
Published: (2025)
by: Zhang, Shuofeng, et al.
Published: (2025)
Language Models Need Inductive Biases to Count Inductively
by: Chang, Yingshan, et al.
Published: (2024)
by: Chang, Yingshan, et al.
Published: (2024)
Instilling Inductive Biases with Subnetworks
by: Zhang, Enyan, et al.
Published: (2023)
by: Zhang, Enyan, et al.
Published: (2023)
Closed-form $\ell_r$ norm scaling with data for overparameterized linear regression and diagonal linear networks under $\ell_p$ bias
by: Zhang, Shuofeng, et al.
Published: (2025)
by: Zhang, Shuofeng, et al.
Published: (2025)
Enhancing the Inductive Biases of Graph Neural ODE for Modeling Dynamical Systems
by: Bishnoi, Suresh, et al.
Published: (2022)
by: Bishnoi, Suresh, et al.
Published: (2022)
Transformers Are Born Biased: Structural Inductive Biases at Random Initialization and Their Practical Consequences
by: Li, Siquan, et al.
Published: (2026)
by: Li, Siquan, et al.
Published: (2026)
Out-of-Domain Generalization in Dynamical Systems Reconstruction
by: Göring, Niclas, et al.
Published: (2024)
by: Göring, Niclas, et al.
Published: (2024)
Architectural and Inferential Inductive Biases For Exchangeable Sequence Modeling
by: Mittal, Daksh, et al.
Published: (2025)
by: Mittal, Daksh, et al.
Published: (2025)
Incorporating Inductive Biases to Energy-based Generative Models
by: Li, Yukun, et al.
Published: (2025)
by: Li, Yukun, et al.
Published: (2025)
Conformal Inductive Graph Neural Networks
by: Zargarbashi, Soroush H., et al.
Published: (2024)
by: Zargarbashi, Soroush H., et al.
Published: (2024)
When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets
by: Zeno, Chen, et al.
Published: (2025)
by: Zeno, Chen, et al.
Published: (2025)
Priors in Time: Missing Inductive Biases for Language Model Interpretability
by: Lubana, Ekdeep Singh, et al.
Published: (2025)
by: Lubana, Ekdeep Singh, et al.
Published: (2025)
Customizing the Inductive Biases of Softmax Attention using Structured Matrices
by: Kuang, Yilun, et al.
Published: (2025)
by: Kuang, Yilun, et al.
Published: (2025)
Boolean Product Graph Neural Networks
by: Wang, Ziyan, et al.
Published: (2024)
by: Wang, Ziyan, et al.
Published: (2024)
Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning
by: Comminiello, Danilo, et al.
Published: (2024)
by: Comminiello, Danilo, et al.
Published: (2024)
Lyapunov Stability Learning with Nonlinear Control via Inductive Biases
by: Lu, Yupu, et al.
Published: (2025)
by: Lu, Yupu, et al.
Published: (2025)
Inductive Spatial Temporal Prediction Under Data Drift with Informative Graph Neural Network
by: Zheng, Jialun, et al.
Published: (2024)
by: Zheng, Jialun, et al.
Published: (2024)
Boolean Logic as an Error feedback mechanism
by: Leconte, Louis
Published: (2024)
by: Leconte, Louis
Published: (2024)
Physics-Informed Inductive Biases for Voltage Prediction in Distribution Grids
by: Okoyomon, Ehimare, et al.
Published: (2025)
by: Okoyomon, Ehimare, et al.
Published: (2025)
Boolean-aware Boolean Circuit Classification: A Comprehensive Study on Graph Neural Network
by: Ni, Liwei, et al.
Published: (2024)
by: Ni, Liwei, et al.
Published: (2024)
Integrating Inductive Biases in Transformers via Distillation for Financial Time Series Forecasting
by: Den, Yu-Chen, et al.
Published: (2026)
by: Den, Yu-Chen, et al.
Published: (2026)
The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning
by: Goldblum, Micah, et al.
Published: (2023)
by: Goldblum, Micah, et al.
Published: (2023)
Rethinking Inductive Bias in Geographically Neural Network Weighted Regression
by: Chen, Zhenyuan
Published: (2025)
by: Chen, Zhenyuan
Published: (2025)
Neural Artistic Style and Color Transfer Using Deep Learning
by: London, Justin
Published: (2025)
by: London, Justin
Published: (2025)
Temporal Task Diversity: Inductive Biases Under Non-Stationarity in Synthetic Sequence Modelling
by: Aswadi, Afiq Abdillah Effiezal, et al.
Published: (2026)
by: Aswadi, Afiq Abdillah Effiezal, et al.
Published: (2026)
Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases
by: Vafidis, Pantelis, et al.
Published: (2024)
by: Vafidis, Pantelis, et al.
Published: (2024)
Pause Tokens Strictly Increase the Expressivity of Constant-Depth Transformers
by: London, Charles, et al.
Published: (2025)
by: London, Charles, et al.
Published: (2025)
Frequency Regularization: Unveiling the Spectral Inductive Bias of Deep Neural Networks
by: Lu, Jiahao
Published: (2025)
by: Lu, Jiahao
Published: (2025)
Similar Items
-
A simple mean field model of feature learning
by: Göring, Niclas, et al.
Published: (2025) -
Feature learning is decoupled from generalization in high capacity neural networks
by: Göring, Niclas Alexander, et al.
Published: (2025) -
Decoupling Dynamical Richness from Representation Learning: Towards Practical Measurement
by: Nam, Yoonsoo, et al.
Published: (2024) -
Deep neural networks have an inbuilt Occam's razor
by: Mingard, Chris, et al.
Published: (2023) -
An exactly solvable model for emergence and scaling laws in the multitask sparse parity problem
by: Nam, Yoonsoo, et al.
Published: (2024)