Cover Image

On the Minimal Degree Bias in Generalization on the Unseen for non-Boolean Functions

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pushkin, Denys, Berthier, Raphaël, Abbe, Emmanuel
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Generalization on the Unseen, Logic Reasoning and Degree Curriculum
by: Abbe, Emmanuel, et al.
Published: (2023)

LEAD: Breaking the No-Recovery Bottleneck in Long-Horizon Reasoning
by: Pushkin, Denys, et al.
Published: (2026)

Learning High-Degree Parities: The Crucial Role of the Initialization
by: Abbe, Emmanuel, et al.
Published: (2024)

Transformation-Invariant Learning and Theoretical Guarantees for OOD Generalization
by: Montasser, Omar, et al.
Published: (2024)

Diagonal Linear Networks and the Lasso Regularization Path
by: Berthier, Raphaël
Published: (2025)

Goldilocks RL: Tuning Task Difficulty to Escape Sparse Rewards for Reasoning
by: Mahrooghi, Ilia, et al.
Published: (2026)

$k$-server-bench: Automating Potential Discovery for the $k$-Server Conjecture
by: Brilliantov, Kirill, et al.
Published: (2026)

The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks
by: Abbe, Emmanuel, et al.
Published: (2022)

Attention layers provably solve single-location regression
by: Marion, Pierre, et al.
Published: (2024)

Boolformer: Symbolic Regression of Logic Functions with Transformers
by: d'Ascoli, Stéphane, et al.
Published: (2023)

No-Regret Gaussian Process Optimization of Time-Varying Functions
by: Mauduit, Eliabelle, et al.
Published: (2025)

Inductive Domain Transfer In Misspecified Simulation-Based Inference
by: Senouf, Ortal, et al.
Published: (2025)

To Infinity and Beyond: Tool-Use Unlocks Length Generalization in State Space Models
by: Malach, Eran, et al.
Published: (2025)

How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad
by: Abbe, Emmanuel, et al.
Published: (2024)

MechPert: Mechanistic Consensus as an Inductive Bias for Unseen Perturbation Prediction
by: Martell, Marc Boubnovski, et al.
Published: (2026)

Mitigating Degree Bias in Signed Graph Neural Networks
by: He, Fang, et al.
Published: (2024)

Retrieval-Guided Reinforcement Learning for Boolean Circuit Minimization
by: Chowdhury, Animesh Basak, et al.
Published: (2024)

Learning time-scales in two-layers neural networks
by: Berthier, Raphaël, et al.
Published: (2023)

Chain-of-Sketch: Enabling Global Visual Reasoning
by: Lotfi, Aryo, et al.
Published: (2024)

Fourier Analysis on the Boolean Hypercube via Hoeffding Functional Decomposition
by: Ferrere, Baptiste, et al.
Published: (2025)

Hyperbolic Aware Minimization: Implicit Bias for Sparsity
by: Jacobs, Tom, et al.
Published: (2025)

Toward Quantum Utility in Finance: A Robust Data-Driven Algorithm for Asset Clustering
by: Sharma, Shivam, et al.
Published: (2025)

Convergence Guarantees for Federated SARSA with Local Training and Heterogeneous Agents
by: Mangold, Paul, et al.
Published: (2025)

Controlled Generation of Unseen Faults for Partial and Open-Partial Domain Adaptation
by: Rombach, Katharina, et al.
Published: (2022)

Implicit Bias of Policy Gradient in Linear Quadratic Control: Extrapolation to Unseen Initial States
by: Razin, Noam, et al.
Published: (2024)

BooleanOCT: Optimal Classification Trees based on multivariate Boolean Rules
by: Tu, Jiancheng, et al.
Published: (2024)

Generalizing to Unseen Disaster Events: A Causal View
by: Seeberger, Philipp, et al.
Published: (2025)

Functional Risk Minimization
by: Alet, Ferran, et al.
Published: (2024)

Minimalist Softmax Attention Provably Learns Constrained Boolean Functions
by: Hu, Jerry Yao-Chieh, et al.
Published: (2025)

Generalization Beyond Benchmarks: Evaluating Learnable Protein-Ligand Scoring Functions on Unseen Targets
by: Kopko, Jakub, et al.
Published: (2025)

Adversarial Déjà Vu: Jailbreak Dictionary Learning for Stronger Generalization to Unseen Attacks
by: Dabas, Mahavir, et al.
Published: (2025)

A Boolean Function-Theoretic Framework for Expressivity in GNNs with Applications to Fair Graph Mining
by: Pal, Manjish
Published: (2026)

Instruction Diversity Drives Generalization To Unseen Tasks
by: Zhang, Dylan, et al.
Published: (2024)

Theoretical and Empirical Insights into the Origins of Degree Bias in Graph Neural Networks
by: Subramonian, Arjun, et al.
Published: (2024)

When can transformers reason with abstract symbols?
by: Boix-Adsera, Enric, et al.
Published: (2023)

Bias-Reduced Estimation of Finite Mixtures: An Application to Latent Group Structures in Panel Data
by: Langevin, Raphaël
Published: (2026)

MADOD: Generalizing OOD Detection to Unseen Domains via G-Invariance Meta-Learning
by: Wang, Haoliang, et al.
Published: (2024)

Learning Nonlinearity of Boolean Functions: An Experimentation with Neural Networks
by: Ranga, Sriram, et al.
Published: (2025)

NeuraLUT: Hiding Neural Network Density in Boolean Synthesizable Functions
by: Andronic, Marta, et al.
Published: (2024)

Simplicity Bias via Global Convergence of Sharpness Minimization
by: Gatmiry, Khashayar, et al.
Published: (2024)