Cover Image

Learning High-Degree Parities: The Crucial Role of the Initialization

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Abbe, Emmanuel, Cornacchia, Elisabetta, Hązła, Jan, Kougang-Yombi, Donald
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Quantitative Version of More Capable Channel Comparison
by: Kougang-Yombi, Donald, et al.
Published: (2024)

Weight distribution bounds to relate minimum distance, list decoding, and symmetric channel performance
by: Kougang-Yombi, Donald, et al.
Published: (2026)

A Mathematical Model for Curriculum Learning for Parities
by: Cornacchia, Elisabetta, et al.
Published: (2023)

Intransitive dice tournament is not quasirandom
by: Cornacchia, Elisabetta, et al.
Published: (2020)

Learning with Shallow Neural Networks on Cluster-Structured Features
by: Cornacchia, Elisabetta, et al.
Published: (2026)

On the Minimal Degree Bias in Generalization on the Unseen for non-Boolean Functions
by: Pushkin, Denys, et al.
Published: (2024)

Generalization on the Unseen, Logic Reasoning and Degree Curriculum
by: Abbe, Emmanuel, et al.
Published: (2023)

The Benefits of Temporal Correlations: SGD Learns k-Juntas from Random Walks Efficiently
by: Cornacchia, Elisabetta, et al.
Published: (2026)

On the Crucial Role of Initialization for Matrix Factorization
by: Li, Bingcong, et al.
Published: (2024)

Low-dimensional Functions are Efficiently Learnable under Randomly Biased Distributions
by: Cornacchia, Elisabetta, et al.
Published: (2025)

Transformation-Invariant Learning and Theoretical Guarantees for OOD Generalization
by: Montasser, Omar, et al.
Published: (2024)

Positive Distribution Shift as a Framework for Understanding Tractable Learning
by: Medvedev, Marko, et al.
Published: (2026)

Goldilocks RL: Tuning Task Difficulty to Escape Sparse Rewards for Reasoning
by: Mahrooghi, Ilia, et al.
Published: (2026)

$k$-server-bench: Automating Potential Discovery for the $k$-Server Conjecture
by: Brilliantov, Kirill, et al.
Published: (2026)

The Crucial Role of Problem Formulation in Real-World Reinforcement Learning
by: Schäfer, Georg, et al.
Published: (2025)

The merged-staircase property: a necessary and nearly sufficient condition for SGD learning of sparse functions on two-layer neural networks
by: Abbe, Emmanuel, et al.
Published: (2022)

The Crucial Role of Samplers in Online Direct Preference Optimization
by: Shi, Ruizhe, et al.
Published: (2024)

Inductive Domain Transfer In Misspecified Simulation-Based Inference
by: Senouf, Ortal, et al.
Published: (2025)

How Far Can Transformers Reason? The Globality Barrier and Inductive Scratchpad
by: Abbe, Emmanuel, et al.
Published: (2024)

Tokenizer Choice For LLM Training: Negligible or Crucial?
by: Ali, Mehdi, et al.
Published: (2023)

Learning High-Dimensional Parity Functions with Product Networks using Gradient Descent
by: Larue, Guillaume, et al.
Published: (2026)

Chain-of-Sketch: Enabling Global Visual Reasoning
by: Lotfi, Aryo, et al.
Published: (2024)

Hardness of Learning Fixed Parities with Neural Networks
by: Shoshani, Itamar, et al.
Published: (2025)

Keeping LLMs Aligned After Fine-tuning: The Crucial Role of Prompt Templates
by: Lyu, Kaifeng, et al.
Published: (2024)

Loss Gap Parity for Fairness in Heterogeneous Federated Learning
by: Erraji, Brahim, et al.
Published: (2026)

To Infinity and Beyond: Tool-Use Unlocks Length Generalization in State Space Models
by: Malach, Eran, et al.
Published: (2025)

Boolformer: Symbolic Regression of Logic Functions with Transformers
by: d'Ascoli, Stéphane, et al.
Published: (2023)

Learning Optimal Individualized Decision Rules with Conditional Demographic Parity
by: Cui, Wenhai, et al.
Published: (2026)

Differential Adjusted Parity for Learning Fair Representations
by: Sahyouni, Bucher, et al.
Published: (2025)

Computationally Efficient Replicable Learning of Parities and Applications
by: Noivirt, Moshe, et al.
Published: (2026)

When can transformers reason with abstract symbols?
by: Boix-Adsera, Enric, et al.
Published: (2023)

Demographic Parity Tails for Regression
by: Le, Naht Sinh, et al.
Published: (2026)

Approximating the Number of Relevant Variables in a Parity Implies Proper Learning
by: Bshouty, Nader H., et al.
Published: (2024)

RL for Reasoning by Adaptively Revealing Rationales
by: Amani, Mohammad Hossein, et al.
Published: (2025)

SDGym: Low-Code Reinforcement Learning Environments using System Dynamics Models
by: Klu, Emmanuel, et al.
Published: (2023)

Collaboration Between the City and Machine Learning Community is Crucial to Efficient Autonomous Vehicles Routing
by: Psarou, Anastasia, et al.
Published: (2025)

Parity, Sensitivity, and Transformers
by: Kozachinskiy, Alexander, et al.
Published: (2026)

Autocorrelation Matters: Understanding the Role of Initialization Schemes for State Space Models
by: Liu, Fusheng, et al.
Published: (2024)

A Bioinformatic Approach Validated Utilizing Machine Learning Algorithms to Identify Relevant Biomarkers and Crucial Pathways in Gallbladder Cancer
by: Khatun, Rabea, et al.
Published: (2024)

Unravelling the (In)compatibility of Statistical-Parity and Equalized-Odds
by: Bargh, Mortaza S., et al.
Published: (2026)