Copertina

Compositional Sparsity as an Inductive Bias for Neural Architecture Design

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Lin, Hongyu, Briola, Antonio, Wang, Yuanrong, Aste, Tomaso
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Granger Causality Detection with Kolmogorov-Arnold Networks
di: Lin, Hongyu, et al.
Pubblicazione: (2024)

Deep Limit Order Book Forecasting
di: Briola, Antonio, et al.
Pubblicazione: (2024)

HLOB -- Information Persistence and Structure in Limit Order Books
di: Briola, Antonio, et al.
Pubblicazione: (2024)

Position: A Theory of Deep Learning Must Include Compositional Sparsity
di: Danhofer, David A., et al.
Pubblicazione: (2025)

Teasing Apart Architecture and Initial Weights as Sources of Inductive Bias in Neural Networks
di: Bencomo, Gianluca, et al.
Pubblicazione: (2025)

Information Filtering Networks: Theoretical Foundations, Generative Methodologies, and Real-World Applications
di: Aste, Tomaso
Pubblicazione: (2025)

Training the Untrainable: Introducing Inductive Bias via Representational Alignment
di: Subramaniam, Vighnesh, et al.
Pubblicazione: (2024)

Small Models, Strong Priors: Architectural Inductive Bias for Parameter-Efficient Neural PDE Solvers
di: Sankaran, Shyam, et al.
Pubblicazione: (2026)

A Relational Inductive Bias for Dimensional Abstraction in Neural Networks
di: Campbell, Declan, et al.
Pubblicazione: (2024)

Disentangling Granularity: An Implicit Inductive Bias in Factorized VAEs
di: Chen, Zihao, et al.
Pubblicazione: (2025)

Graph Regularized PCA
di: Briola, Antonio, et al.
Pubblicazione: (2026)

Soft Geometric Inductive Bias for Object Centric Dynamics
di: Linander, Hampus, et al.
Pubblicazione: (2025)

Structured Diffusion Bridges: Inductive Bias for Denoising Diffusion Bridges
di: Kosman, Eitan, et al.
Pubblicazione: (2026)

Eliminating Inductive Bias in Reward Models with Information-Theoretic Guidance
di: Li, Zhuo, et al.
Pubblicazione: (2025)

MechPert: Mechanistic Consensus as an Inductive Bias for Unseen Perturbation Prediction
di: Martell, Marc Boubnovski, et al.
Pubblicazione: (2026)

Functorial Neural Architectures from Higher Inductive Types
di: Sargsyan, Karen
Pubblicazione: (2026)

On the Inductive Bias of Stacking Towards Improving Reasoning
di: Saunshi, Nikunj, et al.
Pubblicazione: (2024)

Shaping Inductive Bias in Diffusion Models through Frequency-Based Noise Control
di: Jiralerspong, Thomas, et al.
Pubblicazione: (2025)

Group Relative Knowledge Distillation: Learning from Teacher's Relational Inductive Bias
di: Li, Chao, et al.
Pubblicazione: (2025)

Sparsity and Out-of-Distribution Generalization
di: Aaronson, Scott, et al.
Pubblicazione: (2026)

Temporal Inductive Path Neural Network for Temporal Knowledge Graph Reasoning
di: Dong, Hao, et al.
Pubblicazione: (2023)

The Geometric Inductive Bias of Grokking: Bypassing Phase Transitions via Architectural Topology
di: Yıldırım, Alper
Pubblicazione: (2026)

What Has a Foundation Model Found? Using Inductive Bias to Probe for World Models
di: Vafa, Keyon, et al.
Pubblicazione: (2025)

An Attentive Inductive Bias for Sequential Recommendation beyond the Self-Attention
di: Shin, Yehjin, et al.
Pubblicazione: (2023)

Unraveling the Enigma of Double Descent: An In-depth Analysis through the Lens of Learned Feature Space
di: Gu, Yufei, et al.
Pubblicazione: (2023)

Improving Decision Sparsity
di: Sun, Yiyang, et al.
Pubblicazione: (2024)

Minimum Variance Unbiased N:M Sparsity for the Neural Gradients
di: Chmiel, Brian, et al.
Pubblicazione: (2022)

SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases
di: Liu, Yang, et al.
Pubblicazione: (2023)

What Structural Inductive Bias Helps Transformers Reason Over Knowledge Graphs? A Study with Tabula RASA
di: Petersen, Jonas, et al.
Pubblicazione: (2026)

Hierarchical Reasoning Models: Perspectives and Misconceptions
di: Ge, Renee, et al.
Pubblicazione: (2025)

Inductive Moment Matching
di: Zhou, Linqi, et al.
Pubblicazione: (2025)

LoRA Dropout as a Sparsity Regularizer for Overfitting Control
di: Lin, Yang, et al.
Pubblicazione: (2024)

Artificial Intelligence-Driven Network-on-Chip Design Space Exploration: Neural Network Architectures for Design
di: N, Amogh Anshu, et al.
Pubblicazione: (2025)

Homeostasis and Sparsity in Transformer
di: Kotyuzanskiy, Leonid, et al.
Pubblicazione: (2024)

Polar Sparsity: High Throughput Batched LLM Inferencing with Scalable Contextual Sparsity
di: Shrestha, Susav, et al.
Pubblicazione: (2025)

Instilling Inductive Biases with Subnetworks
di: Zhang, Enyan, et al.
Pubblicazione: (2023)

Reevaluation of Inductive Link Prediction
di: Ott, Simon, et al.
Pubblicazione: (2024)

Scaling Attention via Feature Sparsity
di: Xie, Yan, et al.
Pubblicazione: (2026)

Dynamic Sparsity: Challenging Common Sparsity Assumptions for Learning World Models in Robotic Reinforcement Learning Benchmarks
di: Pandaram, Muthukumar, et al.
Pubblicazione: (2025)

Joint Training Across Multiple Activation Sparsity Regimes
di: Wang, Haotian
Pubblicazione: (2026)