Copertina

The Good, The Efficient and the Inductive Biases: Exploring Efficiency in Deep Learning Through the Use of Inductive Biases

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autore principale:	Romero, David W.
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Demystifying the Hypercomplex: Inductive Biases in Hypercomplex Deep Learning
di: Comminiello, Danilo, et al.
Pubblicazione: (2024)

Language Models Need Inductive Biases to Count Inductively
di: Chang, Yingshan, et al.
Pubblicazione: (2024)

Instilling Inductive Biases with Subnetworks
di: Zhang, Enyan, et al.
Pubblicazione: (2023)

Theoretical Analysis of Inductive Biases in Deep Convolutional Networks
di: Wang, Zihao, et al.
Pubblicazione: (2023)

Geometric Inductive Biases of Deep Networks: The Role of Data and Architecture
di: Movahedi, Sajad, et al.
Pubblicazione: (2024)

Transformers Are Born Biased: Structural Inductive Biases at Random Initialization and Their Practical Consequences
di: Li, Siquan, et al.
Pubblicazione: (2026)

Clustering Inductive Biases with Unrolled Networks
di: Huml, Jonathan, et al.
Pubblicazione: (2023)

Lyapunov Stability Learning with Nonlinear Control via Inductive Biases
di: Lu, Yupu, et al.
Pubblicazione: (2025)

Characterising the Inductive Biases of Neural Networks on Boolean Data
di: Mingard, Chris, et al.
Pubblicazione: (2025)

Architectural and Inferential Inductive Biases For Exchangeable Sequence Modeling
di: Mittal, Daksh, et al.
Pubblicazione: (2025)

Incorporating Inductive Biases to Energy-based Generative Models
di: Li, Yukun, et al.
Pubblicazione: (2025)

Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases
di: Vafidis, Pantelis, et al.
Pubblicazione: (2024)

Priors in Time: Missing Inductive Biases for Language Model Interpretability
di: Lubana, Ekdeep Singh, et al.
Pubblicazione: (2025)

Customizing the Inductive Biases of Softmax Attention using Structured Matrices
di: Kuang, Yilun, et al.
Pubblicazione: (2025)

Tripod: Three Complementary Inductive Biases for Disentangled Representation Learning
di: Hsu, Kyle, et al.
Pubblicazione: (2024)

On the Inductive Biases of Demographic Parity-based Fair Learning Algorithms
di: Lei, Haoyu, et al.
Pubblicazione: (2024)

The No Free Lunch Theorem, Kolmogorov Complexity, and the Role of Inductive Biases in Machine Learning
di: Goldblum, Micah, et al.
Pubblicazione: (2023)

Physics-Informed Inductive Biases for Voltage Prediction in Distribution Grids
di: Okoyomon, Ehimare, et al.
Pubblicazione: (2025)

SEGNO: Generalizing Equivariant Graph Neural Networks with Physical Inductive Biases
di: Liu, Yang, et al.
Pubblicazione: (2023)

Enhancing the Inductive Biases of Graph Neural ODE for Modeling Dynamical Systems
di: Bishnoi, Suresh, et al.
Pubblicazione: (2022)

Integrating Inductive Biases in Transformers via Distillation for Financial Time Series Forecasting
di: Den, Yu-Chen, et al.
Pubblicazione: (2026)

From Kepler to Newton: Inductive Biases Guide Learned World Models in Transformers
di: Liu, Ziming, et al.
Pubblicazione: (2026)

Inductive Biases for Zero-shot Systematic Generalization in Language-informed Reinforcement Learning
di: Dijujin, Negin Hashemi, et al.
Pubblicazione: (2025)

From Molecules to Mixtures: Learning Representations of Olfactory Mixture Similarity using Inductive Biases
di: Tom, Gary, et al.
Pubblicazione: (2025)

Deep Learning Inductive Biases for fMRI Time Series Classification during Resting-state and Movie-watching
di: Khodabandehloo, Behdad, et al.
Pubblicazione: (2025)

Object-Centric Temporal Consistency via Conditional Autoregressive Inductive Biases
di: Meo, Cristian, et al.
Pubblicazione: (2024)

Catalytic Role Of Noise And Necessity Of Inductive Biases In The Emergence Of Compositional Communication
di: Kuciński, Łukasz, et al.
Pubblicazione: (2021)

Temporal Task Diversity: Inductive Biases Under Non-Stationarity in Synthetic Sequence Modelling
di: Aswadi, Afiq Abdillah Effiezal, et al.
Pubblicazione: (2026)

IBiT: Utilizing Inductive Biases to Create a More Data Efficient Attention Mechanism
di: Giri, Adithya
Pubblicazione: (2025)

Character-level Tokenizations as Powerful Inductive Biases for RNA Foundational Models
di: Morales-Pastor, Adrián, et al.
Pubblicazione: (2024)

Leveraging Geometric Visual Illusions as Perceptual Inductive Biases for Vision Models
di: Yang, Haobo, et al.
Pubblicazione: (2025)

Confronting Reward Overoptimization for Diffusion Models: A Perspective of Inductive and Primacy Biases
di: Zhang, Ziyi, et al.
Pubblicazione: (2024)

When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets
di: Zeno, Chen, et al.
Pubblicazione: (2025)

Energy-Gated Attention and Wavelet Positional Encoding: Complementary Inductive Biases for Transformer Attention
di: Zeris, Athanasios
Pubblicazione: (2026)

Do We Always Need the Simplicity Bias? Looking for Optimal Inductive Biases in the Wild
di: Teney, Damien, et al.
Pubblicazione: (2025)

Tiny Recursive Models on ARC-AGI-1: Inductive Biases, Identity Conditioning, and Test-Time Compute
di: Roye-Azar, Antonio, et al.
Pubblicazione: (2025)

Diffusion Model's Generalization Can Be Characterized by Inductive Biases toward a Data-Dependent Ridge Manifold
di: He, Ye, et al.
Pubblicazione: (2026)

Do Robot Snakes Dream like Electric Sheep? Investigating the Effects of Architectural Inductive Biases on Hallucination
di: Huang, Jerry, et al.
Pubblicazione: (2024)

Biased Local SGD for Efficient Deep Learning on Heterogeneous Systems
di: Lim, Jihyun, et al.
Pubblicazione: (2025)

Benchmarking Inductive Biases for Multivariate Time-Series Anomaly Detection with a Robust Multi-View Channel-Graph Detector
di: Wei, Junhao, et al.
Pubblicazione: (2026)