The Relational Bottleneck as an Inductive Bias for Efficient Abstraction
Fuente:
arXiv
Saved in:
| Main Authors: | Webb, Taylor W., Frankland, Steven M., Altabaa, Awni, Segert, Simon, Krishnamurthy, Kamesh, Campbell, Declan, Russin, Jacob, Giallanza, Tyler, Dulberg, Zack, O'Reilly, Randall, Lafferty, John, Cohen, Jonathan D. |
|---|---|
| Format: | Preprint |
| Published: |
2023
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
A Group Theoretic Analysis of the Symmetries Underlying Base Addition and Their Learnability by Neural Networks
by: Dawes, Cutter, et al.
Published: (2025)
by: Dawes, Cutter, et al.
Published: (2025)
Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers
by: Altabaa, Awni, et al.
Published: (2023)
by: Altabaa, Awni, et al.
Published: (2023)
Disentangling and Integrating Relational and Sensory Information in Transformer Architectures
by: Altabaa, Awni, et al.
Published: (2024)
by: Altabaa, Awni, et al.
Published: (2024)
Approximation of relation functions and attention mechanisms
by: Altabaa, Awni, et al.
Published: (2024)
by: Altabaa, Awni, et al.
Published: (2024)
Learning Hierarchical Relational Representations through Relational Convolutions
by: Altabaa, Awni, et al.
Published: (2023)
by: Altabaa, Awni, et al.
Published: (2023)
A Relational Inductive Bias for Dimensional Abstraction in Neural Networks
by: Campbell, Declan, et al.
Published: (2024)
by: Campbell, Declan, et al.
Published: (2024)
CoT Information: Improved Sample Complexity under Chain-of-Thought Supervision
by: Altabaa, Awni, et al.
Published: (2025)
by: Altabaa, Awni, et al.
Published: (2025)
The dynamic interplay between in-context and in-weight learning in humans and neural networks
by: Russin, Jacob, et al.
Published: (2024)
by: Russin, Jacob, et al.
Published: (2024)
Human-Like Geometric Abstraction in Large Pre-trained Neural Networks
by: Campbell, Declan, et al.
Published: (2024)
by: Campbell, Declan, et al.
Published: (2024)
From Frege to chatGPT: Compositionality in language, cognition, and deep neural networks
by: Russin, Jacob, et al.
Published: (2024)
by: Russin, Jacob, et al.
Published: (2024)
Unlocking Out-of-Distribution Generalization in Transformers via Recursive Latent Space Reasoning
by: Altabaa, Awni, et al.
Published: (2025)
by: Altabaa, Awni, et al.
Published: (2025)
Flexible Prefrontal Control over Hippocampal Episodic Memory for Goal-Directed Generalization
by: Zheng, Yicong, et al.
Published: (2025)
by: Zheng, Yicong, et al.
Published: (2025)
Evolutionary and Coevolutionary Multi-Agent Design Choices and Dynamics
by: Hemberg, Erik, et al.
Published: (2025)
by: Hemberg, Erik, et al.
Published: (2025)
On the Role of Information Structure in Reinforcement Learning for Partially-Observable Sequential Teams and Games
by: Altabaa, Awni, et al.
Published: (2024)
by: Altabaa, Awni, et al.
Published: (2024)
Guiding Evolutionary AutoEncoder Training with Activation-Based Pruning Operators
by: Jorgensen, Steven, et al.
Published: (2025)
by: Jorgensen, Steven, et al.
Published: (2025)
Evaluating Different Fault Injection Abstractions on the Assessment of DNN SW Hardening Strategies
by: Esposito, Giuseppe, et al.
Published: (2024)
by: Esposito, Giuseppe, et al.
Published: (2024)
Evolving Code with A Large Language Model
by: Hemberg, Erik, et al.
Published: (2024)
by: Hemberg, Erik, et al.
Published: (2024)
Convolutional Spiking Neural Networks for Detecting Anticipatory Brain Potentials Using Electroencephalogram
by: Lutes, Nathan, et al.
Published: (2022)
by: Lutes, Nathan, et al.
Published: (2022)
ARC-NCA: Towards Developmental Solutions to the Abstraction and Reasoning Corpus
by: Guichard, Etienne, et al.
Published: (2025)
by: Guichard, Etienne, et al.
Published: (2025)
Prospective Compression in Human Abstraction Learning
by: Cano, Leonardo Hernandez, et al.
Published: (2026)
by: Cano, Leonardo Hernandez, et al.
Published: (2026)
Relational Concept Bottleneck Models
by: Barbiero, Pietro, et al.
Published: (2023)
by: Barbiero, Pietro, et al.
Published: (2023)
Abstraction in Neural Networks
by: Lynch, Nancy
Published: (2024)
by: Lynch, Nancy
Published: (2024)
Evolution is Driven by Natural Autoencoding: Reframing Species, Interaction Codes, Cooperation, and Sexual Reproduction
by: Cohen, Irun R., et al.
Published: (2022)
by: Cohen, Irun R., et al.
Published: (2022)
Stimulus-to-Stimulus Learning in RNNs with Cortical Inductive Biases
by: Vafidis, Pantelis, et al.
Published: (2024)
by: Vafidis, Pantelis, et al.
Published: (2024)
Dealing With Assumptions and Sampling Bias in the Estimation of Effective Population Size: A Case Study in an Amphibian Population
by: Karen Cox, et al.
Published: (2024)
by: Karen Cox, et al.
Published: (2024)
Conservation genomics assessment of Tharp's bluestar (Amsonia tharpii) with comparisons to widespread (A. longilora) and narrowly endemic (A. fugatei) congeners
by: Dylan H. Cohen, et al.
Published: (2024)
by: Dylan H. Cohen, et al.
Published: (2024)
Virulence Evolution: Thinking Outside of the Host
by: Luís M. Silva, et al.
Published: (2025)
by: Luís M. Silva, et al.
Published: (2025)
Decentralized Multi-Agent Reinforcement Learning for Continuous-Space Stochastic Games
by: Altabaa, Awni, et al.
Published: (2023)
by: Altabaa, Awni, et al.
Published: (2023)
A Multipurpose Microhaplotype Panel for Genetic Analysis of California Chinook Salmon
by: Eric C. Anderson, et al.
Published: (2025)
by: Eric C. Anderson, et al.
Published: (2025)
Towards Reverse-Engineering the Brain: Brain-Derived Neuromorphic Computing Approach with Photonic, Electronic, and Ionic Dynamicity in 3D integrated circuits
by: Yoo, S. J. Ben, et al.
Published: (2024)
by: Yoo, S. J. Ben, et al.
Published: (2024)
Non‐Random Mortality in an Experimental Oyster Restoration
by: Sarit Truskey, et al.
Published: (2025)
by: Sarit Truskey, et al.
Published: (2025)
Reducing Data Bottlenecks in Distributed, Heterogeneous Neural Networks
by: Lin, Ruhai, et al.
Published: (2024)
by: Lin, Ruhai, et al.
Published: (2024)
Improving Planning with Large Language Models: A Modular Agentic Architecture
by: Webb, Taylor, et al.
Published: (2023)
by: Webb, Taylor, et al.
Published: (2023)
Testing the Energetics of Gestation and Growth Hypothesis for Human Secondary Altriciality
by: Cédric Cordey, et al.
Published: (2026)
by: Cédric Cordey, et al.
Published: (2026)
Smart Starts: Accelerating Convergence through Uncommon Region Exploration
by: Zhang, Xinyu, et al.
Published: (2025)
by: Zhang, Xinyu, et al.
Published: (2025)
Advances in salmonid genetics—Insights from Coastwide and beyond
by: Shawn R. Narum, et al.
Published: (2024)
by: Shawn R. Narum, et al.
Published: (2024)
Breaking Global Self-Attention Bottlenecks in Transformer-based Spiking Neural Networks with Local Structure-Aware Self-Attention
by: Li, Lingdong, et al.
Published: (2026)
by: Li, Lingdong, et al.
Published: (2026)
Fuzzy Logic -- Based Scheduling System for Part-Time Workforce
by: Nguyen, Tri, et al.
Published: (2025)
by: Nguyen, Tri, et al.
Published: (2025)
Comparative of Genetic Fuzzy regression techniques for aeroacoustic phenomenons
by: Henry, Hugo, et al.
Published: (2025)
by: Henry, Hugo, et al.
Published: (2025)
On Accelerating Edge AI: Optimizing Resource-Constrained Environments
by: Sander, Jacob, et al.
Published: (2025)
by: Sander, Jacob, et al.
Published: (2025)
Similar Items
-
A Group Theoretic Analysis of the Symmetries Underlying Base Addition and Their Learnability by Neural Networks
by: Dawes, Cutter, et al.
Published: (2025) -
Abstractors and relational cross-attention: An inductive bias for explicit relational reasoning in Transformers
by: Altabaa, Awni, et al.
Published: (2023) -
Disentangling and Integrating Relational and Sensory Information in Transformer Architectures
by: Altabaa, Awni, et al.
Published: (2024) -
Approximation of relation functions and attention mechanisms
by: Altabaa, Awni, et al.
Published: (2024) -
Learning Hierarchical Relational Representations through Relational Convolutions
by: Altabaa, Awni, et al.
Published: (2023)