Cover Image

Mechanisms of Symbol Processing for In-Context Learning in Transformer Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Smolensky, Paul, Fernandez, Roland, Zhou, Zhenghao Herbert, Opper, Mattia, Davies, Adam, Gao, Jianfeng
Format:	Preprint
Published:	2024
Subjects:	Artificial Intelligence Computation and Language Neural and Evolutionary Computing Symbolic Computation F.1; I.2
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Symbolic Discovery of Stochastic Differential Equations with Genetic Programming
by: de Vries, Sigur, et al.
Published: (2026)

Symbolic Regression with Multimodal Large Language Models and Kolmogorov Arnold Networks
by: Harvey, Thomas R., et al.
Published: (2025)

Deep Symbolic Optimization: Reinforcement Learning for Symbolic Mathematics
by: Hayes, Conor F., et al.
Published: (2025)

A Remedy to Compute-in-Memory with Dynamic Random Access Memory: 1FeFET-1C Technology for Neuro-Symbolic AI
by: Yin, Xunzhao, et al.
Published: (2024)

Symbolic Regression with a Learned Concept Library
by: Grayeli, Arya, et al.
Published: (2024)

Rethinking Symbolic Regression Datasets and Benchmarks for Scientific Discovery
by: Matsubara, Yoshitomo, et al.
Published: (2022)

Polyra Swarms: A Shape-Based Approach to Machine Learning
by: Klüttermann, Simon, et al.
Published: (2025)

High-resolution spatial memory requires grid-cell-like neural codes
by: Cotteret, Madison, et al.
Published: (2025)

Evolutionary Causal Discovery with Relative Impact Stratification for Interpretable Data Analysis
by: Deng, Ou, et al.
Published: (2024)

TinyverseGP: Towards a Modular Cross-domain Benchmarking Framework for Genetic Programming
by: Kalkreuth, Roman, et al.
Published: (2025)

Decoupling Representation and Learning in Genetic Programming: the LaSER Approach
by: Le, Nam H., et al.
Published: (2025)

Improving Evaluation of Recombination-based Cartesian Genetic Programming
by: Tran, Duy Long, et al.
Published: (2026)

Guiding Genetic Programming with Graph Neural Networks
by: Wyrwiński, Piotr, et al.
Published: (2024)

X-KAN: Optimizing Local Kolmogorov-Arnold Networks via Evolutionary Rule-Based Machine Learning
by: Shiraishi, Hiroki, et al.
Published: (2025)

Architecture-Induced Recoverability Bias in Differentiable Symbolic Regression
by: Gupta, Chakshu, et al.
Published: (2026)

Enes Causal Discovery
by: Kafantaris, Alexis
Published: (2026)

Looking Through Glass Box
by: Kafantaris, Alexis
Published: (2026)

Enhancing Symbolic Regression with Quality-Diversity and Physics-Inspired Constraints
by: Bruneton, J. -P.
Published: (2025)

Memory as Resonance: A Biomimetic Architecture for Infinite Context Memory on Ergodic Phonetic Manifolds
by: Houichime, Tarik, et al.
Published: (2025)

Controlling Recurrent Neural Networks by Conceptors
by: Jaeger, Herbert
Published: (2014)

Discovering Ordinary Differential Equations with LLM-Based Qualitative and Quantitative Evaluation
by: Song, Sum Kyun, et al.
Published: (2026)

Artificial Intelligence Software Structured to Simulate Human Working Memory, Mental Imagery, and Mental Continuity
by: Reser, Jared Edward
Published: (2022)

Learning Guided Automated Reasoning: A Brief Survey
by: Blaauwbroek, Lasse, et al.
Published: (2024)

Learning Conjecturing from Scratch
by: Gauthier, Thibault, et al.
Published: (2025)

An island-parallel ensemble metaheuristic algorithm for large graph coloring problems
by: Dokeroglu, Tansel, et al.
Published: (2025)

Bio-inspired AI: Integrating Biological Complexity into Artificial Intelligence
by: Dehghani, Nima, et al.
Published: (2024)

Learning Neuron Dynamics within Deep Spiking Neural Networks
by: Jahns, Eric, et al.
Published: (2025)

Shrinkage Initialization for Smooth Learning of Neural Networks
by: Cheng, Miao, et al.
Published: (2025)

Illustrating the Efficiency of Popular Evolutionary Multi-Objective Algorithms Using Runtime Analysis
by: Dang, Duc-Cuong, et al.
Published: (2024)

Transformer Semantic Genetic Programming for Symbolic Regression
by: Anthes, Philipp, et al.
Published: (2025)

Neuromorphic Deployment of Spiking Neural Networks for Cognitive Load Classification in Air Traffic Control
by: An, Jiahui, et al.
Published: (2025)

A Technical Note on the Architectural Effects on Maximum Dependency Lengths of Recurrent Neural Networks
by: Kent, Jonathan S., et al.
Published: (2024)

Developing Convolutional Neural Networks using a Novel Lamarckian Co-Evolutionary Algorithm
by: Sharifi, Zaniar, et al.
Published: (2024)

Alternate Loss Functions for Classification and Robust Regression Can Improve the Accuracy of Artificial Neural Networks
by: Noel, Mathew Mithra, et al.
Published: (2023)

SymDQN: Symbolic Knowledge and Reasoning in Neural Network-based Reinforcement Learning
by: Amador, Ivo, et al.
Published: (2025)

EvoPruneDeepTL: An Evolutionary Pruning Model for Transfer Learning based Deep Neural Networks
by: Poyatos, Javier, et al.
Published: (2022)

A Neuro-Symbolic Approach to Multi-Agent RL for Interpretability and Probabilistic Decision Making
by: Subramanian, Chitra, et al.
Published: (2024)

Vector Symbolic Finite State Machines in Attractor Neural Networks
by: Cotteret, Madison, et al.
Published: (2022)

Searching Search Spaces: Meta-evolving a Geometric Encoding for Neural Networks
by: Kunze, Tarek, et al.
Published: (2024)

On-Chip Learning via Transformer In-Context Learning
by: Finkbeiner, Jan, et al.
Published: (2024)