Cover Image

Neuronal Attention Circuit (NAC) for Representation Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Razzaq, Waleed, Kanjaraway, Izis, Zhao, Yun-Bo
Format:	Preprint
Published:	2025
Subjects:	Artificial Intelligence Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Neuronal Stochastic Attention Circuit (NSAC) for Probabilistic Representation Learning
by: Razzaq, Waleed, et al.
Published: (2026)

FLUID: Continuous-Time Hyperconnected Sparse Transformer for Sink-Free Learning
by: Razzaq, Waleed, et al.
Published: (2026)

CARLE: A Hybrid Deep-Shallow Learning Framework for Robust and Explainable RUL Estimation of Rolling Element Bearings
by: Razzaq, Waleed, et al.
Published: (2025)

A Novel Multimodal RUL Framework for Remaining Useful Life Estimation with Layer-wise Explanations
by: Razzaq, Waleed, et al.
Published: (2025)

Developing Distance-Aware, and Evident Uncertainty Quantification in Dynamic Physics-Constrained Neural Networks for Robust Bearing Degradation Estimation
by: Razzaq, Waleed, et al.
Published: (2025)

Tractable Representation Learning with Probabilistic Circuits
by: Braun, Steven, et al.
Published: (2025)

DeepGate3: Towards Scalable Circuit Representation Learning
by: Shi, Zhengyuan, et al.
Published: (2024)

DeepCell: Self-Supervised Multiview Fusion for Circuit Representation Learning
by: Shi, Zhengyuan, et al.
Published: (2025)

KCLNet: Electrically Equivalence-Oriented Graph Representation Learning for Analog Circuits
by: Xu, Peng, et al.
Published: (2026)

In Search of Grandmother Cells: Tracing Interpretable Neurons in Tabular Representations
by: Knauer, Ricardo, et al.
Published: (2026)

Optimizing Sensory Neurons: Nonlinear Attention Mechanisms for Accelerated Convergence in Permutation-Invariant Neural Networks for Reinforcement Learning
by: Muzaffar, Junaid, et al.
Published: (2025)

Shapley Neuron Values for Continual Learning: Which Neurons Matter Most?
by: Vahedifar, Mohammad Ali, et al.
Published: (2026)

NeuronSeek: On Stability and Expressivity of Task-driven Neurons
by: Pei, Hanyu, et al.
Published: (2025)

The Structural Origin of Attention Sink: Variance Discrepancy, Super Neurons, and Dimension Disparity
by: Li, Siquan, et al.
Published: (2026)

Spectral Probe-Circuits: A Three-Step Recipe for Identifying Attention-Head Circuits in Pretrained Transformers
by: Xu, Yongzhong
Published: (2026)

LLM Advertisement based on Neuron Auctions
by: Yun, Peiran, et al.
Published: (2026)

Decomposing Attention To Find Context-Sensitive Neurons
by: Gibson, Alex
Published: (2025)

Quantifying LLM Attention-Head Stability: Implications for Circuit Universality
by: Bali, Karan, et al.
Published: (2026)

Identifiable Object-Centric Representation Learning via Probabilistic Slot Attention
by: Kori, Avinash, et al.
Published: (2024)

COLEP: Certifiably Robust Learning-Reasoning Conformal Prediction via Probabilistic Circuits
by: Kang, Mintong, et al.
Published: (2024)

Evaluating Large Language Models for Security Bug Report Prediction
by: Soltaniani, Farnaz, et al.
Published: (2026)

Spectral Representation-based Reinforcement Learning
by: Gao, Chenxiao, et al.
Published: (2025)

Diffusion Spectral Representation for Reinforcement Learning
by: Shribak, Dmitry, et al.
Published: (2024)

GLANCE: Graph Logic Attention Network with Cluster Enhancement for Heterophilous Graph Representation Learning
by: Sun, Zhongtian, et al.
Published: (2025)

Learning Attention-based Representations from Multiple Patterns for Relation Prediction in Knowledge Graphs
by: Lourenço, Vítor, et al.
Published: (2022)

Causal Neural Probabilistic Circuits
by: Chen, Weixin, et al.
Published: (2026)

BECAUSE: Bilinear Causal Representation for Generalizable Offline Model-based Reinforcement Learning
by: Lin, Haohong, et al.
Published: (2024)

Attention as Robust Representation for Time Series Forecasting
by: Niu, PeiSong, et al.
Published: (2024)

Understanding Representation Learnability of Nonlinear Self-Supervised Learning
by: Yang, Ruofeng, et al.
Published: (2024)

Soft Learning Probabilistic Circuits
by: Ghandi, Soroush, et al.
Published: (2024)

Sparse Attention Decomposition Applied to Circuit Tracing
by: Franco, Gabriel, et al.
Published: (2024)

Enhancing Linear Attention with Residual Learning
by: Lai, Xunhao, et al.
Published: (2025)

Mitigating Degree Bias in Graph Representation Learning with Learnable Structural Augmentation and Structural Self-Attention
by: Hoang, Van Thuy, et al.
Published: (2025)

Learning Topological Representations with Bidirectional Graph Attention Network for Solving Job Shop Scheduling Problem
by: Zhang, Cong, et al.
Published: (2024)

De-confounding Representation Learning for Counterfactual Inference on Continuous Treatment via Generative Adversarial Network
by: Zhao, Yonghe, et al.
Published: (2023)

TSI: A Multi-View Representation Learning Approach for Time Series Forecasting
by: Gao, Wentao, et al.
Published: (2024)

When Do Attention Circuits Form? Developmental Trajectories of Capability and Attention-Sink Emergence Across Three 1B-ClassArchitectures
by: Xu, Yongzhong
Published: (2026)

Revisiting Kernel Attention with Correlated Gaussian Process Representation
by: Bui, Long Minh, et al.
Published: (2025)

Attention-based Iterative Decomposition for Tensor Product Representation
by: Park, Taewon, et al.
Published: (2024)

Disentangled Generative Graph Representation Learning
by: Hu, Xinyue, et al.
Published: (2024)