Cover Image

Universal Neurons in GPT-2: Emergence, Persistence, and Functional Impact

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Nandan, Advey, Chou, Cheng-Ting, Kurakula, Amrit, Blondin, Cole, Zhu, Kevin, Sharma, Vasu, O'Brien, Sean
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence Neural and Evolutionary Computing
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Adaptive Spiking Neurons for Vision and Language Modeling
by: Zhou, Chenlin, et al.
Published: (2026)

Biologically Inspired Oscillating Activation Functions Can Bridge the Performance Gap between Biological and Artificial Neurons
by: Noel, Matthew Mithra, et al.
Published: (2021)

CLIF: Complementary Leaky Integrate-and-Fire Neuron for Spiking Neural Networks
by: Huang, Yulong, et al.
Published: (2024)

Pattern recognition in the nucleation kinetics of non-equilibrium self-assembly
by: Evans, Constantine Glen, et al.
Published: (2022)

Toward Neuromic Computing: Neurons as Autoencoders
by: Bull, Larry
Published: (2024)

PRF: Parallel Resonate and Fire Neuron for Long Sequence Learning in Spiking Neural Networks
by: Huang, Yulong, et al.
Published: (2024)

General Self-Prediction Enhancement for Spiking Neurons
by: Huang, Zihan, et al.
Published: (2026)

Rethinking Intelligence: Brain-like Neuron Network
by: Liu, Weifeng
Published: (2026)

Optimal ANN-SNN Conversion with Group Neurons
by: Lv, Liuzhenghao, et al.
Published: (2024)

Space as Time Through Neuron Position Learning
by: Mészáros, Balázs, et al.
Published: (2025)

Conceptual and Design Principles for a Self-Referential Algorithm Mimicking Neuronal Assembly Functions
by: Totaro, Paolo, et al.
Published: (2025)

Maximizing Information in Neuron Populations for Neuromorphic Spike Encoding
by: Ferdaoussi, Ahmad El, et al.
Published: (2024)

Amortized Inference of Neuron Parameters on Analog Neuromorphic Hardware
by: Kaiser, Jakob, et al.
Published: (2026)

Efficient Online Learning for Networks of Two-Compartment Spiking Neurons
by: Yin, Yujia, et al.
Published: (2024)

Multiplication-Free Parallelizable Spiking Neurons with Efficient Spatio-Temporal Dynamics
by: Xue, Peng, et al.
Published: (2025)

TMN: A Lightweight Neuron Model for Efficient Nonlinear Spike Representation
by: Gu, Yiwen, et al.
Published: (2024)

A More Accurate Approximation of Activation Function with Few Spikes Neurons
by: Jeong, Dayena, et al.
Published: (2024)

FiTS: Interpretable Spiking Neurons via Frequency Selectivity and Temporal Shaping
by: Choi, Jongmin, et al.
Published: (2026)

Bio-Inspired Neuron Synapse Optimization for Adaptive Learning and Smart Decision-Making
by: Singh, Sreeja, et al.
Published: (2025)

Ternary Spiking Neural Networks Enhanced by Complemented Neurons and Membrane Potential Aggregation
by: Zhang, Boxuan, et al.
Published: (2026)

Spiking World Model with Multi-Compartment Neurons for Model-based Reinforcement Learning
by: Sun, Yinqian, et al.
Published: (2025)

PMSN: A Parallel Multi-compartment Spiking Neuron for Multi-scale Temporal Processing
by: Chen, Xinyi, et al.
Published: (2024)

Stream Neural Networks: Epoch-Free Learning with Persistent Temporal State
by: Pathan, Amama
Published: (2026)

TC-LIF: A Two-Compartment Spiking Neuron Model for Long-Term Sequential Modelling
by: Zhang, Shimin, et al.
Published: (2023)

Evolutionary Algorithms for Optimizing Emergency Exit Placement in Indoor Environments
by: Cotta, Carlos, et al.
Published: (2024)

One-Timestep is Enough: Achieving High-performance ANN-to-SNN Conversion via Scale-and-Fire Neurons
by: Chen, Qiuyang, et al.
Published: (2025)

Modular Creation of Neuronal Networks for Autonomous Robot Control
by: Laura Lanzarini
Published: (2007)

Med-Bot: An AI-Powered Assistant to Provide Accurate and Reliable Medical Information
by: Bhatt, Ahan, et al.
Published: (2024)

Improving Low-Latency Learning Performance in Spiking Neural Networks via a Change-Perceptive Dendrite-Soma-Axon Neuron
by: Huang, Zeyu, et al.
Published: (2025)

Optimizing Spatio-Temporal Information Processing in Spiking Neural Networks via Unconstrained Leaky Integrate-and-Fire Neurons and Hybrid Coding
by: He, Huaxu
Published: (2024)

Learning Delays Through Gradients and Structure: Emergence of Spatiotemporal Patterns in Spiking Neural Networks
by: Mészáros, Balázs, et al.
Published: (2024)

Graph-Theoretic Measures for Interpretable Multicriteria Decision Making in Emergency Department Layout Optimization
by: Sarhan, Ola, et al.
Published: (2025)

Quadratic Neuron-empowered Heterogeneous Autoencoder for Unsupervised Anomaly Detection
by: Liao, Jing-Xiao, et al.
Published: (2022)

Reservoir computing with large valid prediction time for the Lorenz system
by: Hurley, Lauren A, et al.
Published: (2025)

Stabilizing Spiking Neuron Training
by: Herranz-Celotti, Luca, et al.
Published: (2022)

Balanced Resonate-and-Fire Neurons
by: Higuchi, Saya, et al.
Published: (2024)

An On-Chip Trainable Neuron Circuit for SFQ-Based Spiking Neural Networks
by: Ucpinar, Beyza Zeynep, et al.
Published: (2023)

The Causally Emergent Alignment Hypothesis: Causal Emergence Aligns with and Predicts Final Reward in Reinforcement Learning Agents
by: Pigozzi, Federico, et al.
Published: (2026)

Learning from Emergence: A Study on Proactively Inhibiting the Monosemantic Neurons of Artificial Neural Networks
by: Wang, Jiachuan, et al.
Published: (2023)

A Universal Framework for Large-Scale Multi-Objective Optimization Based on Particle Drift and Diffusion
by: Li, Jia-Cheng, et al.
Published: (2025)