The Concept Allocation Zone: Tracking How Concepts Form Across Transformer Depth
Fuente:
arXiv
Enregistré dans:
| Auteur principal: | Henry, James |
|---|---|
| Format: | Preprint |
| Publié: |
2026
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
Documents similaires
Geometric Evolution Maps: Extracting Stable Concept Probes from Transformer Residual Streams
par: Henry, James
Publié: (2026)
par: Henry, James
Publié: (2026)
How Pruning Reshapes Features: Sparse Autoencoder Analysis of Weight-Pruned Language Models
par: Borobia, Hector, et autres
Publié: (2026)
par: Borobia, Hector, et autres
Publié: (2026)
CLMN: Concept based Language Models via Neural Symbolic Reasoning
par: Yang, Yibo
Publié: (2025)
par: Yang, Yibo
Publié: (2025)
Causal Dimensionality of Transformer Representations: Measurement, Scaling, and Layer Structure
par: Sarkar, Nilesh, et autres
Publié: (2026)
par: Sarkar, Nilesh, et autres
Publié: (2026)
ProactBench: Beyond What The User Asked For
par: Harfi, Sepehr, et autres
Publié: (2026)
par: Harfi, Sepehr, et autres
Publié: (2026)
When Does Content-Based Routing Work? Representation Requirements for Selective Attention in Hybrid Sequence Models
par: Basu, Abhinaba
Publié: (2026)
par: Basu, Abhinaba
Publié: (2026)
Harnessing non-adversarial robustness in large language models
par: Zhou, Qinghua, et autres
Publié: (2026)
par: Zhou, Qinghua, et autres
Publié: (2026)
SafeAnchor: Preventing Cumulative Safety Erosion in Continual Domain Adaptation of Large Language Models
par: Guo, Dongxin, et autres
Publié: (2026)
par: Guo, Dongxin, et autres
Publié: (2026)
ProbeScale: Probing Analysis to Optimize Neural Scaling Laws for Efficient Small Language Model Inference
par: Das, Sourav
Publié: (2026)
par: Das, Sourav
Publié: (2026)
Unsolvability Ceiling in Multi-LLM Routing: An Empirical Study of Evaluation Artifacts
par: Garg, Saloni, et autres
Publié: (2026)
par: Garg, Saloni, et autres
Publié: (2026)
mHC-SSM: Manifold-Constrained Hyper-Connections for State Space Language Models with Stream-Specialized Adapters
par: Mutlu, Abdulvahap, et autres
Publié: (2026)
par: Mutlu, Abdulvahap, et autres
Publié: (2026)
ReFactor GNNs: Revisiting Factorisation-based Models from a Message-Passing Perspective
par: Chen, Yihong, et autres
Publié: (2022)
par: Chen, Yihong, et autres
Publié: (2022)
AIPsy-Affect: A Keyword-Free Clinical Stimulus Battery for Mechanistic Interpretability of Emotion in Language Models
par: Keeman, Michael
Publié: (2026)
par: Keeman, Michael
Publié: (2026)
Product-of-Experts Training Reduces Dataset Artifacts in Natural Language Inference
par: Mathew, Aby Mammen
Publié: (2026)
par: Mathew, Aby Mammen
Publié: (2026)
Latent Object Permanence: Topological Phase Transitions, Free-Energy Principles, and Renormalization Group Flows in Deep Transformer Manifolds
par: Alpay, Faruk, et autres
Publié: (2026)
par: Alpay, Faruk, et autres
Publié: (2026)
Mechanistic Analysis of Catastrophic Forgetting in Large Language Models During Continual Fine-tuning
par: Imanov, Olaf Yunus Laitinen
Publié: (2026)
par: Imanov, Olaf Yunus Laitinen
Publié: (2026)
Strategic Doctrine Language Models (sdLM): A Learning-System Framework for Doctrinal Consistency and Geopolitical Forecasting
par: Imanov, Olaf Yunus Laitinen, et autres
Publié: (2026)
par: Imanov, Olaf Yunus Laitinen, et autres
Publié: (2026)
Inference acceleration for large language models using "stairs" assisted greedy generation
par: Grigaliūnas, Domas, et autres
Publié: (2024)
par: Grigaliūnas, Domas, et autres
Publié: (2024)
A Practical Guide to Streaming Continual Learning
par: Cossu, Andrea, et autres
Publié: (2026)
par: Cossu, Andrea, et autres
Publié: (2026)
Don't Look Back in Anger: MAGIC Net for Streaming Continual Learning with Temporal Dependence
par: Giannini, Federico, et autres
Publié: (2026)
par: Giannini, Federico, et autres
Publié: (2026)
cPNN: Continuous Progressive Neural Networks for Evolving Streaming Time Series
par: Giannini, Federico, et autres
Publié: (2026)
par: Giannini, Federico, et autres
Publié: (2026)
The Geometry of Persona: Disentangling Personality from Reasoning in Large Language Models
par: Wang, Zhixiang
Publié: (2025)
par: Wang, Zhixiang
Publié: (2025)
NOTAI.AI: Explainable Detection of Machine-Generated Text via Curvature and Feature Attribution
par: Breneur, Oleksandr Marchenko, et autres
Publié: (2026)
par: Breneur, Oleksandr Marchenko, et autres
Publié: (2026)
Rethinking the Multilingual Reasoning Gap with Layer Swap
par: Lasbordes, Maxence, et autres
Publié: (2026)
par: Lasbordes, Maxence, et autres
Publié: (2026)
DRO-InstructZero: Distributionally Robust Prompt Optimization for Large Language Models
par: Li, Yangyang
Publié: (2025)
par: Li, Yangyang
Publié: (2025)
SAGE: Sign-Adaptive Gradient for Memory-Efficient LLM Optimization
par: Lee, Wooin, et autres
Publié: (2026)
par: Lee, Wooin, et autres
Publié: (2026)
Think-at-Hard: Selective Latent Iterations to Improve Reasoning Language Models
par: Fu, Tianyu, et autres
Publié: (2025)
par: Fu, Tianyu, et autres
Publié: (2025)
A Confidence-Diversity Framework for Calibrating AI Judgement in Accessible Qualitative Coding Tasks
par: Zhao, Zhilong, et autres
Publié: (2025)
par: Zhao, Zhilong, et autres
Publié: (2025)
Unpacking Hateful Memes: Presupposed Context and False Claims
par: Cai, Weibin, et autres
Publié: (2025)
par: Cai, Weibin, et autres
Publié: (2025)
HEFT: A Coarse-to-Fine Hierarchy for Enhancing the Efficiency and Accuracy of Language Model Reasoning
par: Hill, Brennen
Publié: (2025)
par: Hill, Brennen
Publié: (2025)
Extracting Sentence Embeddings from Pretrained Transformer Models
par: Stankevičius, Lukas, et autres
Publié: (2024)
par: Stankevičius, Lukas, et autres
Publié: (2024)
Multi-Model Synthetic Training for Mission-Critical Small Language Models
par: Platt, Nolan, et autres
Publié: (2025)
par: Platt, Nolan, et autres
Publié: (2025)
Sliced-Wasserstein Distribution Alignment Loss Improves the Ultra-Low-Bit Quantization of Large Language Models
par: Cao, Deyu, et autres
Publié: (2026)
par: Cao, Deyu, et autres
Publié: (2026)
JAM: Controllable and Responsible Text Generation via Causal Reasoning and Latent Vector Manipulation
par: Huang, Yingbing, et autres
Publié: (2025)
par: Huang, Yingbing, et autres
Publié: (2025)
Do Reasoning Models Enhance Embedding Models?
par: Chan, Wun Yu, et autres
Publié: (2026)
par: Chan, Wun Yu, et autres
Publié: (2026)
DeepPersona: A Generative Engine for Scaling Deep Synthetic Personas
par: Wang, Zhen, et autres
Publié: (2025)
par: Wang, Zhen, et autres
Publié: (2025)
NeuronSpark: A Spiking Neural Network Language Model with Selective State Space Dynamics
par: Tang, Zhengzheng
Publié: (2026)
par: Tang, Zhengzheng
Publié: (2026)
From Noise to Diversity: Random Embedding Injection in LLM Reasoning
par: Kim, Heejun, et autres
Publié: (2026)
par: Kim, Heejun, et autres
Publié: (2026)
Communicative Agents for Slideshow Storytelling Video Generation based on LLMs
par: Fan, Jingxing, et autres
Publié: (2025)
par: Fan, Jingxing, et autres
Publié: (2025)
Challenges and Applications of Large Language Models: A Comparison of GPT and DeepSeek family of models
par: Sharma, Shubham, et autres
Publié: (2025)
par: Sharma, Shubham, et autres
Publié: (2025)
Documents similaires
-
Geometric Evolution Maps: Extracting Stable Concept Probes from Transformer Residual Streams
par: Henry, James
Publié: (2026) -
How Pruning Reshapes Features: Sparse Autoencoder Analysis of Weight-Pruned Language Models
par: Borobia, Hector, et autres
Publié: (2026) -
CLMN: Concept based Language Models via Neural Symbolic Reasoning
par: Yang, Yibo
Publié: (2025) -
Causal Dimensionality of Transformer Representations: Measurement, Scaling, and Layer Structure
par: Sarkar, Nilesh, et autres
Publié: (2026) -
ProactBench: Beyond What The User Asked For
par: Harfi, Sepehr, et autres
Publié: (2026)