Copertina

Concepts Whisper While Syntax Shouts: Spectral Anti-Concentration and the Dual Geometry of Transformer Representations

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Acharya, Pratyush, Rimal, Nuraj, Dhakal, Habish
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Grokking as a Variance-Limited Phase Transition: Spectral Gating and the Epsilon-Stability Threshold
di: Acharya, Pratyush, et al.
Pubblicazione: (2026)

Multi-Dimensional Spectral Geometry of Biological Knowledge in Single-Cell Transformer Representations
di: Kendiukhov, Ihor
Pubblicazione: (2026)

From Dispersion to Attraction: Spectral Dynamics of Hallucination Across Whisper Model Scales
di: Viakhirev, Ivan, et al.
Pubblicazione: (2026)

Dynamics of the Transformer Residual Stream: Coupling Spectral Geometry to Network Topology
di: Fernando, Jesseba, et al.
Pubblicazione: (2026)

Generating Synthetic Fair Syntax-agnostic Data by Learning and Distilling Fair Representation
di: Sikder, Md Fahim, et al.
Pubblicazione: (2024)

Multi-Ontology Integration with Dual-Axis Propagation for Medical Concept Representation
di: Kerdabadi, Mohsen Nayebi, et al.
Pubblicazione: (2025)

On the Spectral Geometry of Cross-Modal Representations: A Functional Map Diagnostic for Multimodal Alignment
di: Sarkar, Krisanu
Pubblicazione: (2026)

Spectral Disentanglement and Enhancement: A Dual-domain Contrastive Framework for Representation Learning
di: Guo, Jinjin, et al.
Pubblicazione: (2026)

The Geometry of Refusal in Large Language Models: Concept Cones and Representational Independence
di: Wollschläger, Tom, et al.
Pubblicazione: (2025)

Primal-Dual Spectral Representation for Off-policy Evaluation
di: Hu, Yang, et al.
Pubblicazione: (2024)

ConceptTracer: Interactive Analysis of Concept Saliency and Selectivity in Neural Representations
di: Knauer, Ricardo, et al.
Pubblicazione: (2026)

Mixture-of-Experts as Soft Clustering: A Dual Jacobian-PCA Spectral Geometry Perspective
di: Liu, Feilong
Pubblicazione: (2026)

Concept Heterogeneity-aware Representation Steering
di: Abdullaev, Laziz U., et al.
Pubblicazione: (2026)

Projecting Assumptions: The Duality Between Sparse Autoencoders and Concept Geometry
di: Hindupur, Sai Sumedh R., et al.
Pubblicazione: (2025)

The Bayesian Geometry of Transformer Attention
di: Agarwal, Naman, et al.
Pubblicazione: (2025)

MolSculpt: Sculpting 3D Molecular Geometries from Chemical Syntax
di: Chen, Zhanpeng, et al.
Pubblicazione: (2025)

Dual Goal Representations
di: Park, Seohong, et al.
Pubblicazione: (2025)

SpectralGCD: Spectral Concept Selection and Cross-modal Representation Learning for Generalized Category Discovery
di: Caselli, Lorenzo, et al.
Pubblicazione: (2026)

Artificial Neural Nets and the Representation of Human Concepts
di: Freiesleben, Timo
Pubblicazione: (2023)

Diffusion Spectral Representation for Reinforcement Learning
di: Shribak, Dmitry, et al.
Pubblicazione: (2024)

Spectral Representation-based Reinforcement Learning
di: Gao, Chenxiao, et al.
Pubblicazione: (2025)

Spectral Transformer Neural Processes
di: Chen, Xianhe, et al.
Pubblicazione: (2026)

Rethinking Benign Relearning: Syntax as the Hidden Driver of Unlearning Failures
di: Yoon, Sangyeon, et al.
Pubblicazione: (2026)

Whispering to a Blackbox: Bootstrapping Frozen OCR with Visual Prompts
di: Samandarov, Samandar, et al.
Pubblicazione: (2026)

TempOpt -- Unsupervised Alarm Relation Learning for Telecommunication Networks
di: Sampath, Sathiyanaryanan, et al.
Pubblicazione: (2025)

Diagnosing Generalization Failures from Representational Geometry Markers
di: Chou, Chi-Ning, et al.
Pubblicazione: (2026)

Self-Training Doesn't Flatten Language -- It Restructures It: Surface Markers Amplify While Deep Syntax Dies
di: Liu, Ming
Pubblicazione: (2026)

Compare different SG-Schemes based on large least square problems
di: Acharya, Ramkrishna
Pubblicazione: (2025)

The Geometry of Concepts: Sparse Autoencoder Feature Structure
di: Li, Yuxiao, et al.
Pubblicazione: (2024)

Exact Attention Sensitivity and the Geometry of Transformer Stability
di: Emadi, Seyed Morteza
Pubblicazione: (2026)

On the Emergence of Syntax by Means of Local Interaction
di: Wei, Zichao
Pubblicazione: (2026)

Speech Emotion Recognition Leveraging OpenAI's Whisper Representations and Attentive Pooling Methods
di: Shendabadi, Ali, et al.
Pubblicazione: (2026)

Spectral Edge Dynamics of Training Trajectories: Signal--Noise Geometry Across Scales
di: Xu, Yongzhong
Pubblicazione: (2026)

Flash STU: Fast Spectral Transform Units
di: Liu, Y. Isabel, et al.
Pubblicazione: (2024)

Uncovering the Representation Geometry of Minimal Cores in Overcomplete Reasoning Traces
di: Chowdhury, Sanjoy, et al.
Pubblicazione: (2026)

Memorization Sinks: Isolating Memorization during LLM Training
di: Ghosal, Gaurav R., et al.
Pubblicazione: (2025)

Hard Examples Are All You Need: Maximizing GRPO Post-Training Under Annotation Budgets
di: Pikus, Benjamin, et al.
Pubblicazione: (2025)

Transformers from Compressed Representations
di: Alcazar, Juan C. Leon, et al.
Pubblicazione: (2025)

Spectral Superposition: A Theory of Feature Geometry
di: Ivanov, Georgi, et al.
Pubblicazione: (2026)

Wormhole: Concept-Aware Deep Representation Learning for Co-Evolving Sequences
di: Xu, Kunpeng, et al.
Pubblicazione: (2024)