Guardado en:
| Autor principal: | O'Neill, Charles |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | https://arxiv.org/abs/2501.02931 |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Sparse Autoencoders Enable Scalable and Reliable Circuit Identification in Language Models
por: O'Neill, Charles, et al.
Publicado: (2024)
por: O'Neill, Charles, et al.
Publicado: (2024)
Type 2 Tobit Sample Selection Models with Bayesian Additive Regression Trees
por: O'Neill, Eoghan
Publicado: (2025)
por: O'Neill, Eoghan
Publicado: (2025)
Low-Rank Key Value Attention
por: O'Neill, James, et al.
Publicado: (2026)
por: O'Neill, James, et al.
Publicado: (2026)
Resurrecting the Salmon: Rethinking Mechanistic Interpretability with Domain-Specific Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2025)
por: O'Neill, Charles, et al.
Publicado: (2025)
Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity
por: Miller, Jack, et al.
Publicado: (2023)
por: Miller, Jack, et al.
Publicado: (2023)
Compute Optimal Inference and Provable Amortisation Gap in Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2024)
por: O'Neill, Charles, et al.
Publicado: (2024)
Disentangling Dense Embeddings with Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2024)
por: O'Neill, Charles, et al.
Publicado: (2024)
Sketching the Heat Kernel: Using Gaussian Processes to Embed Data
por: Gilbert, Anna C., et al.
Publicado: (2024)
por: Gilbert, Anna C., et al.
Publicado: (2024)
Kan Extension Transformers: A Categorical Unification of Attention, Diffusion, and Predict-Detach Self-Conditioning
por: Mahadevan, Sridhar
Publicado: (2026)
por: Mahadevan, Sridhar
Publicado: (2026)
Modelling the Doughnut of social and planetary boundaries with frugal machine learning
por: Vrizzi, Stefano, et al.
Publicado: (2025)
por: Vrizzi, Stefano, et al.
Publicado: (2025)
From superposition to sparse codes: interpretable representations in neural networks
por: Klindt, David, et al.
Publicado: (2025)
por: Klindt, David, et al.
Publicado: (2025)
Measuring Sharpness in Grokking
por: Miller, Jack, et al.
Publicado: (2024)
por: Miller, Jack, et al.
Publicado: (2024)
A Single Direction of Truth: An Observer Model's Linear Residual Probe Exposes and Steers Contextual Hallucinations
por: O'Neill, Charles, et al.
Publicado: (2025)
por: O'Neill, Charles, et al.
Publicado: (2025)
CA-PCA: Manifold Dimension Estimation, Adapted for Curvature
por: Gilbert, Anna C., et al.
Publicado: (2023)
por: Gilbert, Anna C., et al.
Publicado: (2023)
Self-Attention as Distributional Projection: A Unified Interpretation of Transformer Architecture
por: Mehta, Nihal
Publicado: (2025)
por: Mehta, Nihal
Publicado: (2025)
Evaluating Sources: Strategies for Faculty-Librarian-Student Collaboration.
por: Simmons-O'Neill, Elizabeth
Publicado: (1990)
por: Simmons-O'Neill, Elizabeth
Publicado: (1990)
On Understanding Attention-Based In-Context Learning for Categorical Data
por: Wang, Aaron T., et al.
Publicado: (2024)
por: Wang, Aaron T., et al.
Publicado: (2024)
On the Universality of Transformer Architectures; How Much Attention Is Enough?
por: Abbasi, Amirreza, et al.
Publicado: (2025)
por: Abbasi, Amirreza, et al.
Publicado: (2025)
Learning with SASQuaTCh: a Novel Variational Quantum Transformer Architecture with Kernel-Based Self-Attention
por: Evans, Ethan N., et al.
Publicado: (2024)
por: Evans, Ethan N., et al.
Publicado: (2024)
Geometry-Preserving Encoder/Decoder in Latent Generative Models
por: Lee, Wonjun, et al.
Publicado: (2025)
por: Lee, Wonjun, et al.
Publicado: (2025)
Cutting Through the Noise: On-the-fly Outlier Detection for Robust Training of Machine Learning Interatomic Potentials
por: Lam, Terry C. W., et al.
Publicado: (2026)
por: Lam, Terry C. W., et al.
Publicado: (2026)
DEFault++: Automated Fault Detection, Categorization, and Diagnosis for Transformer Architectures
por: Jahan, Sigma, et al.
Publicado: (2026)
por: Jahan, Sigma, et al.
Publicado: (2026)
AnchorGT: Efficient and Flexible Attention Architecture for Scalable Graph Transformers
por: Zhu, Wenhao, et al.
Publicado: (2024)
por: Zhu, Wenhao, et al.
Publicado: (2024)
Understanding Differential Transformer Unchains Pretrained Self-Attentions
por: Kong, Chaerin, et al.
Publicado: (2025)
por: Kong, Chaerin, et al.
Publicado: (2025)
Graph Convolutions Enrich the Self-Attention in Transformers!
por: Choi, Jeongwhan, et al.
Publicado: (2023)
por: Choi, Jeongwhan, et al.
Publicado: (2023)
Quantifying Ambiguity in Categorical Annotations: A Measure and Statistical Inference Framework
por: Klugmann, Christopher, et al.
Publicado: (2025)
por: Klugmann, Christopher, et al.
Publicado: (2025)
Multistability of Self-Attention Dynamics in Transformers
por: Altafini, Claudio
Publicado: (2025)
por: Altafini, Claudio
Publicado: (2025)
A Markov Categorical Framework for Language Modeling
por: Zhang, Yifan
Publicado: (2025)
por: Zhang, Yifan
Publicado: (2025)
Parametrized Multi-Agent Routing via Deep Attention Models
por: Basiri, Salar, et al.
Publicado: (2025)
por: Basiri, Salar, et al.
Publicado: (2025)
Triple Attention Transformer Architecture for Time-Dependent Concrete Creep Prediction
por: Dokduea, Warayut, et al.
Publicado: (2025)
por: Dokduea, Warayut, et al.
Publicado: (2025)
Local Attention Mechanism: Boosting the Transformer Architecture for Long-Sequence Time Series Forecasting
por: Aguilera-Martos, Ignacio, et al.
Publicado: (2024)
por: Aguilera-Martos, Ignacio, et al.
Publicado: (2024)
Quantum Adaptive Self-Attention for Quantum Transformer Models
por: Chen, Chi-Sheng, et al.
Publicado: (2025)
por: Chen, Chi-Sheng, et al.
Publicado: (2025)
Self-Supervised Transformer Architecture for Change Detection in Radio Access Networks
por: Kozlov, Igor, et al.
Publicado: (2023)
por: Kozlov, Igor, et al.
Publicado: (2023)
CAST: Clustering Self-Attention using Surrogate Tokens for Efficient Transformers
por: van Engelenhoven, Adjorn, et al.
Publicado: (2024)
por: van Engelenhoven, Adjorn, et al.
Publicado: (2024)
Spacetime $E(n)$-Transformer: Equivariant Attention for Spatio-temporal Graphs
por: Charles, Sergio G.
Publicado: (2024)
por: Charles, Sergio G.
Publicado: (2024)
Convergence Theory for Iterative LLM-Based Neural Architecture Search: A Parametric Cross-Entropy Framework with Closed-Form Proxy Reliability
por: Adhikari, Santosh Premi, et al.
Publicado: (2026)
por: Adhikari, Santosh Premi, et al.
Publicado: (2026)
How to Train Your Advisor: Steering Black-Box LLMs with Advisor Models
por: Asawa, Parth, et al.
Publicado: (2025)
por: Asawa, Parth, et al.
Publicado: (2025)
The List Object Endofunctor is Polynomial
por: Desrochers, Samuel
Publicado: (2025)
por: Desrochers, Samuel
Publicado: (2025)
Transformers for Tabular Data: A Training Perspective of Self-Attention via Optimal Transport
por: Quadrio, Alessandro, et al.
Publicado: (2025)
por: Quadrio, Alessandro, et al.
Publicado: (2025)
Decoupling Knowledge and Reasoning in Transformers: A Modular Architecture with Generalized Cross-Attention
por: Guo, Zhenyu, et al.
Publicado: (2025)
por: Guo, Zhenyu, et al.
Publicado: (2025)
Ejemplares similares
-
Sparse Autoencoders Enable Scalable and Reliable Circuit Identification in Language Models
por: O'Neill, Charles, et al.
Publicado: (2024) -
Type 2 Tobit Sample Selection Models with Bayesian Additive Regression Trees
por: O'Neill, Eoghan
Publicado: (2025) -
Low-Rank Key Value Attention
por: O'Neill, James, et al.
Publicado: (2026) -
Resurrecting the Salmon: Rethinking Mechanistic Interpretability with Domain-Specific Sparse Autoencoders
por: O'Neill, Charles, et al.
Publicado: (2025) -
Grokking Beyond Neural Networks: An Empirical Exploration with Model Complexity
por: Miller, Jack, et al.
Publicado: (2023)