Copertina

Retrieval from Within: An Intrinsic Capability of Attention-Based Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hoffer, Elad, Blau, Yochai, Kinderman, Edan, Banner, Ron, Soudry, Daniel, Ginsburg, Boris
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Workspace Optimization: How to Train Your Agent
di: Sarafian, Elad, et al.
Pubblicazione: (2026)

Accurate Neural Training with 4-bit Matrix Multiplications at Standard Formats
di: Chmiel, Brian, et al.
Pubblicazione: (2021)

Foldable SuperNets: Scalable Merging of Transformers with Different Initializations and Tasks
di: Kinderman, Edan, et al.
Pubblicazione: (2024)

Normalized Architectures are Natively 4-Bit
di: Fishman, Maxim, et al.
Pubblicazione: (2026)

Minimum Variance Unbiased N:M Sparsity for the Neural Gradients
di: Chmiel, Brian, et al.
Pubblicazione: (2022)

FP4 All the Way: Fully Quantized Training of LLMs
di: Chmiel, Brian, et al.
Pubblicazione: (2025)

Scaling FP8 training to trillion-token LLMs
di: Fishman, Maxim, et al.
Pubblicazione: (2024)

The Implicit Bias of Gradient Descent on Separable Data
di: Soudry, Daniel, et al.
Pubblicazione: (2017)

PLUMAGE: Probabilistic Low rank Unbiased Min Variance Gradient Estimator for Efficient Large Model Training
di: Haroush, Matan, et al.
Pubblicazione: (2025)

Distributed Training under Packet Loss
di: Weintraub, Erez, et al.
Pubblicazione: (2025)

Star Attention: Efficient LLM Inference over Long Sequences
di: Acharya, Shantanu, et al.
Pubblicazione: (2024)

Optimal L2 Regularization in High-dimensional Continual Linear Regression
di: Karpel, Gilad, et al.
Pubblicazione: (2026)

Block Sparse Flash Attention
di: Ohayon, Daniel, et al.
Pubblicazione: (2025)

The Joint Effect of Task Similarity and Overparameterization on Catastrophic Forgetting -- An Analytical Model
di: Goldfarb, Daniel, et al.
Pubblicazione: (2024)

Explore to Generalize in Zero-Shot RL
di: Zisselman, Ev, et al.
Pubblicazione: (2023)

The Implicit Bias of Gradient Descent on Separable Multiclass Data
di: Ravi, Hrithik, et al.
Pubblicazione: (2024)

Towards Cheaper Inference in Deep Networks with Lower Bit-Width Accumulators
di: Blumenfeld, Yaniv, et al.
Pubblicazione: (2024)

SILO: Solving Inverse Problems with Latent Operators
di: Raphaeli, Ron, et al.
Pubblicazione: (2025)

WIND: Accelerated RNN-T Decoding with Windowed Inference for Non-blank Detection
di: Xu, Hainan, et al.
Pubblicazione: (2025)

Diffusion-Based Unsupervised Audio-Visual Speech Separation in Noisy Environments with Noise Prior
di: Yemini, Yochai, et al.
Pubblicazione: (2025)

When Diffusion Models Memorize: Inductive Biases in Probability Flow of Minimum-Norm Shallow Neural Nets
di: Zeno, Chen, et al.
Pubblicazione: (2025)

Pattern-Based Time-Series Risk Scoring for Anomaly Detection and Alert Filtering -- A Predictive Maintenance Case Study
di: Liebman, Elad
Pubblicazione: (2024)

Tensor-Parallelism with Partially Synchronized Activations
di: Lamprecht, Itay, et al.
Pubblicazione: (2025)

How do Minimum-Norm Shallow Denoisers Look in Function Space?
di: Zeno, Chen, et al.
Pubblicazione: (2023)

Temperature is All You Need for Generalization in Langevin Dynamics and other Markov Processes
di: Harel, Itamar, et al.
Pubblicazione: (2025)

HAINAN: Fast and Accurate Transducer for Hybrid-Autoregressive ASR
di: Xu, Hainan, et al.
Pubblicazione: (2024)

Spectral State Space Models
di: Agarwal, Naman, et al.
Pubblicazione: (2023)

From Continual Learning to SGD and Back: Better Rates for Continual Linear Models
di: Evron, Itay, et al.
Pubblicazione: (2025)

EXAQ: Exponent Aware Quantization For LLMs Acceleration
di: Shkolnik, Moran, et al.
Pubblicazione: (2024)

Enhancing LLM Planning Capabilities through Intrinsic Self-Critique
di: Bohnet, Bernd, et al.
Pubblicazione: (2025)

Expert-Guided Class-Conditional Goodness-of-Fit Scores for Interpretable Classification with Informative Missingness: An Application to Seismic Monitoring
di: Cohen, Shahar, et al.
Pubblicazione: (2026)

Are Greedy Task Orderings Better Than Random in Continual Linear Regression?
di: Tsipory, Matan, et al.
Pubblicazione: (2025)

Exponential Quantum Communication Advantage in Distributed Inference and Learning
di: Gilboa, Dar, et al.
Pubblicazione: (2023)

nGPT: Normalized Transformer with Representation Learning on the Hypersphere
di: Loshchilov, Ilya, et al.
Pubblicazione: (2024)

World Model Agents with Change-Based Intrinsic Motivation
di: Ferrao, Jeremias, et al.
Pubblicazione: (2025)

How Uniform Random Weights Induce Non-uniform Bias: Typical Interpolating Neural Networks Generalize with Narrow Teachers
di: Buzaglo, Gon, et al.
Pubblicazione: (2024)

Provable Tempered Overfitting of Minimal Nets and Typical Nets
di: Harel, Itamar, et al.
Pubblicazione: (2024)

Spectral Analysis of Diffusion Models with Application to Schedule Design
di: Benita, Roi, et al.
Pubblicazione: (2025)

Stable Minima Cannot Overfit in Univariate ReLU Networks: Generalization by Large Step Sizes
di: Qiao, Dan, et al.
Pubblicazione: (2024)

Analyzing and Guiding Zero-Shot Posterior Sampling in Diffusion Models
di: Benita, Roi, et al.
Pubblicazione: (2026)