Cover Image

Normal Guidance is what Attention Needs

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Harvey, Ethan, Loevlie, Dennis Johan, Hughes, Michael C.
Format:	Preprint
Published:	2026
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Synthetic Data Reveals Generalization Gaps in Correlated Multiple Instance Learning
by: Harvey, Ethan, et al.
Published: (2025)

A Multi-Dataset Benchmark of Multiple Instance Learning for 3D Neuroimage Classification
by: Harvey, Ethan, et al.
Published: (2026)

Occam's Razor is Only as Sharp as Your ELBO
by: Harvey, Ethan, et al.
Published: (2026)

Transfer Learning with Informative Priors: Simple Baselines Better than Previously Reported
by: Harvey, Ethan, et al.
Published: (2024)

Learning Hyperparameters via a Data-Emphasized Variational Objective
by: Harvey, Ethan, et al.
Published: (2025)

Learning the Regularization Strength for Deep Fine-Tuning via a Data-Emphasized Variational Objective
by: Harvey, Ethan, et al.
Published: (2024)

Diverse Sampling in Diffusion Models with Marginal Preserving Particle Guidance
by: Vinograd, Gal, et al.
Published: (2026)

Flexible Tails for Normalizing Flows
by: Hickling, Tennessee, et al.
Published: (2024)

A second order regret bound for NormalHedge
by: Freund, Yoav, et al.
Published: (2026)

Some Attention is All You Need for Retrieval
by: Michalak, Felix, et al.
Published: (2025)

But what is your honest answer? Aiding LLM-judges with honest alternatives using steering vectors
by: Eshuijs, Leon, et al.
Published: (2025)

Attention is All You Need Until You Need Retention
by: Yaslioglu, M. Murat
Published: (2025)

Why GRPO Needs Normalization: A Local-Curvature Perspective on Adaptive Gradients
by: Ge, Cheng, et al.
Published: (2026)

Limitations of Normalization in Attention Mechanism
by: Mudarisov, Timur, et al.
Published: (2025)

On the Normalization of Confusion Matrices: Methods and Geometric Interpretations
by: Erbani, Johan, et al.
Published: (2025)

Scalable Message Passing Neural Networks: No Need for Attention in Large Graph Representation Learning
by: Borde, Haitz Sáez de Ocáriz, et al.
Published: (2024)

You Need Better Attention Priors
by: Litman, Elon, et al.
Published: (2026)

Attention Is Not What You Need
by: Chong, Zhang
Published: (2025)

Element-wise Attention Is All You Need
by: Feng, Guoxin
Published: (2025)

Linear Memory SE(2) Invariant Attention
by: Pronovost, Ethan, et al.
Published: (2025)

Attention Needs to Focus: A Unified Perspective on Attention Allocation
by: Fu, Zichuan, et al.
Published: (2026)

Attention Once Is All You Need: Efficient Streaming Inference with Stateful Transformers
by: Norgren, Victor
Published: (2026)

Attention Is All You Need But You Don't Need All Of It For Inference of Large Language Models
by: Tyukin, Georgy, et al.
Published: (2024)

Geometry-Aware Attention Guidance for Diffusion Models via Modern Hopfield Dynamics
by: Kim, Kwanyoung
Published: (2026)

Detecting Heart Disease from Multi-View Ultrasound Images via Supervised Attention Multiple Instance Learning
by: Huang, Zhe, et al.
Published: (2023)

Guidance is All You Need: Temperature-Guided Reasoning in Large Language Models
by: Gomaa, Eyad, et al.
Published: (2024)

Does Long-Term Series Forecasting Need Complex Attention and Extra Long Inputs?
by: Liang, Daojun, et al.
Published: (2023)

Improving Prediction of Need for Mechanical Ventilation using Cross-Attention
by: Mohanty, Anwesh, et al.
Published: (2024)

Attention Smoothing Is All You Need For Unlearning
by: Zade, Saleh Zare, et al.
Published: (2026)

Tensor Product Attention Is All You Need
by: Zhang, Yifan, et al.
Published: (2025)

What Matters in Transformers? Not All Attention is Needed
by: He, Shwai, et al.
Published: (2024)

Variational Autoencoder with Normalizing flow for X-ray spectral fitting
by: Redmen, Fiona, et al.
Published: (2026)

If generative AI is the answer, what is the question?
by: Tewari, Ambuj
Published: (2025)

Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidance
by: Ahn, Donghoon, et al.
Published: (2024)

Discrete Guidance Matching: Exact Guidance for Discrete Flow Matching
by: Wan, Zhengyan, et al.
Published: (2025)

SINCERE: Supervised Information Noise-Contrastive Estimation REvisited
by: Feeney, Patrick, et al.
Published: (2023)

MacroGuide: Topological Guidance for Macrocycle Generation
by: Maksymiuk, Alicja, et al.
Published: (2026)

TransMLA: Multi-Head Latent Attention Is All You Need
by: Meng, Fanxu, et al.
Published: (2025)

Attention Is Not All You Need: The Importance of Feedforward Networks in Transformer Models
by: Gerber, Isaac
Published: (2025)

Attention is All You Need to Optimize Wind Farm Operations and Maintenance
by: Kazemian, Iman, et al.
Published: (2024)