Saved in:
Bibliographic Details
Main Authors: Zhang, Yifan, Qin, Zhen, Wang, Mengdi, Gu, Quanquan
Format: Preprint
Published: 2025
Subjects:
Online Access:https://arxiv.org/abs/2510.27258
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866909042676334592
author Zhang, Yifan
Qin, Zhen
Wang, Mengdi
Gu, Quanquan
author_facet Zhang, Yifan
Qin, Zhen
Wang, Mengdi
Gu, Quanquan
contents The quadratic cost of scaled dot-product attention is a central obstacle to scaling autoregressive language models to long contexts. Linear-time attention and State Space Models (SSMs) provide scalable alternatives but are typically restricted to first-order or kernel-based approximations, which can limit expressivity. We introduce Higher-order Linear Attention (HLA), a causal, streaming mechanism that realizes higher interactions via compact prefix sufficient statistics. In the second-order case, HLA maintains a constant-size state and computes per-token outputs in linear time without materializing any $n \times n$ matrices. We give closed-form streaming identities, a strictly causal masked variant using two additional summaries, and a chunk-parallel training scheme based on associative scans that reproduces the activations of a serial recurrence exactly. We further outline extensions to third and higher orders. Collectively, these results position HLA as a principled, scalable building block that combines attention-like, data-dependent mixing with the efficiency of modern recurrent architectures.
format Preprint
id arxiv_https___arxiv_org_abs_2510_27258
institution arXiv
publishDate 2025
record_format arxiv
spellingShingle Higher-order Linear Attention
Zhang, Yifan
Qin, Zhen
Wang, Mengdi
Gu, Quanquan
Machine Learning
Artificial Intelligence
Computation and Language
The quadratic cost of scaled dot-product attention is a central obstacle to scaling autoregressive language models to long contexts. Linear-time attention and State Space Models (SSMs) provide scalable alternatives but are typically restricted to first-order or kernel-based approximations, which can limit expressivity. We introduce Higher-order Linear Attention (HLA), a causal, streaming mechanism that realizes higher interactions via compact prefix sufficient statistics. In the second-order case, HLA maintains a constant-size state and computes per-token outputs in linear time without materializing any $n \times n$ matrices. We give closed-form streaming identities, a strictly causal masked variant using two additional summaries, and a chunk-parallel training scheme based on associative scans that reproduces the activations of a serial recurrence exactly. We further outline extensions to third and higher orders. Collectively, these results position HLA as a principled, scalable building block that combines attention-like, data-dependent mixing with the efficiency of modern recurrent architectures.
title Higher-order Linear Attention
topic Machine Learning
Artificial Intelligence
Computation and Language
url https://arxiv.org/abs/2510.27258