Copertina

Gated Slot Attention for Efficient Linear-Time Sequence Modeling

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Zhang, Yu, Yang, Songlin, Zhu, Ruijie, Zhang, Yue, Cui, Leyang, Wang, Yiqiao, Wang, Bolun, Shi, Freda, Wang, Bailin, Bi, Wei, Zhou, Peng, Fu, Guohong
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Gated Linear Attention Transformers with Hardware-Efficient Training
di: Yang, Songlin, et al.
Pubblicazione: (2023)

Parallelizing Linear Transformers with the Delta Rule over Sequence Length
di: Yang, Songlin, et al.
Pubblicazione: (2024)

ViG: Linear-complexity Visual Sequence Learning with Gated Linear Attention
di: Liao, Bencheng, et al.
Pubblicazione: (2024)

Alleviating Hallucinations of Large Language Models through Induced Hallucinations
di: Zhang, Yue, et al.
Pubblicazione: (2023)

Spotting AI's Touch: Identifying LLM-Paraphrased Spans in Text
di: Li, Yafu, et al.
Pubblicazione: (2024)

Linear Independence of Generalized Neurons and Related Functions
di: Zhang, Leyang
Pubblicazione: (2024)

SPLA: Block Sparse Plus Linear Attention for Long Context Modeling
di: Wang, Bailin, et al.
Pubblicazione: (2026)

FLASepformer: Efficient Speech Separation with Gated Focused Linear Attention Transformer
di: Wang, Haoxu, et al.
Pubblicazione: (2025)

SAGA: Selective Adaptive Gating for Efficient and Expressive Linear Attention
di: Cao, Yuan, et al.
Pubblicazione: (2025)

Adaptive Slot Attention: Object Discovery with Dynamic Slot Number
di: Fan, Ke, et al.
Pubblicazione: (2024)

Slot-VAE: Object-Centric Scene Generation with Slot Attention
di: Wang, Yanbo, et al.
Pubblicazione: (2023)

ARFlow: Autoregressive Flow with Hybrid Linear Attention
di: Hui, Mude, et al.
Pubblicazione: (2025)

DiG: Scalable and Efficient Diffusion Models with Gated Linear Attention
di: Zhu, Lianghui, et al.
Pubblicazione: (2024)

Logical forms complement probability in understanding language model (and human) performance
di: Wang, Yixuan, et al.
Pubblicazione: (2025)

Distribution Prompting: Understanding the Expressivity of Language Models Through the Next-Token Distributions They Can Produce
di: Wang, Haojin, et al.
Pubblicazione: (2025)

Efficient Linear Attention for Multivariate Time Series Modeling via Entropy Equality
di: Zhang, Mingtao, et al.
Pubblicazione: (2025)

MAGE: Machine-generated Text Detection in the Wild
di: Li, Yafu, et al.
Pubblicazione: (2023)

Scaling Linear Attention with Sparse State Expansion
di: Pan, Yuqi, et al.
Pubblicazione: (2025)

Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
di: Zhang, Yue, et al.
Pubblicazione: (2023)

Learning Language Structures through Grounding
di: Shi, Freda
Pubblicazione: (2024)

ZeCO: Zero Communication Overhead Sequence Parallelism for Linear Attention
di: Chou, Yuhong, et al.
Pubblicazione: (2025)

Trinuclear Ru(II)‐Ru(II)‐Ru(II) Complexes as Efficient Photosensitizers for Potent Aqueous Singlet Oxygen Generation and NADH Photo‐Oxidation
di: Chunyin Zhu, et al.
Pubblicazione: (2026)

Kimi Linear: An Expressive, Efficient Attention Architecture
di: Kimi Team, et al.
Pubblicazione: (2025)

Gated Differential Linear Attention: A Linear-Time Decoder for High-Fidelity Medical Segmentation
di: Zheng, Hongbo, et al.
Pubblicazione: (2026)

Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences
di: Liu, Zicheng, et al.
Pubblicazione: (2024)

Guiding Time-Varying Generative Models with Natural Gradients on Exponential Family Manifold
di: Liu, Song, et al.
Pubblicazione: (2025)

Network localization governs social contagion dynamics with macro-level reinforcement
di: Xue, Leyang, et al.
Pubblicazione: (2025)

Linear Attention for Efficient Bidirectional Sequence Modeling
di: Afzal, Arshia, et al.
Pubblicazione: (2025)

ReGLA: Refining Gated Linear Attention
di: Lu, Peng, et al.
Pubblicazione: (2025)

RATTENTION: Towards the Minimal Sliding Window Size in Local-Global Attention Models
di: Wang, Bailin, et al.
Pubblicazione: (2025)

Design of the Monopulse Feeding Network for a Slotted Waveguide Array on an Annular Disk
di: Zongxin Wang, et al.
Pubblicazione: (2024)

Vision Augmentation Prediction Autoencoder with Attention Design (VAPAAD)
di: Yin, Yiqiao
Pubblicazione: (2024)

Nexusformer: Nonlinear Attention Expansion for Stable and Inheritable Transformer Scaling
di: Zhao, Weijie, et al.
Pubblicazione: (2026)

Inducing Meaningful Units from Character Sequences with Dynamic Capacity Slot Attention
di: Behjati, Melika, et al.
Pubblicazione: (2021)

Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks
di: Li, Qintong, et al.
Pubblicazione: (2023)

SlotMemory: Object-Centric KV Memory for Streaming Long-Video Generation
di: Dou, Weijia, et al.
Pubblicazione: (2026)

Local Linear Recovery Guarantee of Deep Neural Networks at Overparameterization
di: Zhang, Yaoyu, et al.
Pubblicazione: (2024)

Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression
di: Zuo, Yifei, et al.
Pubblicazione: (2025)

VISTA: Variance-Gated Inter-Sequence Test-Time Adaptation for Multi-Sequence MRI Segmentation
di: Deng, Zhipeng, et al.
Pubblicazione: (2026)

Gated Condition Injection without Multimodal Attention: Towards Controllable Linear-Attention Transformers
di: Liu, Yuhe, et al.
Pubblicazione: (2026)