Image de couverture de livre

CAB: Comprehensive Attention Benchmarking on Long Sequence Modeling

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Zhang, Jun, Jiang, Shuyang, Feng, Jiangtao, Zheng, Lin, Kong, Lingpeng
Format:	Preprint
Publié:	2022
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Proxy Compression for Language Modeling
par: Zheng, Lin, et autres
Publié: (2026)

A Reparameterized Discrete Diffusion Model for Text Generation
par: Zheng, Lin, et autres
Publié: (2023)

Scaling Reasoning without Attention
par: Zhao, Xueliang, et autres
Publié: (2025)

Long-range Modeling and Processing of Multimodal Event Sequences
par: Li, Jichu, et autres
Publié: (2026)

Self-Infilling Code Generation
par: Zheng, Lin, et autres
Publié: (2023)

BioMaze: Benchmarking and Enhancing Large Language Models for Biological Pathway Reasoning
par: Zhao, Haiteng, et autres
Publié: (2025)

Beyond Autoregression: Discrete Diffusion for Complex Reasoning and Planning
par: Ye, Jiacheng, et autres
Publié: (2024)

PromptCoT: Synthesizing Olympiad-level Problems for Mathematical Reasoning in Large Language Models
par: Zhao, Xueliang, et autres
Publié: (2025)

Continuous-Time Attention: PDE-Guided Mechanisms for Long-Sequence Transformers
par: Zhang, Yukun, et autres
Publié: (2025)

Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences
par: Liu, Zicheng, et autres
Publié: (2024)

LongVQ: Long Sequence Modeling with Vector Quantization on Structured Memory
par: Liu, Zicheng, et autres
Publié: (2024)

Long-Sequence Recommendation Models Need Decoupled Embeddings
par: Feng, Ningya, et autres
Publié: (2024)

DynaAct: Large Language Model Reasoning with Dynamic Action Spaces
par: Zhao, Xueliang, et autres
Publié: (2025)

PromptCoT 2.0: Scaling Prompt Synthesis for Large Language Model Reasoning
par: Zhao, Xueliang, et autres
Publié: (2025)

DLM-Scope: Mechanistic Interpretability of Diffusion Language Models via Sparse Autoencoders
par: Wang, Xu, et autres
Publié: (2026)

QLAM: A Quantum Long-Attention Memory Approach to Long-Sequence Token Modeling
par: Nguyen, Hoang-Quan, et autres
Publié: (2026)

Sequence-to-Sequence Models with Attention Mechanistically Map to the Architecture of Human Memory Search
par: Salvatore, Nikolaus, et autres
Publié: (2025)

Modeling Long Sequences in Bladder Cancer Recurrence: A Comparative Evaluation of LSTM,Transformer,and Mamba
par: Zhang, Runquan, et autres
Publié: (2024)

A Comprehensive Survey of Dynamic Graph Neural Networks: Models, Frameworks, Benchmarks, Experiments and Challenges
par: Feng, ZhengZhao, et autres
Publié: (2024)

BurstAttention: An Efficient Distributed Attention Framework for Extremely Long Sequences
par: Sun, Ao, et autres
Publié: (2024)

PRoLoRA: Partial Rotation Empowers More Parameter-Efficient LoRA
par: Wang, Sheng, et autres
Publié: (2024)

PRISM: Parallel Residual Iterative Sequence Model
par: Jiang, Jie, et autres
Publié: (2026)

SMR: State Memory Replay for Long Sequence Modeling
par: Qi, Biqing, et autres
Publié: (2024)

Local Attention Mechanism: Boosting the Transformer Architecture for Long-Sequence Time Series Forecasting
par: Aguilera-Martos, Ignacio, et autres
Publié: (2024)

Large Language Models Can Verbatim Reproduce Long Malicious Sequences
par: Lin, Sharon, et autres
Publié: (2025)

KernelBenchX: A Comprehensive Benchmark for Evaluating LLM-Generated GPU Kernels
par: Wang, Han, et autres
Publié: (2026)

DHG-Bench: A Comprehensive Benchmark for Deep Hypergraph Learning
par: Li, Fan, et autres
Publié: (2025)

Distribution-Aligned Sequence Distillation for Superior Long-CoT Reasoning
par: Yan, Shaotian, et autres
Publié: (2026)

SubgoalXL: Subgoal-based Expert Learning for Theorem Proving
par: Zhao, Xueliang, et autres
Publié: (2024)

Counterfactual Explanations for Continuous Action Reinforcement Learning
par: Dong, Shuyang, et autres
Publié: (2025)

RotRNN: Modelling Long Sequences with Rotations
par: Biegun, Kai, et autres
Publié: (2024)

BackSlash: Rate Constrained Optimized Training of Large Language Models
par: Wu, Jun, et autres
Publié: (2025)

QSpec: Speculative Decoding with Complementary Quantization Schemes
par: Zhao, Juntao, et autres
Publié: (2024)

From Time Series to State: Situation-Aware Modeling for Air Traffic Flow Prediction
par: Liu, Anqi, et autres
Publié: (2026)

Star Attention: Efficient LLM Inference over Long Sequences
par: Acharya, Shantanu, et autres
Publié: (2024)

A Comprehensive Survey on Long Context Language Modeling
par: Liu, Jiaheng, et autres
Publié: (2025)

Diffusion of Thoughts: Chain-of-Thought Reasoning in Diffusion Language Models
par: Ye, Jiacheng, et autres
Publié: (2024)

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards
par: Wang, Sheng, et autres
Publié: (2024)

Native Hybrid Attention for Efficient Sequence Modeling
par: Du, Jusen, et autres
Publié: (2025)

Linear Attention for Efficient Bidirectional Sequence Modeling
par: Afzal, Arshia, et autres
Publié: (2025)