:: Library Catalog

Cover Image

Saved in:

Bibliographic Details
Main Authors:	Li, Zhexiang, Wang, Haoyu, Bao, Yutong, Woodruff, David
Format:	Preprint
Published:	2025
Subjects:	Machine Learning
Online Access:	https://arxiv.org/abs/2505.11040
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

LevAttention: Time, Space, and Streaming Efficient Algorithm for Heavy Attentions
by: Kannan, Ravindran, et al.
Published: (2024)

Ridge Leverage Score Sampling for $\ell_p$ Subspace Approximation
by: Woodruff, David P., et al.
Published: (2024)

LOOKAT: Lookup-Optimized Key-Attention for Memory-Efficient Transformers
by: Karmore, Aryan
Published: (2026)

Causal Information Prioritization for Efficient Reinforcement Learning
by: Cao, Hongye, et al.
Published: (2025)

Mixture-of-Channels: Exploiting Sparse FFNs for Efficient LLMs Pre-Training and Inference
by: Wu, Tong, et al.
Published: (2025)

Stronger Graph Transformer with Regularized Attention Scores
by: Ku, Eugene
Published: (2023)

EcoSpa: Efficient Transformer Training with Coupled Sparsity
by: Xiao, Jinqi, et al.
Published: (2025)

John Ellipsoids via Lazy Updates
by: Woodruff, David P., et al.
Published: (2025)

Simulation-based Inference via Langevin Dynamics with Score Matching
by: Jiang, Haoyu, et al.
Published: (2025)

QSVD: Efficient Low-rank Approximation for Unified Query-Key-Value Weight Compression in Low-Precision Vision-Language Models
by: Wang, Yutong, et al.
Published: (2025)

Grass: Compute Efficient Low-Memory LLM Training with Structured Sparse Gradients
by: Muhamed, Aashiq, et al.
Published: (2024)

Hamming Attention Distillation: Binarizing Keys and Queries for Efficient Long-Context Transformers
by: Horton, Mark, et al.
Published: (2025)

Query-Efficient Locally Private Hypothesis Selection via the Scheffe Graph
by: Kamath, Gautam, et al.
Published: (2025)

Data Efficient Any Transformer-to-Mamba Distillation via Attention Bridge
by: Wang, Penghao, et al.
Published: (2025)

Even Sparser Graph Transformers
by: Shirzad, Hamed, et al.
Published: (2024)

Unmasking Backdoors: An Explainable Defense via Gradient-Attention Anomaly Scoring for Pre-trained Language Models
by: Das, Anindya Sundar, et al.
Published: (2025)

The Effect of Attention Head Count on Transformer Approximation
by: Yu, Penghao, et al.
Published: (2025)

A Theory for Compressibility of Graph Transformers for Transductive Learning
by: Shirzad, Hamed, et al.
Published: (2024)

Loki: Low-rank Keys for Efficient Sparse Attention
by: Singhania, Prajwal, et al.
Published: (2024)

GQKVA: Efficient Pre-training of Transformers by Grouping Queries, Keys, and Values
by: Javadi, Farnoosh, et al.
Published: (2023)

Toward Efficient Testing of Graph Neural Networks via Test Input Prioritization
by: Yang, Lichen, et al.
Published: (2025)

Learning to Focus: Prioritizing Informative Histories with Structured Attention Mechanisms in Partially Observable Reinforcement Learning
by: Allegue, Daniel De Dios, et al.
Published: (2025)

Brenier Isotonic Regression
by: Bao, Han, et al.
Published: (2026)

ScoutAttention: Efficient KV Cache Offloading via Layer-Ahead CPU Pre-computation for LLM Inference
by: Zhang, Qiuyang, et al.
Published: (2026)

Attention-Enhanced Prioritized Proximal Policy Optimization for Adaptive Edge Caching
by: Niknia, Farnaz, et al.
Published: (2024)

Prioritized Generative Replay
by: Wang, Renhao, et al.
Published: (2024)

Online Learning with Limited Information in the Sliding Window Model
by: Braverman, Vladimir, et al.
Published: (2026)

Better Bounds for the Distributed Experts Problem
by: Woodruff, David P., et al.
Published: (2026)

Sharper Bounds for $\ell_p$ Sensitivity Sampling
by: Woodruff, David P., et al.
Published: (2023)

Reweighted Solutions for Weighted Low Rank Approximation
by: Woodruff, David P., et al.
Published: (2024)

Coresets for Multiple $\ell_p$ Regression
by: Woodruff, David P., et al.
Published: (2024)

RoPeSLR: 3D RoPE-driven Sparse-LowRank Attention for Efficient Diffusion Transformers
by: Liu, Yuxi, et al.
Published: (2026)

Reading Your Heart: Learning ECG Words and Sentences via Pre-training ECG Language Model
by: Jin, Jiarui, et al.
Published: (2025)

BitStopper: An Efficient Transformer Attention Accelerator via Stage-fusion and Early Termination
by: Wang, Huizheng, et al.
Published: (2025)

Optimal Sketching for Residual Error Estimation for Matrix and Vector Norms
by: Li, Yi, et al.
Published: (2024)

Graph Attention Based Prioritization of Disease Responsible Genes from Multimodal Alzheimer's Network
by: Teji, Binon, et al.
Published: (2026)

Data-Efficient Learning via Clustering-Based Sensitivity Sampling: Foundation Models and Beyond
by: Axiotis, Kyriakos, et al.
Published: (2024)

Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression
by: Zuo, Yifei, et al.
Published: (2025)

Exploring Key Factors for Long-Term Vessel Incident Risk Prediction
by: Chen, Tianyi, et al.
Published: (2024)

Reducing Transformer Key-Value Cache Size with Cross-Layer Attention
by: Brandon, William, et al.
Published: (2024)