Saved in:
| Main Author: | Zhao, Jialin |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2510.01718 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
Efficient High-Resolution Time Series Classification via Attention Kronecker Decomposition
by: Feng, Aosong, et al.
Published: (2024)
by: Feng, Aosong, et al.
Published: (2024)
BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basis
by: Ni, Zelin, et al.
Published: (2023)
by: Ni, Zelin, et al.
Published: (2023)
Support Basis: Fast Attention Beyond Bounded Entries
by: Aliakbarpour, Maryam, et al.
Published: (2025)
by: Aliakbarpour, Maryam, et al.
Published: (2025)
Importance-Guided Basis Selection for Low-Rank Decomposition of Large Language Models
by: Asante, Daniel Agyei, et al.
Published: (2026)
by: Asante, Daniel Agyei, et al.
Published: (2026)
Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications
by: Li, Yang, et al.
Published: (2024)
by: Li, Yang, et al.
Published: (2024)
Conv-Basis: A New Paradigm for Efficient Attention Inference and Gradient Computation in Transformers
by: Liang, Yingyu, et al.
Published: (2024)
by: Liang, Yingyu, et al.
Published: (2024)
AB-PINNs: Adaptive-Basis Physics-Informed Neural Networks for Residual-Driven Domain Decomposition
by: Botvinick-Greenhouse, Jonah, et al.
Published: (2025)
by: Botvinick-Greenhouse, Jonah, et al.
Published: (2025)
Computational Algebra with Attention: Transformer Oracles for Border Basis Algorithms
by: Kera, Hiroshi, et al.
Published: (2025)
by: Kera, Hiroshi, et al.
Published: (2025)
HSR-Enhanced Sparse Attention Acceleration
by: Chen, Bo, et al.
Published: (2024)
by: Chen, Bo, et al.
Published: (2024)
Basis-to-Basis Operator Learning Using Function Encoders
by: Ingebrand, Tyler, et al.
Published: (2024)
by: Ingebrand, Tyler, et al.
Published: (2024)
Don't Fix the Basis -- Learn It: Spectral Representation with Adaptive Basis Learning for PDEs
by: Zhao, Xuxiang, et al.
Published: (2026)
by: Zhao, Xuxiang, et al.
Published: (2026)
SageAttention: Accurate 8-Bit Attention for Plug-and-play Inference Acceleration
by: Zhang, Jintao, et al.
Published: (2024)
by: Zhang, Jintao, et al.
Published: (2024)
Attention-based Iterative Decomposition for Tensor Product Representation
by: Park, Taewon, et al.
Published: (2024)
by: Park, Taewon, et al.
Published: (2024)
An Accelerated Alternating Partial Bregman Algorithm for ReLU-based Matrix Decomposition
by: Wang, Qingsong, et al.
Published: (2025)
by: Wang, Qingsong, et al.
Published: (2025)
Sparse Attention Decomposition Applied to Circuit Tracing
by: Franco, Gabriel, et al.
Published: (2024)
by: Franco, Gabriel, et al.
Published: (2024)
Pivoting Factorization: A Compact Meta Low-Rank Representation of Sparsity for Efficient Inference in Large Language Models
by: Zhao, Jialin, et al.
Published: (2025)
by: Zhao, Jialin, et al.
Published: (2025)
Towards Understanding the Nature of Attention with Low-Rank Sparse Decomposition
by: He, Zhengfu, et al.
Published: (2025)
by: He, Zhengfu, et al.
Published: (2025)
Fourier Basis Density Model
by: De la Fuente, Alfredo, et al.
Published: (2024)
by: De la Fuente, Alfredo, et al.
Published: (2024)
Radial Basis Operator Networks
by: Kurz, Jason, et al.
Published: (2024)
by: Kurz, Jason, et al.
Published: (2024)
When and Why Grouping Attention Heads Accelerates Muon Optimization
by: Zhang, Hongtao, et al.
Published: (2026)
by: Zhang, Hongtao, et al.
Published: (2026)
From Basis to Basis: Gaussian Particle Representation for Interpretable PDE Operators
by: Li, Zhihao, et al.
Published: (2026)
by: Li, Zhihao, et al.
Published: (2026)
AttnCache: Accelerating Self-Attention Inference for LLM Prefill via Attention Cache
by: Song, Dinghong, et al.
Published: (2025)
by: Song, Dinghong, et al.
Published: (2025)
Tender: Accelerating Large Language Models via Tensor Decomposition and Runtime Requantization
by: Lee, Jungi, et al.
Published: (2024)
by: Lee, Jungi, et al.
Published: (2024)
Flashlight: PyTorch Compiler Extensions to Accelerate Attention Variants
by: You, Bozhi, et al.
Published: (2025)
by: You, Bozhi, et al.
Published: (2025)
CSAttention: Centroid-Scoring Attention for Accelerating LLM Inference
by: Song, Chuxu, et al.
Published: (2026)
by: Song, Chuxu, et al.
Published: (2026)
Accelerating Regularized Attention Kernel Regression for Spectrum Cartography
by: Tao, Liping, et al.
Published: (2026)
by: Tao, Liping, et al.
Published: (2026)
Tensor Decomposition Based Attention Module for Spiking Neural Networks
by: Deng, Haoyu, et al.
Published: (2023)
by: Deng, Haoyu, et al.
Published: (2023)
Hybrid Attention Model Using Feature Decomposition and Knowledge Distillation for Glucose Forecasting
by: Farahmand, Ebrahim, et al.
Published: (2024)
by: Farahmand, Ebrahim, et al.
Published: (2024)
Change-of-Basis Pruning via Rotational Invariance
by: Ning, Alex, et al.
Published: (2025)
by: Ning, Alex, et al.
Published: (2025)
Basis Transformers for Multi-Task Tabular Regression
by: Loh, Wei Min, et al.
Published: (2025)
by: Loh, Wei Min, et al.
Published: (2025)
Scalable Deep Basis Kernel Gaussian Processes
by: Zhu, Yunqin, et al.
Published: (2025)
by: Zhu, Yunqin, et al.
Published: (2025)
Dual-Domain Deep Learning Method to Accelerate Local Basis Functions Computation for Reservoir Simulation in High-Contrast Porous Media
by: Li, Peiqi, et al.
Published: (2025)
by: Li, Peiqi, et al.
Published: (2025)
A Momentum Accelerated Algorithm for ReLU-based Nonlinear Matrix Decomposition
by: Wang, Qingsong, et al.
Published: (2024)
by: Wang, Qingsong, et al.
Published: (2024)
ITA: An Energy-Efficient Attention and Softmax Accelerator for Quantized Transformers
by: İslamoğlu, Gamze, et al.
Published: (2023)
by: İslamoğlu, Gamze, et al.
Published: (2023)
CLAA: Cross-Layer Attention Aggregation for Accelerating LLM Prefill
by: McDanel, Bradley, et al.
Published: (2026)
by: McDanel, Bradley, et al.
Published: (2026)
Balancing Fidelity and Diversity in Diffusion Models via Symmetric Attention Decomposition: Hopfield Perspective
by: Cho, Hyunmin, et al.
Published: (2026)
by: Cho, Hyunmin, et al.
Published: (2026)
CARE: Covariance-Aware and Rank-Enhanced Decomposition for Enabling Multi-Head Latent Attention
by: Zhou, Zhongzhu, et al.
Published: (2026)
by: Zhou, Zhongzhu, et al.
Published: (2026)
TreeCut: A Synthetic Unanswerable Math Word Problem Dataset for LLM Hallucination Evaluation
by: Ouyang, Jialin
Published: (2025)
by: Ouyang, Jialin
Published: (2025)
Efficient Nonparametric Tensor Decomposition for Binary and Count Data
by: Tao, Zerui, et al.
Published: (2024)
by: Tao, Zerui, et al.
Published: (2024)
FB-HyDON: Parameter-Efficient Physics-Informed Operator Learning of Complex PDEs via Hypernetwork and Finite Basis Domain Decomposition
by: Ramezankhani, Milad, et al.
Published: (2024)
by: Ramezankhani, Milad, et al.
Published: (2024)
Similar Items
-
Efficient High-Resolution Time Series Classification via Attention Kronecker Decomposition
by: Feng, Aosong, et al.
Published: (2024) -
BasisFormer: Attention-based Time Series Forecasting with Learnable and Interpretable Basis
by: Ni, Zelin, et al.
Published: (2023) -
Support Basis: Fast Attention Beyond Bounded Entries
by: Aliakbarpour, Maryam, et al.
Published: (2025) -
Importance-Guided Basis Selection for Low-Rank Decomposition of Large Language Models
by: Asante, Daniel Agyei, et al.
Published: (2026) -
Basis Selection: Low-Rank Decomposition of Pretrained Large Language Models for Target Applications
by: Li, Yang, et al.
Published: (2024)