Image de couverture de livre

MirrorLA: Reflecting Feature Map for Vision Linear Attention

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Meng, Weikang, Huo, Liangyu, Luo, Yadan, Wang, Yaowei, Li, Yingjian, Zhang, Zheng
Format:	Preprint
Publié:	2026
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Norm$\times$Direction: Restoring the Missing Query Norm in Vision Linear Attention
par: Meng, Weikang, et autres
Publié: (2025)

STILL: Selecting Tokens for Intra-Layer Hybrid Attention to Linearize LLMs
par: Meng, Weikang, et autres
Publié: (2026)

PolaFormer: Polarity-aware Linear Attention for Vision Transformers
par: Meng, Weikang, et autres
Publié: (2025)

PLS in the Mirror of Self-Attention
par: Jiangsheng, et autres
Publié: (2026)

MetaLA: Unified Optimal Linear Approximation to Softmax Attention Map
par: Chou, Yuhong, et autres
Publié: (2024)

A Finite Sample Analysis of Distributional TD Learning with Linear Function Approximation
par: Peng, Yang, et autres
Publié: (2025)

Statistical Test for Attention Map in Vision Transformer
par: Shiraishi, Tomohiro, et autres
Publié: (2024)

Degrees of Freedom for Linear Attention: Distilling Softmax Attention with Optimal Feature Efficiency
par: Nishikawa, Naoki, et autres
Publié: (2025)

Multi-refined Feature Enhanced Sentiment Analysis Using Contextual Instruction
par: Atandoh, Peter, et autres
Publié: (2025)

Provable Ordering and Continuity in Vision-Language Pretraining for Generalizable Embodied Agents
par: Zhang, Zhizhen, et autres
Publié: (2025)

Scaling Linear Attention with Sparse State Expansion
par: Pan, Yuqi, et autres
Publié: (2025)

ConjNorm: Tractable Density Estimation for Out-of-Distribution Detection
par: Peng, Bo, et autres
Publié: (2024)

Nonstationary Generalized Linear Bandits with Discounted Online Mirror Descent
par: Lee, Joongkyu, et autres
Publié: (2026)

EfficientECG: Cross-Attention with Feature Fusion for Efficient Electrocardiogram Classification
par: Deng, Hanhui, et autres
Publié: (2025)

A Library of Mirrors: Deep Neural Nets in Low Dimensions are Convex Lasso Models with Reflection Features
par: Zeger, Emi, et autres
Publié: (2024)

Dense Feature Learning via Linear Structure Preservation in Medical Data
par: Zhang, Yuanyun, et autres
Publié: (2026)

PCaM: A Progressive Focus Attention-Based Information Fusion Method for Improving Vision Transformer Domain Adaptation
par: Zang, Zelin, et autres
Publié: (2025)

Local Linear Attention: An Optimal Interpolation of Linear and Softmax Attention For Test-Time Regression
par: Zuo, Yifei, et autres
Publié: (2025)

Beyond Euclidean Proximity: Repairing Latent World Models with Horizon-Matched Trajectory Reachability Metrics
par: Li, Liangyu, et autres
Publié: (2026)

Kimi Linear: An Expressive, Efficient Attention Architecture
par: Kimi Team, et autres
Publié: (2025)

Emotion Collider: Dual Hyperbolic Mirror Manifolds for Sentiment Recovery via Anti Emotion Reflection
par: Fu, Rong, et autres
Publié: (2026)

Log-Linear Attention
par: Guo, Han, et autres
Publié: (2025)

Statistical Efficiency of Distributional Temporal Difference Learning and Freedman's Inequality in Hilbert Spaces
par: Peng, Yang, et autres
Publié: (2024)

Federated Reinforcement Learning with Constraint Heterogeneity
par: Jin, Hao, et autres
Publié: (2024)

Linearized Diffusion Map
par: Candanedo, Julio
Publié: (2025)

On-the-Fly Adaptive Distillation of Transformer to Dual-State Linear Attention
par: Ro, Yeonju, et autres
Publié: (2025)

Class-Discriminative Attention Maps for Vision Transformers
par: Brocki, Lennart, et autres
Publié: (2023)

Hallucination Detection in LLMs Using Spectral Features of Attention Maps
par: Binkowski, Jakub, et autres
Publié: (2025)

RoPE Attention Can Be Trained in Almost Linear Time
par: Cao, Yang, et autres
Publié: (2024)

Higher-order Linear Attention
par: Zhang, Yifan, et autres
Publié: (2025)

Short-Long Convolutions Help Hardware-Efficient Linear Attention to Focus on Long Sequences
par: Liu, Zicheng, et autres
Publié: (2024)

Adaptive Memory Decay for Log-Linear Attention
par: Amin, Yaxita, et autres
Publié: (2026)

Training Dynamics of In-Context Learning in Linear Attention
par: Zhang, Yedi, et autres
Publié: (2025)

MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection
par: Chen, Zhuoxiao, et autres
Publié: (2024)

Implicit Bias of Mirror Flow in Homogeneous Neural Networks: Sparse and Dense Feature Learning
par: Jacobs, Tom, et autres
Publié: (2026)

Contextual Linear Bandits with Delay as Payoff
par: Zhang, Mengxiao, et autres
Publié: (2025)

Macformer: Transformer with Random Maclaurin Feature Attention
par: Guo, Yuhan, et autres
Publié: (2024)

One-Step Flow Policy Mirror Descent
par: Chen, Tianyi, et autres
Publié: (2025)

CodeMerge: Codebook-Guided Model Merging for Robust Test-Time Adaptation in Autonomous Driving
par: Yang, Huitong, et autres
Publié: (2025)

DistZO2: High-Throughput and Memory-Efficient Zeroth-Order Fine-tuning LLMs with Distributed Parallel Computing
par: Wang, Liangyu, et autres
Publié: (2025)