Image de couverture de livre

On The Application of Linear Attention in Multimodal Transformers

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Gerami, Armin, Madani, Seyedehanita, Duraiswami, Ramani
Format:	Preprint
Publié:	2026
Sujets:	Computer Vision and Pattern Recognition
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Transformer Based Linear Attention with Optimized GPU Kernel Implementation
par: Gerami, Armin, et autres
Publié: (2025)

Morphing Through Time: Diffusion-Based Bridging of Temporal Gaps for Robust Alignment in Change Detection
par: Madani, Seyedehanita, et autres
Publié: (2025)

Auditing Algorithmic Bias in Transformer-Based Trading
par: Gerami, Armin, et autres
Publié: (2025)

DiffRegCD: Integrated Registration and Change Detection with Diffusion Features
par: Madani, Seyedehanita, et autres
Publié: (2025)

3D Gaussian Splatting with Normal Information for Mesh Extraction and Improved Rendering
par: Krishnan, Meenakshi, et autres
Publié: (2025)

Room Impulse Response Synthesis via Differentiable Feedback Delay Networks for Efficient Spatial Audio Rendering
par: Gerami, Armin, et autres
Publié: (2025)

AURA: A Fine-Grained Benchmark and Decomposed Metric for Audio-Visual Reasoning
par: Galougah, Siminfar Samakoush, et autres
Publié: (2025)

Quantifying Document Impact in RAG-LLMs
par: Gerami, Armin, et autres
Publié: (2025)

FAST: Factorizable Attention for Speeding up Transformers
par: Gerami, Armin, et autres
Publié: (2024)

Gated Condition Injection without Multimodal Attention: Towards Controllable Linear-Attention Transformers
par: Liu, Yuhe, et autres
Publié: (2026)

Learning Illumination Control in Diffusion Models
par: Anand, Nishit, et autres
Publié: (2026)

ViT-AdaLA: Adapting Vision Transformers with Linear Attention
par: Li, Yifan, et autres
Publié: (2026)

ScatterFormer: Efficient Voxel Transformer with Scattered Linear Attention
par: He, Chenhang, et autres
Publié: (2024)

Dynamic Differential Linear Attention: Enhancing Linear Diffusion Transformer for High-Quality Image Generation
par: Cao, Boyuan, et autres
Publié: (2026)

The Linear Attention Resurrection in Vision Transformer
par: Zheng, Chuanyang
Publié: (2025)

Attention Surgery: An Efficient Recipe to Linearize Your Video Diffusion Transformer
par: Ghafoorian, Mohsen, et autres
Publié: (2025)

SALAD: Achieve High-Sparsity Attention via Efficient Linear Attention Tuning for Video Diffusion Transformer
par: Fang, Tongcheng, et autres
Publié: (2026)

LoFLAT: Local Feature Matching using Focused Linear Attention Transformer
par: Cao, Naijian, et autres
Publié: (2024)

Castling-ViT: Compressing Self-Attention via Switching Towards Linear-Angular Attention at Vision Transformer Inference
par: You, Haoran, et autres
Publié: (2022)

EGOILLUSION: Benchmarking Hallucinations in Egocentric Video Understanding
par: Seth, Ashish, et autres
Publié: (2025)

Dynamic-eDiTor: Training-Free Text-Driven 4D Scene Editing with Multimodal Diffusion Transformer
par: Lee, Dong In, et autres
Publié: (2025)

Agent Attention: On the Integration of Softmax and Linear Attention
par: Han, Dongchen, et autres
Publié: (2023)

EDiT: Efficient Diffusion Transformers with Linear Compressed Attention
par: Becker, Philipp, et autres
Publié: (2025)

Beyond Anatomy: Explainable ASD Classification from rs-fMRI via Functional Parcellation and Graph Attention Networks
par: Madani, Syeda Hareem, et autres
Publié: (2026)

PolaFormer: Polarity-aware Linear Attention for Vision Transformers
par: Meng, Weikang, et autres
Publié: (2025)

X2I: Seamless Integration of Multimodal Understanding into Diffusion Transformer via Attention Distillation
par: Ma, Jian, et autres
Publié: (2025)

L-MCAT: Unpaired Multimodal Transformer with Contrastive Attention for Label-Efficient Satellite Image Classification
par: Goswami, Mitul, et autres
Publié: (2025)

SLAB: Efficient Transformers with Simplified Linear Attention and Progressive Re-parameterized Batch Normalization
par: Guo, Jialong, et autres
Publié: (2024)

Rectifying Magnitude Neglect in Linear Attention
par: Fan, Qihang, et autres
Publié: (2025)

DeepFace-Attention: Multimodal Face Biometrics for Attention Estimation with Application to e-Learning
par: Daza, Roberto, et autres
Publié: (2024)

HyperPointFormer: Multimodal Fusion in 3D Space with Dual-Branch Cross-Attention Transformers
par: Rizaldy, Aldino, et autres
Publié: (2025)

Head Pursuit: Probing Attention Specialization in Multimodal Transformers
par: Basile, Lorenzo, et autres
Publié: (2025)

Breaking the Low-Rank Dilemma of Linear Attention
par: Fan, Qihang, et autres
Publié: (2024)

ARFlow: Autoregressive Flow with Hybrid Linear Attention
par: Hui, Mude, et autres
Publié: (2025)

Linear Attention Modeling for Learned Image Compression
par: Feng, Donghui, et autres
Publié: (2025)

Bridging the Divide: Reconsidering Softmax and Linear Attention
par: Han, Dongchen, et autres
Publié: (2024)

SeaDATE: Remedy Dual-Attention Transformer with Semantic Alignment via Contrast Learning for Multimodal Object Detection
par: Dong, Shuhan, et autres
Publié: (2024)

LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution
par: Li, Xiaohui, et autres
Publié: (2025)

Representative Attention For Vision Transformers
par: Li, Yuntong, et autres
Publié: (2026)

Vision Transformers with Hierarchical Attention
par: Liu, Yun, et autres
Publié: (2021)