Imagen de Portada

MHLA: Restoring Expressivity of Linear Attention via Token-Level Multi-Head

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autores principales:	Zhang, Kewei, Huang, Ye, Deng, Yufan, Yu, Jincheng, Chen, Junsong, Ling, Huan, Xie, Enze, Zhou, Daquan
Formato:	Preprint
Publicado:	2026
Materias:	Computer Vision and Pattern Recognition Artificial Intelligence
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

HumanNet: Scaling Human-centric Video Learning to One Million Hours
por: Deng, Yufan, et al.
Publicado: (2026)

SANA-WM: Efficient Minute-Scale World Modeling with Hybrid Linear Diffusion Transformer
por: Zhu, Haoyi, et al.
Publicado: (2026)

SANA 1.5: Efficient Scaling of Training-Time and Inference-Time Compute in Linear Diffusion Transformer
por: Xie, Enze, et al.
Publicado: (2025)

DC-AR: Efficient Masked Autoregressive Image Generation with Deep Compression Hybrid Tokenizer
por: Wu, Yecheng, et al.
Publicado: (2025)

SANA-Video: Efficient Video Generation with Block Linear Diffusion Transformer
por: Chen, Junsong, et al.
Publicado: (2025)

TS-Attn: Temporal-wise Separable Attention for Multi-Event Video Generation
por: Zhang, Hongyu, et al.
Publicado: (2026)

SANA-Streaming: Real-time Streaming Video Editing with Hybrid Diffusion Transformer
por: Zhao, Yuyang, et al.
Publicado: (2026)

Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention
por: Qiao, Bingtian, et al.
Publicado: (2026)

Real-time One-Step Diffusion-based Expressive Portrait Videos Generation
por: Guo, Hanzhong, et al.
Publicado: (2024)

Interactive Multi-Head Self-Attention with Linear Complexity
por: Kang, Hankyul, et al.
Publicado: (2024)

Enhancing Spatial Understanding in Image Generation via Reward Modeling
por: Tang, Zhenyu, et al.
Publicado: (2026)

Not All Tokens and Heads Are Equally Important: Dual-Level Attention Intervention for Hallucination Mitigation
por: Tang, Lexiang, et al.
Publicado: (2025)

SAGA: Selective Adaptive Gating for Efficient and Expressive Linear Attention
por: Cao, Yuan, et al.
Publicado: (2025)

PixArt-$α$: Fast Training of Diffusion Transformer for Photorealistic Text-to-Image Synthesis
por: Chen, Junsong, et al.
Publicado: (2023)

TalkCLIP: Talking Head Generation with Text-Guided Expressive Speaking Styles
por: Ma, Yifeng, et al.
Publicado: (2023)

Magic 1-For-1: Generating One Minute Video Clips within One Minute
por: Yi, Hongwei, et al.
Publicado: (2025)

Selective LoRA for Visual Tokens and Attention Heads
por: Luo, Tiange, et al.
Publicado: (2025)

Low-Resolution Self-Attention for Semantic Segmentation
por: Wu, Yu-Huan, et al.
Publicado: (2023)

ID-to-3D: Expressive ID-guided 3D Heads via Score Distillation Sampling
por: Babiloni, Francesca, et al.
Publicado: (2024)

SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformers
por: Xie, Enze, et al.
Publicado: (2024)

StoryDiffusion: Consistent Self-Attention for Long-Range Image and Video Generation
por: Zhou, Yupeng, et al.
Publicado: (2024)

Restoring Initial Noise Sensitivity in Text-to-Image Distillation via Geometric Alignment
por: Huang, Huayang, et al.
Publicado: (2026)

Token-Level Inference-Time Alignment for Vision-Language Models
por: Chen, Kejia, et al.
Publicado: (2025)

GLMHA A Guided Low-rank Multi-Head Self-Attention for Efficient Image Restoration and Spectral Reconstruction
por: Ilyas, Zaid, et al.
Publicado: (2024)

MoH: Multi-Head Attention as Mixture-of-Head Attention
por: Jin, Peng, et al.
Publicado: (2024)

Breaking Complexity Barriers: High-Resolution Image Restoration with Rank Enhanced Linear Attention
por: Ai, Yuang, et al.
Publicado: (2025)

FreeBlend: Advancing Concept Blending with Staged Feedback-Driven Interpolation Diffusion
por: Zhou, Yufan, et al.
Publicado: (2025)

Exploring Real&Synthetic Dataset and Linear Attention in Image Restoration
por: Du, Yuzhen, et al.
Publicado: (2024)

SafePTR: Token-Level Jailbreak Defense in Multimodal LLMs via Prune-then-Restore Mechanism
por: Chen, Beitao, et al.
Publicado: (2025)

DC-AE 1.5: Accelerating Diffusion Model Convergence with Structured Latent Space
por: Chen, Junyu, et al.
Publicado: (2025)

X-NeMo: Expressive Neural Motion Reenactment via Disentangled Latent Attention
por: Zhao, Xiaochen, et al.
Publicado: (2025)

High-Fidelity Mural Restoration via a Unified Hybrid Mask-Aware Transformer
por: Jiang, Jincheng, et al.
Publicado: (2026)

Controllable and Expressive One-Shot Video Head Swapping
por: Ji, Chaonan, et al.
Publicado: (2025)

Restorer: Removing Multi-Degradation with All-Axis Attention and Prompt Guidance
por: Mao, Jiawei, et al.
Publicado: (2024)

Improving Vision Transformers by Overlapping Heads in Multi-Head Self-Attention
por: Zhang, Tianxiao, et al.
Publicado: (2024)

Agent Attention: On the Integration of Softmax and Linear Attention
por: Han, Dongchen, et al.
Publicado: (2023)

Instant Expressive Gaussian Head Avatar via 3D-Aware Expression Distillation
por: Jiang, Kaiwen, et al.
Publicado: (2025)

PIXART-δ: Fast and Controllable Image Generation with Latent Consistency Models
por: Chen, Junsong, et al.
Publicado: (2024)

HAT: Hybrid Attention Transformer for Image Restoration
por: Chen, Xiangyu, et al.
Publicado: (2023)

X-Portrait: Expressive Portrait Animation with Hierarchical Motion Attention
por: Xie, You, et al.
Publicado: (2024)