Cover Image

Linear Differential Vision Transformer: Learning Visual Contrasts via Pairwise Differentials

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Pu, Yifan, Ying, Jixuan, Li, Qixiu, Ye, Tianzhu, Han, Dongchen, Wang, Xiaochen, Wang, Ziyi, Shao, Xinyu, Huang, Gao, Li, Xiu
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Vision Transformers are Circulant Attention Learners
by: Han, Dongchen, et al.
Published: (2025)

Efficient Diffusion Transformer with Step-wise Dynamic Attention Mediators
by: Pu, Yifan, et al.
Published: (2024)

Differential Transformer
by: Ye, Tianzhu, et al.
Published: (2024)

Demystify Mamba in Vision: A Linear Attention Perspective
by: Han, Dongchen, et al.
Published: (2024)

Bridging the Divide: Reconsidering Softmax and Linear Attention
by: Han, Dongchen, et al.
Published: (2024)

Linear-Time Global Visual Modeling without Explicit Attention
by: He, Ruize, et al.
Published: (2026)

Agent Attention: On the Integration of Softmax and Linear Attention
by: Han, Dongchen, et al.
Published: (2023)

Step by Step Network
by: Han, Dongchen, et al.
Published: (2025)

Optimal Differentially Private Ranking from Pairwise Comparisons
by: Cai, T. Tony, et al.
Published: (2025)

Unifying Visual and Vision-Language Tracking via Contrastive Learning
by: Ma, Yinchao, et al.
Published: (2024)

GRA: Detecting Oriented Objects through Group-wise Rotating and Attention
by: Wang, Jiangshan, et al.
Published: (2024)

PRISM: Deriving a White-Box Transformer as a Signal-Noise Decomposition Operator via Maximum Coding Rate Reduction
by: Huang, Dongchen
Published: (2026)

DPI: Ensuring Strict Differential Privacy for Infinite Data Streaming
by: Feng, Shuya, et al.
Published: (2023)

Dynamic Differential Linear Attention: Enhancing Linear Diffusion Transformer for High-Quality Image Generation
by: Cao, Boyuan, et al.
Published: (2026)

Benchmarking Differentially Private Tabular Data Synthesis
by: Chen, Kai, et al.
Published: (2025)

On Computing Pairwise Statistics with Local Differential Privacy
by: Ghazi, Badih, et al.
Published: (2024)

HeteroFedSyn: Differentially Private Tabular Data Synthesis for Heterogeneous Federated Settings
by: Li, Xiaochen, et al.
Published: (2026)

Differential Contrastive Training for Gaze Estimation
by: Zhang, Lin, et al.
Published: (2025)

Global, regional and national burdens of bipolar disorders in adolescents and young adults: a trend analysis from 1990 to 2019
by: Yunxi Zhong, et al.
Published: (2024)

Separate, Dynamic and Differentiable (SMART) Pruner for Block/Output Channel Pruning on Computer Vision Tasks
by: Ding, Guanhua, et al.
Published: (2024)

ViT$^3$: Unlocking Test-Time Training in Vision
by: Han, Dongchen, et al.
Published: (2025)

From Easy to Hard: Building a Shortcut for Differentially Private Image Synthesis
by: Li, Kecen, et al.
Published: (2025)

Application of Ultra Micro Angiography in Differential Diagnosis of Renal Tumors
by: Rui Cheng, et al.
Published: (2025)

Neural Estimation of Pairwise Mutual Information in Masked Discrete Sequence Models
by: Sharma, Jai, et al.
Published: (2026)

$C^1$-robust homoclinic tangencies
by: Li, Dongchen
Published: (2024)

Blender-producing mechanisms and a dichotomy for local dynamics for heterodimensional cycles
by: Li, Dongchen
Published: (2024)

A Novel Interactive-Guided Differential Testing Approach for FPGA Simulation Debugger Tools
by: Guo, Shikai, et al.
Published: (2025)

High-Fidelity Differential-information Driven Binary Vision Transformer
by: Gao, Tian, et al.
Published: (2025)

The Limits of Differential Privacy in Online Learning
by: Li, Bo, et al.
Published: (2024)

dwang53/WaxLakeDelta_openTelemac_model: Initial release. v0.0.1
by: Dongchen Wang
Published: (2025)

AnchorFormer: Differentiable Anchor Attention for Efficient Vision Transformer
by: Shan, Jiquan, et al.
Published: (2025)

Differentiable Prompt Learning for Vision Language Models
by: Huang, Zhenhan, et al.
Published: (2024)

Universal Skeleton Understanding via Differentiable Rendering and MLLMs
by: Wang, Ziyi, et al.
Published: (2026)

Differential Multimodal Transformers
by: Li, Jerry, et al.
Published: (2025)

Attributed Graph Clustering with Multi-Scale Weight-Based Pairwise Coarsening and Contrastive Learning
by: Li, Binxiong, et al.
Published: (2025)

Differentiable Architecture Search for Adversarially Robust Quantum Computer Vision
by: Afane, Mohamed, et al.
Published: (2026)

DASViT: Differentiable Architecture Search for Vision Transformer
by: Wu, Pengjin, et al.
Published: (2025)

The Transformation of Neck Unicentric Castleman's Disease to Follicular Dendritic Cell Sarcoma
by: Yingying Li, et al.
Published: (2024)

CO 2 Capture and In Situ Conversion Technologies: Prospects and Perspectives for Green and Low‐Energy Transformation
by: Xiaochen Han, et al.
Published: (2025)

Differentially Private Contrastive Learning via Bounding Group-level Contribution
by: Li, Kecen, et al.
Published: (2026)