Cover Image

Bi-Orthogonal Factor Decomposition for Vision Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Doshi, Fenil R., Fel, Thomas, Konkle, Talia, Alvarez, George
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Visual Anagrams Reveal Hidden Differences in Holistic Shape Processing Across Vision Models
by: Doshi, Fenil R., et al.
Published: (2025)

Feature Accentuation: Revealing 'What' Features Respond to in Natural Images
by: Hamblin, Chris, et al.
Published: (2024)

Sparks of Explainability: Recent Advancements in Explaining Large Vision Models
by: Fel, Thomas
Published: (2025)

Into the Rabbit Hull: From Task-Relevant Concepts in DINO to Minkowski Geometry
by: Fel, Thomas, et al.
Published: (2025)

Block-Recurrent Dynamics in Vision Transformers
by: Jacobs, Mozes, et al.
Published: (2025)

Understanding Inhibition Through Maximally Tense Images
by: Hamblin, Chris, et al.
Published: (2024)

Orthogonal Quadratic Complements for Vision Transformer Feed-Forward Networks
by: Zixian, Wang
Published: (2026)

Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy
by: Yang, Yiting, et al.
Published: (2025)

FOVI: A biologically-inspired foveated interface for deep vision models
by: Blauch, Nicholas M., et al.
Published: (2026)

Understanding Visual Feature Reliance through the Lens of Complexity
by: Fel, Thomas, et al.
Published: (2024)

Archetypal SAE: Adaptive and Stable Dictionary Learning for Concept Extraction in Large Vision Models
by: Fel, Thomas, et al.
Published: (2025)

Back to the Baseline: Examining Baseline Effects on Explainability Metrics
by: Picard, Agustin Martin, et al.
Published: (2025)

Group Orthogonalization Regularization For Vision Models Adaptation and Robustness
by: Kurtz, Yoav, et al.
Published: (2023)

A Geometric Unification of Concept Learning with Concept Cones
by: Rocchi--Henry, Alexandre, et al.
Published: (2025)

Uncovering Conceptual Blindspots in Generative Image Models Using Sparse Autoencoders
by: Bohacek, Matyas, et al.
Published: (2025)

CLQ: Cross-Layer Guided Orthogonal-based Quantization for Diffusion Transformers
by: Liu, Kai, et al.
Published: (2025)

Visual IRL for Human-Like Robotic Manipulation
by: Asali, Ehsan, et al.
Published: (2024)

Beyond the Doors of Perception: Vision Transformers Represent Relations Between Objects
by: Lepori, Michael A., et al.
Published: (2024)

Interpreting Physics in Video World Models
by: Joseph, Sonia, et al.
Published: (2026)

Let's Roll a BiFTA: Bi-refinement for Fine-grained Text-visual Alignment in Vision-Language Models
by: Sun, Yuhao, et al.
Published: (2026)

Compressing Vision Transformers in Geospatial Transfer Learning with Manifold-Constrained Optimization
by: Snyder, Thomas, et al.
Published: (2026)

Benchmarking Unlearning for Vision Transformers
by: Zhao, Kairan, et al.
Published: (2026)

Vision Bridge Transformer at Scale
by: Tan, Zhenxiong, et al.
Published: (2025)

Saliency strikes back: How filtering out high frequencies improves white-box explanations
by: Muzellec, Sabine, et al.
Published: (2023)

Bridging the Rural Healthcare Gap: A Cascaded Edge-Cloud Architecture for Automated Retinal Screening
by: Doshi, Nishi, et al.
Published: (2026)

Weierstrass Positional Encoding for Vision Transformers
by: Xin, Zhihang, et al.
Published: (2026)

The Linear Attention Resurrection in Vision Transformer
by: Zheng, Chuanyang
Published: (2025)

Sensitive Image Classification by Vision Transformers
by: He, Hanxian, et al.
Published: (2024)

Spiking Vision Transformer with Saccadic Attention
by: Wang, Shuai, et al.
Published: (2025)

Sub-DM:Subspace Diffusion Model with Orthogonal Decomposition for MRI Reconstruction
by: Guan, Yu, et al.
Published: (2024)

Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation
by: Dong, Wei, et al.
Published: (2024)

DiffDecompose: Layer-Wise Decomposition of Alpha-Composited Images via Diffusion Transformers
by: Wang, Zitong, et al.
Published: (2025)

I Walk the Line: Examining the Role of Gestalt Continuity in Object Binding for Vision Transformers
by: Tartaglini, Alexa R., et al.
Published: (2026)

Vision-Language Introspection: Mitigating Overconfident Hallucinations in MLLMs via Interpretable Bi-Causal Steering
by: Liu, Shuliang, et al.
Published: (2026)

Attention Retention for Continual Learning with Vision Transformers
by: Lu, Yue, et al.
Published: (2026)

Accelerating Vision Transformers on Brain Processing Unit
by: Tang, Jinchi, et al.
Published: (2026)

Mixed Non-linear Quantization for Vision Transformers
by: Kim, Gihwan, et al.
Published: (2024)

Decoding Vision Transformers: the Diffusion Steering Lens
by: Takatsuki, Ryota, et al.
Published: (2025)

Vision Transformers Don't Need Trained Registers
by: Jiang, Nick, et al.
Published: (2025)

[Re] Improving Interpretation Faithfulness for Vision Transformers
by: Kurek, Izabela, et al.
Published: (2025)