Orthogonal Quadratic Complements for Vision Transformer Feed-Forward Networks

Fuente: arXiv

Saved in:

Bibliographic Details
Main Author:	Zixian, Wang
Format:	Preprint
Published:	2026
Subjects:	Computer Vision and Pattern Recognition Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

CascadedViT: Cascaded Chunk-FeedForward and Cascaded Group Attention Vision Transformer
by: Sivakumar, Srivathsan, et al.
Published: (2025)

Precise, Fast, and Low-cost Concept Erasure in Value Space: Orthogonal Complement Matters
by: Wang, Yuan, et al.
Published: (2024)

Bi-Orthogonal Factor Decomposition for Vision Transformers
by: Doshi, Fenil R., et al.
Published: (2026)

You Only Judge Once: Multi-response Reward Modeling in a Single Forward Pass
by: Yang, Yinuo, et al.
Published: (2026)

Efficient Adaptation of Pre-trained Vision Transformer underpinned by Approximately Orthogonal Fine-Tuning Strategy
by: Yang, Yiting, et al.
Published: (2025)

Particulate: Feed-Forward 3D Object Articulation
by: Li, Ruining, et al.
Published: (2025)

AREA3D: Active Reconstruction Agent with Unified Feed-Forward 3D Perception and Vision-Language Guidance
by: Xu, Tianling, et al.
Published: (2025)

DenoiseSplat: Feed-Forward Gaussian Splatting for Noisy 3D Scene Reconstruction
by: Jiang, Fuzhen, et al.
Published: (2026)

Feed-Forward 3D Scene Modeling: A Problem-Driven Perspective
by: Wang, Weijie, et al.
Published: (2026)

Training Convolutional Neural Networks with the Forward-Forward algorithm
by: Scodellaro, Riccardo, et al.
Published: (2023)

Group Orthogonalization Regularization For Vision Models Adaptation and Robustness
by: Kurtz, Yoav, et al.
Published: (2023)

Feed-Forward Bullet-Time Reconstruction of Dynamic Scenes from Monocular Videos
by: Liang, Hanxue, et al.
Published: (2024)

Resource-efficient Medical Image Analysis with Self-adapting Forward-Forward Networks
by: Müller, Johanna P., et al.
Published: (2024)

Learning to Complement and to Defer to Multiple Users
by: Zhang, Zheng, et al.
Published: (2024)

Enhancing Breast Cancer Detection with Vision Transformers and Graph Neural Networks
by: Cai, Yeming, et al.
Published: (2025)

Concept Complement Bottleneck Model for Interpretable Medical Image Diagnosis
by: Wang, Hongmei, et al.
Published: (2024)

ArtSplat: Feed-Forward Articulated 3D Gaussian Splatting from Sparse Multi-State Uncalibrated Views
by: Lee, Inseo, et al.
Published: (2026)

ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
by: Wei, Guoyizhe, et al.
Published: (2025)

Vision Bridge Transformer at Scale
by: Tan, Zhenxiong, et al.
Published: (2025)

CLQ: Cross-Layer Guided Orthogonal-based Quantization for Diffusion Transformers
by: Liu, Kai, et al.
Published: (2025)

GeoDecoder: Empowering Multimodal Map Understanding
by: Qi, Feng, et al.
Published: (2024)

FPRF: Feed-Forward Photorealistic Style Transfer of Large-Scale 3D Neural Radiance Fields
by: Kim, GeonU, et al.
Published: (2024)

AT-SNN: Adaptive Tokens for Vision Transformer on Spiking Neural Network
by: Kang, Donghwa, et al.
Published: (2024)

VFIG: Vectorizing Complex Figures in SVG with Vision-Language Models
by: He, Qijia, et al.
Published: (2026)

Hierarchical Vision Transformer Enhanced by Graph Convolutional Network for Image Classification
by: Jiao, Haibin
Published: (2026)

ProVision: Programmatically Scaling Vision-centric Instruction Data for Multimodal Language Models
by: Zhang, Jieyu, et al.
Published: (2024)

Weierstrass Positional Encoding for Vision Transformers
by: Xin, Zhihang, et al.
Published: (2026)

Efficient Feature-Free Initialization for Monocular Visual-Inertial Systems Using a Feed-Forward 3D Model
by: Zhang, Yuantai, et al.
Published: (2026)

MapAnything: Universal Feed-Forward Metric 3D Reconstruction
by: Keetha, Nikhil, et al.
Published: (2025)

Revisiting Residual Connections: Orthogonal Updates for Stable and Efficient Deep Networks
by: Oh, Giyeong, et al.
Published: (2025)

RePaViT: Scalable Vision Transformer Acceleration via Structural Reparameterization on Feedforward Network Layers
by: Xu, Xuwei, et al.
Published: (2025)

IoT Botnet Detection: Application of Vision Transformer to Classification of Network Flow Traffic
by: Wasswa, Hassan, et al.
Published: (2025)

Spiking Vision Transformer with Saccadic Attention
by: Wang, Shuai, et al.
Published: (2025)

Efficient Adaptation of Pre-trained Vision Transformer via Householder Transformation
by: Dong, Wei, et al.
Published: (2024)

Benchmarking Unlearning for Vision Transformers
by: Zhao, Kairan, et al.
Published: (2026)

Any4D: Unified Feed-Forward Metric 4D Reconstruction
by: Karhade, Jay, et al.
Published: (2025)

Multi-Level Heterogeneous Knowledge Transfer Network on Forward Scattering Center Model for Limited Samples SAR ATR
by: Zhao, Chenxi, et al.
Published: (2025)

Can Cross-Layer Transcoders Replace Vision Transformer Activations? An Interpretable Perspective on Vision
by: Chatzoudis, Gerasimos, et al.
Published: (2026)

TinyDrop: Tiny Model Guided Token Dropping for Vision Transformers
by: Wang, Guoxin, et al.
Published: (2025)

MRI Embeddings Complement Clinical Predictors for Cognitive Decline Modeling in Alzheimer's Disease Cohorts
by: Putera, Nathaniel, et al.
Published: (2025)