Cover Image

Enhancing Transformers Through Conditioned Embedded Tokens

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Saratchandran, Hemanth, Lucey, Simon
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Weight Conditioning for Smooth Optimization of Neural Networks
by: Saratchandran, Hemanth, et al.
Published: (2024)

Leaner Transformers: More Heads, Less Depth
by: Saratchandran, Hemanth, et al.
Published: (2025)

Structured Initialization for Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2025)

SineProject: Machine Unlearning for Stable Vision Language Alignment
by: Garg, Arpit, et al.
Published: (2025)

From Activation to Initialization: Scaling Insights for Optimizing Neural Fields
by: Saratchandran, Hemanth, et al.
Published: (2024)

Preconditioners for the Stochastic Training of Neural Fields
by: Chng, Shin-Fang, et al.
Published: (2024)

Mask the Target: A Plug-and-Play Regularizer Against LoRA Forgetting
by: Xu, Runze, et al.
Published: (2026)

Rethinking Attention: Polynomial Alternatives to Softmax in Transformers
by: Saratchandran, Hemanth, et al.
Published: (2024)

Invertible Neural Warp for NeRF
by: Chng, Shin-Fang, et al.
Published: (2024)

Always Skip Attention
by: Ji, Yiping, et al.
Published: (2025)

From Tables to Signals: Revealing Spectral Adaptivity in TabPFN
by: Zheng, Jianqiao, et al.
Published: (2025)

D'OH: Decoder-Only Random Hypernetworks for Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2024)

Efficient Learning With Sine-Activated Low-rank Matrices
by: Ji, Yiping, et al.
Published: (2024)

Spectral Conditioning of Attention Improves Transformer Performance
by: Saratchandran, Hemanth, et al.
Published: (2026)

Can You Learn to See Without Images? Procedural Warm-Up for Vision Transformers
by: Shinnick, Zachary, et al.
Published: (2025)

Structured Initialization for Attention in Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2024)

Convolutional Initialization for Data-Efficient Vision Transformers
by: Zheng, Jianqiao, et al.
Published: (2024)

Gradient Descent as a Shrinkage Operator for Spectral Bias
by: Lucey, Simon
Published: (2025)

Fast Kernel Scene Flow
by: Li, Xueqian, et al.
Published: (2024)

Towards Higher Effective Rank in Parameter-efficient Fine-tuning using Khatri--Rao Product
by: Albert, Paul, et al.
Published: (2025)

3D Gaussian Point Encoders
by: James, Jim, et al.
Published: (2025)

SMORE: Simultaneous Map and Object REconstruction
by: Chodosh, Nathaniel, et al.
Published: (2024)

Trading Positional Complexity vs. Deepness in Coordinate Networks
by: Zheng, Jianqiao, et al.
Published: (2022)

Label Smoothing++: Enhanced Label Regularization for Training Neural Networks
by: Chhabra, Sachin, et al.
Published: (2025)

Rethinking the Role of Spatial Mixing
by: Cazenavette, George, et al.
Published: (2025)

A Hidden Semantic Bottleneck in Conditional Embeddings of Diffusion Transformers
by: Pham, Trung X., et al.
Published: (2026)

RandLoRA: Full-rank parameter-efficient fine-tuning of large models
by: Albert, Paul, et al.
Published: (2025)

Context-Aware Token Selection and Packing for Enhanced Vision Transformer
by: Zhang, Tianyi, et al.
Published: (2024)

On Quantizing Implicit Neural Representations
by: Gordon, Cameron, et al.
Published: (2022)

Multi-Body Neural Scene Flow
by: Vidanapathirana, Kavisha, et al.
Published: (2023)

Robust Physical Adversarial Patches Using Dynamically Optimized Clusters
by: Bagley, Harrison, et al.
Published: (2025)

SeMoLi: What Moves Together Belongs Together
by: Seidenschwarz, Jenny, et al.
Published: (2024)

Learning to Merge Tokens via Decoupled Embedding for Efficient Vision Transformers
by: Lee, Dong Hoon, et al.
Published: (2024)

Class-Conditioned Transformation for Enhanced Robust Image Classification
by: Blau, Tsachi, et al.
Published: (2023)

Dataset Augmentation by Mixing Visual Concepts
by: Rahat, Abdullah Al, et al.
Published: (2024)

Token Transforming: A Unified and Training-Free Token Compression Framework for Vision Transformer Acceleration
by: Zeng, Fanhu, et al.
Published: (2025)

Magic-MM-Embedding: Towards Visual-Token-Efficient Universal Multimodal Embedding with MLLMs
by: Li, Qi, et al.
Published: (2026)

Reg4Pru: Regularisation Through Random Token Routing for Token Pruning
by: Wyatt, Julian, et al.
Published: (2026)

Visual-Word Tokenizer: Beyond Fixed Sets of Tokens in Vision Transformers
by: Gee, Leonidas, et al.
Published: (2024)

Superpixel Tokenization for Vision Transformers: Preserving Semantic Integrity in Visual Tokens
by: Lew, Jaihyun, et al.
Published: (2024)