Imagen de Portada

CAT: Circular-Convolutional Attention for Sub-Quadratic Transformers

Fuente: arXiv

Guardado en:

Detalles Bibliográficos
Autor principal:	Yamada, Yoshihiro
Formato:	Preprint
Publicado:	2025
Materias:	Machine Learning Computation and Language Computer Vision and Pattern Recognition
Acceso en línea:	Acceder al recurso
Etiquetas:	Agregar Etiqueta Sin Etiquetas, Sea el primero en etiquetar este registro!

Ejemplares similares

Transformer with Controlled Attention for Synchronous Motion Captioning
por: Radouane, Karim, et al.
Publicado: (2024)

Head Pursuit: Probing Attention Specialization in Multimodal Transformers
por: Basile, Lorenzo, et al.
Publicado: (2025)

A Training-free Sub-quadratic Cost Transformer Model Serving Framework With Hierarchically Pruned Attention
por: Lee, Heejun, et al.
Publicado: (2024)

When are Lemons Purple? The Concept Association Bias of Vision-Language Models
por: Yamada, Yutaro, et al.
Publicado: (2022)

Reinforced Attention Learning
por: Li, Bangzheng, et al.
Publicado: (2026)

Spectral Norm of Convolutional Layers with Circular and Zero Paddings
por: Delattre, Blaise, et al.
Publicado: (2024)

Listen Then See: Video Alignment with Speaker Attention
por: Agrawal, Aviral, et al.
Publicado: (2024)

AttnLRP: Attention-Aware Layer-Wise Relevance Propagation for Transformers
por: Achtibat, Reduan, et al.
Publicado: (2024)

Transformer-VQ: Linear-Time Transformers via Vector Quantization
por: Lingle, Lucas D.
Publicado: (2023)

Convolutional Rectangular Attention Module
por: Nguyen, Hai-Vy, et al.
Publicado: (2025)

General Transform: A Unified Framework for Adaptive Transform to Enhance Representations
por: Budiutama, Gekko, et al.
Publicado: (2025)

The ART of Composition: Attention-Regularized Training for Compositional Visual Grounding
por: Luo, Jiayun, et al.
Publicado: (2024)

A Survey on Transformer Compression
por: Tang, Yehui, et al.
Publicado: (2024)

Towards Better Multi-head Attention via Channel-wise Sample Permutation
por: Yuan, Shen, et al.
Publicado: (2024)

ChartGaze: Enhancing Chart Understanding in LVLMs with Eye-Tracking Guided Attention Refinement
por: Salamatian, Ali, et al.
Publicado: (2025)

Exploring Attention Mechanisms in Integration of Multi-Modal Information for Sign Language Recognition and Translation
por: Hakim, Zaber Ibn Abdul, et al.
Publicado: (2023)

MatFormer: Nested Transformer for Elastic Inference
por: Devvrit, et al.
Publicado: (2023)

A Language Anchor-Guided Method for Robust Noisy Domain Generalization
por: Dai, Zilin, et al.
Publicado: (2025)

Breaking through the learning plateaus of in-context learning in Transformer
por: Fu, Jingwen, et al.
Publicado: (2023)

HATFormer: Historic Handwritten Arabic Text Recognition with Transformers
por: Chan, Adrian, et al.
Publicado: (2024)

Matryoshka Query Transformer for Large Vision-Language Models
por: Hu, Wenbo, et al.
Publicado: (2024)

Efficient Scaling of Diffusion Transformers for Text-to-Image Generation
por: Li, Hao, et al.
Publicado: (2024)

A U-Net and Transformer Pipeline for Multilingual Image Translation
por: Sahay, Siddharth, et al.
Publicado: (2025)

Words in Motion: Extracting Interpretable Control Vectors for Motion Transformers
por: Tas, Omer Sahin, et al.
Publicado: (2024)

SOLO: A Single Transformer for Scalable Vision-Language Modeling
por: Chen, Yangyi, et al.
Publicado: (2024)

Text Role Classification in Scientific Charts Using Multimodal Transformers
por: Kim, Hye Jin, et al.
Publicado: (2024)

DNT: a Deeply Normalized Transformer that can be trained by Momentum SGD
por: Qi, Xianbiao, et al.
Publicado: (2025)

Sparse-IFT: Sparse Iso-FLOP Transformations for Maximizing Training Efficiency
por: Thangarasa, Vithursan, et al.
Publicado: (2023)

White-Box Transformers via Sparse Rate Reduction: Compression Is All There Is?
por: Yu, Yaodong, et al.
Publicado: (2023)

GIT-CXR: End-to-End Transformer for Chest X-Ray Report Generation
por: Sîrbu, Iustin, et al.
Publicado: (2025)

DeepCoT: Deep Continual Transformers for Real-Time Inference on Data Streams
por: Picón, Ginés Carreto, et al.
Publicado: (2025)

RadZero: Similarity-Based Cross-Attention for Explainable Vision-Language Alignment in Chest X-ray with Zero-Shot Multi-Task Capability
por: Park, Jonggwon, et al.
Publicado: (2025)

TWEO: Transformers Without Extreme Outliers Enables FP8 Training And Quantization For Dummies
por: Liang, Guang, et al.
Publicado: (2025)

Brazilian Portuguese Image Captioning with Transformers: A Study on Cross-Native-Translated Dataset
por: Bromonschenkel, Gabriel, et al.
Publicado: (2026)

Elliptical Attention
por: Nielsen, Stefan K., et al.
Publicado: (2024)

Translution: Unifying Self-attention and Convolution for Adaptive and Relative Modeling
por: Fan, Hehe, et al.
Publicado: (2025)

SegSub: Evaluating Robustness to Knowledge Conflicts and Hallucinations in Vision-Language Models
por: Carragher, Peter, et al.
Publicado: (2025)

Cross-modal RAG: Sub-dimensional Text-to-Image Retrieval-Augmented Generation
por: Zhu, Mengdan, et al.
Publicado: (2025)

AsCAN: Asymmetric Convolution-Attention Networks for Efficient Recognition and Generation
por: Kag, Anil, et al.
Publicado: (2024)

Sign Lock-In: Randomly Initialized Weight Signs Persist and Bottleneck Sub-Bit Model Compression
por: Sakai, Akira, et al.
Publicado: (2026)