Copertina

Activator: GLU Activation Function as the Core Component of a Vision Transformer

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Abdullah, Abdullah Nazhat, Aydin, Tarkan
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

NiNformer: A Network in Network Transformer with Token Mixing Generated Gating Function
di: Abdullah, Abdullah Nazhat, et al.
Pubblicazione: (2024)

LoLA-SpecViT: Local Attention SwiGLU Vision Transformer with LoRA for Hyperspectral Imaging
di: Zidi, Fadi Abdeladhim, et al.
Pubblicazione: (2025)

ADFQ-ViT: Activation-Distribution-Friendly Post-Training Quantization for Vision Transformers
di: Jiang, Yanfeng, et al.
Pubblicazione: (2024)

ABFR-KAN: Kolmogorov-Arnold Networks for Functional Brain Analysis
di: Ward, Tyler, et al.
Pubblicazione: (2026)

Trainable Highly-expressive Activation Functions
di: Chelly, Irit, et al.
Pubblicazione: (2024)

Can Cross-Layer Transcoders Replace Vision Transformer Activations? An Interpretable Perspective on Vision
di: Chatzoudis, Gerasimos, et al.
Pubblicazione: (2026)

Steering Video Diffusion Transformers with Massive Activations
di: Cheng, Xianhang, et al.
Pubblicazione: (2026)

Layout Anything: One Transformer for Universal Room Layout Estimation
di: Mia, Md Sohag, et al.
Pubblicazione: (2025)

MixA-Q: Revisiting Activation Sparsity for Vision Transformers from a Mixed-Precision Quantization Perspective
di: Wang, Weitian, et al.
Pubblicazione: (2025)

L-SWAG: Layer-Sample Wise Activation with Gradients information for Zero-Shot NAS on Vision Transformers
di: Casarin, Sofia, et al.
Pubblicazione: (2025)

TAP into the Patch Tokens: Leveraging Vision Foundation Model Features for AI-Generated Image Detection
di: Abdullah, Ahmed, et al.
Pubblicazione: (2026)

Prompting Medical Vision-Language Models to Mitigate Diagnosis Bias by Generating Realistic Dermoscopic Images
di: Munia, Nusrat, et al.
Pubblicazione: (2025)

Improving Brain Disorder Diagnosis with Advanced Brain Function Representation and Kolmogorov-Arnold Networks
di: Ward, Tyler, et al.
Pubblicazione: (2025)

Vision-Centric Activation and Coordination for Multimodal Large Language Models
di: Wang, Yunnan, et al.
Pubblicazione: (2025)

Adaptive Parametric Activation: Unifying and Generalising Activation Functions Across Tasks
di: Alexandridis, Konstantinos Panagiotis, et al.
Pubblicazione: (2024)

MDE-VIO: Enhancing Visual-Inertial Odometry Using Learned Depth Priors
di: Alniak, Arda, et al.
Pubblicazione: (2026)

Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activations
di: Gan, Chaofan, et al.
Pubblicazione: (2025)

Massive Activations are the Key to Local Detail Synthesis in Diffusion Transformers
di: Gan, Chaofan, et al.
Pubblicazione: (2025)

EVCC: Enhanced Vision Transformer-ConvNeXt-CoAtNet Fusion for Classification
di: Hasan, Kazi Reyazul, et al.
Pubblicazione: (2025)

Evaluating Model Performance with Hard-Swish Activation Function Adjustments
di: Pydimarry, Sai Abhinav, et al.
Pubblicazione: (2024)

STAF: Sinusoidal Trainable Activation Functions for Implicit Neural Representation
di: Morsali, Alireza, et al.
Pubblicazione: (2025)

Pix4Point: Image Pretrained Standard Transformers for 3D Point Cloud Understanding
di: Qian, Guocheng, et al.
Pubblicazione: (2022)

DiTAS: Quantizing Diffusion Transformers via Enhanced Activation Smoothing
di: Dong, Zhenyuan, et al.
Pubblicazione: (2024)

VISIONLOGIC: From Neuron Activations to Causally Grounded Concept Rules for Vision Models
di: Geng, Chuqin, et al.
Pubblicazione: (2025)

A Probabilistic Segment Anything Model for Ambiguity-Aware Medical Image Segmentation
di: Ward, Tyler, et al.
Pubblicazione: (2025)

DArFace: Deformation Aware Robustness for Low Quality Face Recognition
di: Gulshad, Sadaf, et al.
Pubblicazione: (2025)

Class-N-Diff: Classification-Induced Diffusion Model Can Make Fair Skin Cancer Diagnosis
di: Munia, Nusrat, et al.
Pubblicazione: (2025)

FINER++: Building a Family of Variable-periodic Functions for Activating Implicit Neural Representation
di: Zhu, Hao, et al.
Pubblicazione: (2024)

Ask Me Again Differently: GRAS for Measuring Bias in Vision Language Models on Gender, Race, Age, and Skin Tone
di: Malik, Shaivi, et al.
Pubblicazione: (2025)

VisionTrap: Unanswerable Questions On Visual Data
di: Saadat, Asir, et al.
Pubblicazione: (2025)

SpaAct: Spatially-Activated Transition Learning with Curriculum Adaptation for Vision-Language Navigation
di: Li, Pengna, et al.
Pubblicazione: (2026)

Activation Quantization of Vision Encoders Needs Prefixing Registers
di: Kim, Seunghyeon, et al.
Pubblicazione: (2025)

Skin Lesion Classification Using a Soft Voting Ensemble of Convolutional Neural Networks
di: Shafi, Abdullah Al, et al.
Pubblicazione: (2025)

Memory-Efficient Vision Transformers: An Activation-Aware Mixed-Rank Compression Strategy
di: Azizi, Seyedarmin, et al.
Pubblicazione: (2024)

GraphFusion3D: Dynamic Graph Attention Convolution with Adaptive Cross-Modal Transformer for 3D Object Detection
di: Mia, Md Sohag, et al.
Pubblicazione: (2025)

ConMamba: Contrastive Vision Mamba for Plant Disease Detection
di: Mamun, Abdullah Al, et al.
Pubblicazione: (2025)

YoloTag: Vision-based Robust UAV Navigation with Fiducial Markers
di: Raxit, Sourav, et al.
Pubblicazione: (2024)

GenFormer -- Generated Images are All You Need to Improve Robustness of Transformers on Small Datasets
di: Oehri, Sven, et al.
Pubblicazione: (2024)

PSMamba: Progressive Self-supervised Vision Mamba for Plant Disease Recognition
di: Mamun, Abdullah Al, et al.
Pubblicazione: (2025)

Activating Distributed Visual Region within LLMs for Efficient and Effective Vision-Language Training and Inference
di: Wang, Siyuan, et al.
Pubblicazione: (2024)