LATTE: Low-Precision Approximate Attention with Head-wise Trainable Threshold for Efficient Transformer
Fuente:
arXiv
Saved in:
| Main Authors: | Wang, Jiing-Ping, Lin, Ming-Guang, An-Yeu, Wu |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Similar Items
RAVEN: Radar Adaptive Vision Encoders for Efficient Chirp-wise Object Detection and Segmentation
by: Sen, Anuvab, et al.
Published: (2026)
by: Sen, Anuvab, et al.
Published: (2026)
Hamming Attention Distillation: Binarizing Keys and Queries for Efficient Long-Context Transformers
by: Horton, Mark, et al.
Published: (2025)
by: Horton, Mark, et al.
Published: (2025)
Learning Binary Color Filter Arrays with Trainable Hard Thresholding
by: Ayna, Cemre Omer, et al.
Published: (2024)
by: Ayna, Cemre Omer, et al.
Published: (2024)
EHVC: Efficient Hierarchical Reference and Quality Structure for Neural Video Coding
by: Liao, Junqi, et al.
Published: (2025)
by: Liao, Junqi, et al.
Published: (2025)
Attention Incorporated Network for Sharing Low-rank, Image and K-space Information during MR Image Reconstruction to Achieve Single Breath-hold Cardiac Cine Imaging
by: Xu, Siying, et al.
Published: (2024)
by: Xu, Siying, et al.
Published: (2024)
Multimodal Neuroimaging Attention-Based architecture for Cognitive Decline Prediction
by: Vo, Jamie, et al.
Published: (2023)
by: Vo, Jamie, et al.
Published: (2023)
An Explainable Attention Model for Cervical Precancer Risk Classification using Colposcopic Images
by: Khare, Smith K., et al.
Published: (2024)
by: Khare, Smith K., et al.
Published: (2024)
MIDOG 2025: Mitotic Figure Detection with Attention-Guided False Positive Correction
by: Broad, Andrew, et al.
Published: (2025)
by: Broad, Andrew, et al.
Published: (2025)
PEANO-ViT: Power-Efficient Approximations of Non-Linearities in Vision Transformers
by: Sadeghi, Mohammad Erfan, et al.
Published: (2024)
by: Sadeghi, Mohammad Erfan, et al.
Published: (2024)
Beyond Data Scarcity Optimizing R3GAN for Medical Image Generation from Small Datasets
by: Pan, Tsung-Wei, et al.
Published: (2025)
by: Pan, Tsung-Wei, et al.
Published: (2025)
Brain Tumor Segmentation Based on Deep Learning, Attention Mechanisms, and Energy-Based Uncertainty Prediction
by: Schwehr, Zachary, et al.
Published: (2023)
by: Schwehr, Zachary, et al.
Published: (2023)
Neural Video Compression with In-Loop Contextual Filtering and Out-of-Loop Reconstruction Enhancement
by: Wu, Yaojun, et al.
Published: (2025)
by: Wu, Yaojun, et al.
Published: (2025)
PGSTalker: Real-Time Audio-Driven Talking Head Generation via 3D Gaussian Splatting with Pixel-Aware Density Control
by: Zhu, Tianheng, et al.
Published: (2025)
by: Zhu, Tianheng, et al.
Published: (2025)
Subject-Specific Low-Field MRI Synthesis via a Neural Operator
by: Gao, Ziqi, et al.
Published: (2026)
by: Gao, Ziqi, et al.
Published: (2026)
A Comprehensive Framework for Uncertainty Quantification of Voxel-wise Supervised Models in IVIM MRI
by: Casali, Nicola, et al.
Published: (2025)
by: Casali, Nicola, et al.
Published: (2025)
Simultaneous Deep Learning of Myocardium Segmentation and T2 Quantification for Acute Myocardial Infarction MRI
by: Zhou, Yirong, et al.
Published: (2024)
by: Zhou, Yirong, et al.
Published: (2024)
RN-Net: Reservoir Nodes-Enabled Neuromorphic Vision Sensing Network
by: Yoo, Sangmin, et al.
Published: (2023)
by: Yoo, Sangmin, et al.
Published: (2023)
Efficient Convolutional Forward Model for Passive Acoustic Mapping and Temporal Monitoring
by: Gelvez-Barrera, Tatiana, et al.
Published: (2026)
by: Gelvez-Barrera, Tatiana, et al.
Published: (2026)
Data-Efficient Point Cloud Semantic Segmentation Pipeline for Unimproved Roads
by: Yarovoi, Andrew, et al.
Published: (2025)
by: Yarovoi, Andrew, et al.
Published: (2025)
Vision Transformers for End-to-End Vision-Based Quadrotor Obstacle Avoidance
by: Bhattacharya, Anish, et al.
Published: (2024)
by: Bhattacharya, Anish, et al.
Published: (2024)
ReTiDe: Real-Time Denoising for Energy-Efficient Motion Picture Processing with FPGAs
by: Li, Changhong, et al.
Published: (2025)
by: Li, Changhong, et al.
Published: (2025)
A Scalable AI Driven, IoT Integrated Cognitive Digital Twin for Multi-Modal Neuro-Oncological Prognostics and Tumor Kinetics Prediction using Enhanced Vision Transformer and XAI
by: Banerjee, Saptarshi, et al.
Published: (2025)
by: Banerjee, Saptarshi, et al.
Published: (2025)
Recognizing Beam Profiles from Silicon Photonics Gratings using Transformer Model
by: Lim, Yu Dian, et al.
Published: (2024)
by: Lim, Yu Dian, et al.
Published: (2024)
Exploring Wavelet Transformations for Deep Learning-based Machine Condition Diagnosis
by: Piedad, Eduardo Jr, et al.
Published: (2024)
by: Piedad, Eduardo Jr, et al.
Published: (2024)
ODFormer: Semantic Fundus Image Segmentation Using Transformer for Optic Nerve Head Detection
by: Wang, Jiayi, et al.
Published: (2024)
by: Wang, Jiayi, et al.
Published: (2024)
NTIRE 2024 Challenge on Short-form UGC Video Quality Assessment: Methods and Results
by: Li, Xin, et al.
Published: (2024)
by: Li, Xin, et al.
Published: (2024)
An Inclusive Foundation Model for Generalizable Cytogenetics in Precision Oncology
by: Yang, Changchun, et al.
Published: (2025)
by: Yang, Changchun, et al.
Published: (2025)
ELFATT: Efficient Linear Fast Attention for Vision Transformers
by: Wu, Chong, et al.
Published: (2025)
by: Wu, Chong, et al.
Published: (2025)
Learning Modality-Aware Representations: Adaptive Group-wise Interaction Network for Multimodal MRI Synthesis
by: Song, Tao, et al.
Published: (2024)
by: Song, Tao, et al.
Published: (2024)
Deep Unfolded BM3D: Unrolling Non-local Collaborative Filtering into a Trainable Neural Network
by: Basim, Kerem, et al.
Published: (2025)
by: Basim, Kerem, et al.
Published: (2025)
CATFormer: When Continual Learning Meets Spiking Transformers With Dynamic Thresholds
by: Nagabhushana, Vaishnavi, et al.
Published: (2026)
by: Nagabhushana, Vaishnavi, et al.
Published: (2026)
Improving the Scan-rescan Precision of AI-based CMR Biomarker Estimation
by: Wickremasinghe, Dewmini Hasara, et al.
Published: (2024)
by: Wickremasinghe, Dewmini Hasara, et al.
Published: (2024)
FSSC: Federated Learning of Transformer Neural Networks for Semantic Image Communication
by: Yan, Yuna, et al.
Published: (2024)
by: Yan, Yuna, et al.
Published: (2024)
Transforming Precision: A Comparative Analysis of Vision Transformers, CNNs, and Traditional ML for Knee Osteoarthritis Severity Diagnosis
by: Apon, Tasnim Sakib, et al.
Published: (2024)
by: Apon, Tasnim Sakib, et al.
Published: (2024)
Efficient Bilinear Attention-based Fusion for Medical Visual Question Answering
by: Zhang, Zhilin, et al.
Published: (2024)
by: Zhang, Zhilin, et al.
Published: (2024)
Efficient Image Restoration via Latent Consistency Flow Matching
by: Cohen, Elad, et al.
Published: (2025)
by: Cohen, Elad, et al.
Published: (2025)
HAAT: Hybrid Attention Aggregation Transformer for Image Super-Resolution
by: Lai, Song-Jiang, et al.
Published: (2024)
by: Lai, Song-Jiang, et al.
Published: (2024)
Enhancing DR Classification with Swin Transformer and Shifted Window Attention
by: Boulaabi, Meher, et al.
Published: (2025)
by: Boulaabi, Meher, et al.
Published: (2025)
Introducing the Biomechanics-Function Relationship in Glaucoma: Improved Visual Field Loss Predictions from intraocular pressure-induced Neural Tissue Strains
by: Chuangsuwanich, Thanadet, et al.
Published: (2024)
by: Chuangsuwanich, Thanadet, et al.
Published: (2024)
Deep Learning Empowered Sub-Diffraction Terahertz Backpropagation Single-Pixel Imaging
by: Zhu, Yongsheng, et al.
Published: (2025)
by: Zhu, Yongsheng, et al.
Published: (2025)
Similar Items
-
RAVEN: Radar Adaptive Vision Encoders for Efficient Chirp-wise Object Detection and Segmentation
by: Sen, Anuvab, et al.
Published: (2026) -
Hamming Attention Distillation: Binarizing Keys and Queries for Efficient Long-Context Transformers
by: Horton, Mark, et al.
Published: (2025) -
Learning Binary Color Filter Arrays with Trainable Hard Thresholding
by: Ayna, Cemre Omer, et al.
Published: (2024) -
EHVC: Efficient Hierarchical Reference and Quality Structure for Neural Video Coding
by: Liao, Junqi, et al.
Published: (2025) -
Attention Incorporated Network for Sharing Low-rank, Image and K-space Information during MR Image Reconstruction to Achieve Single Breath-hold Cardiac Cine Imaging
by: Xu, Siying, et al.
Published: (2024)