Copertina

Communication Efficient Split Learning of ViTs with Attention-based Double Compression

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Alvetreti, Federico, Pomponi, Jary, Di Lorenzo, Paolo, Scardapane, Simone
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Artificial Intelligence Computer Vision and Pattern Recognition
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Adaptive Layer Selection for Efficient Vision Transformer Fine-Tuning
di: Devoto, Alessio, et al.
Pubblicazione: (2024)

Purrturbed but Stable: Human-Cat Invariant Representations Across CNNs, ViTs and Self-Supervised ViTs
di: Shah, Arya, et al.
Pubblicazione: (2025)

Class incremental learning with probability dampening and cascaded gated classifier
di: Pomponi, Jary, et al.
Pubblicazione: (2024)

CLAMP-ViT: Contrastive Data-Free Learning for Adaptive Post-Training Quantization of ViTs
di: Ramachandran, Akshat, et al.
Pubblicazione: (2024)

VIVID-Med: LLM-Supervised Structured Pretraining for Deployable Medical ViTs
di: Wang, Xiyao, et al.
Pubblicazione: (2026)

Training-Free Acceleration of ViTs with Delayed Spatial Merging
di: Heo, Jung Hwan, et al.
Pubblicazione: (2023)

Octic Vision Transformers: Quicker ViTs Through Equivariance
di: Nordström, David, et al.
Pubblicazione: (2025)

ViTs are Everywhere: A Comprehensive Study Showcasing Vision Transformers in Different Domain
di: Mia, Md Sohag, et al.
Pubblicazione: (2023)

ConcatPlexer: Additional Dim1 Batching for Faster ViTs
di: Han, Donghoon, et al.
Pubblicazione: (2023)

TAP-ViTs: Task-Adaptive Pruning for On-Device Deployment of Vision Transformers
di: Wang, Zhibo, et al.
Pubblicazione: (2026)

Adaptive Semantic Token Selection for AI-native Goal-oriented Communications
di: Devoto, Alessio, et al.
Pubblicazione: (2024)

NACHOS: Neural Architecture Search for Hardware Constrained Early Exit Neural Networks
di: Gambella, Matteo, et al.
Pubblicazione: (2024)

Concept-Guided Fine-Tuning: Steering ViTs away from Spurious Correlations to Improve Robustness
di: Elisha, Yehonatan, et al.
Pubblicazione: (2026)

GTP-ViT: Efficient Vision Transformers via Graph-based Token Propagation
di: Xu, Xuwei, et al.
Pubblicazione: (2023)

AFIDAF: Alternating Fourier and Image Domain Adaptive Filters as an Efficient Alternative to Attention in ViTs
di: Zheng, Yunling, et al.
Pubblicazione: (2024)

ViT-Lens: Towards Omni-modal Representations
di: Lei, Weixian, et al.
Pubblicazione: (2023)

LF-ViT: Reducing Spatial Redundancy in Vision Transformer for Efficient Image Recognition
di: Hu, Youbing, et al.
Pubblicazione: (2024)

An Intermediate Fusion ViT Enables Efficient Text-Image Alignment in Diffusion Models
di: Hu, Zizhao, et al.
Pubblicazione: (2024)

I&S-ViT: An Inclusive & Stable Method for Pushing the Limit of Post-Training ViTs Quantization
di: Zhong, Yunshan, et al.
Pubblicazione: (2023)

Trio-ViT: Post-Training Quantization and Acceleration for Softmax-Free Efficient Vision Transformer
di: Shi, Huihong, et al.
Pubblicazione: (2024)

HydraViT: Stacking Heads for a Scalable ViT
di: Haberer, Janek, et al.
Pubblicazione: (2024)

SFMViT: SlowFast Meet ViT in Chaotic World
di: Lin, Jiaying, et al.
Pubblicazione: (2024)

MMeViT: Multi-Modal ensemble ViT for Post-Stroke Rehabilitation Action Recognition
di: Kim, Ye-eun, et al.
Pubblicazione: (2025)

H-CNN-ViT: A Hierarchical Gated Attention Multi-Branch Model for Bladder Cancer Recurrence Prediction
di: Li, Xueyang, et al.
Pubblicazione: (2025)

Tiny-ViT: A Compact Vision Transformer for Efficient and Explainable Potato Leaf Disease Classification
di: Mia, Shakil, et al.
Pubblicazione: (2026)

Sub-token ViT Embedding via Stochastic Resonance Transformers
di: Lao, Dong, et al.
Pubblicazione: (2023)

SAC-ViT: Semantic-Aware Clustering Vision Transformer with Early Exit
di: Hu, Youbing, et al.
Pubblicazione: (2025)

Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection
di: Aubard, Martin, et al.
Pubblicazione: (2024)

Hybrid CNN-ViT Framework for Motion-Blurred Scene Text Restoration
di: Rashid, Umar, et al.
Pubblicazione: (2025)

ViT-Linearizer: Distilling Quadratic Knowledge into Linear-Time Vision Models
di: Wei, Guoyizhe, et al.
Pubblicazione: (2025)

U-REPA: Aligning Diffusion U-Nets to ViTs
di: Tian, Yuchuan, et al.
Pubblicazione: (2025)

Elastic ViTs from Pretrained Models without Retraining
di: Simoncini, Walter, et al.
Pubblicazione: (2025)

Harnessing the Computation Redundancy in ViTs to Boost Adversarial Transferability
di: Liu, Jiani, et al.
Pubblicazione: (2025)

Pretrained ViTs Yield Versatile Representations For Medical Images
di: Matsoukas, Christos, et al.
Pubblicazione: (2023)

STRAP-ViT: Segregated Tokens with Randomized -- Transformations for Defense against Adversarial Patches in ViTs
di: Chattopadhyay, Nandish, et al.
Pubblicazione: (2026)

Case-Enhanced Vision Transformer: Improving Explanations of Image Similarity with a ViT-based Similarity Metric
di: Zhao, Ziwei, et al.
Pubblicazione: (2024)

Parameter Efficient Fine-tuning of Self-supervised ViTs without Catastrophic Forgetting
di: Bafghi, Reza Akbarian, et al.
Pubblicazione: (2024)

CNN-ViT Fusion with Adaptive Attention Gate for Brain Tumor MRI Classification: A Hybrid Deep Learning Model
di: Hasnain, Syed Ibad, et al.
Pubblicazione: (2026)

PEANO-ViT: Power-Efficient Approximations of Non-Linearities in Vision Transformers
di: Sadeghi, Mohammad Erfan, et al.
Pubblicazione: (2024)

Filtered-ViT: A Robust Defense Against Multiple Adversarial Patch Attacks
di: Khanal, Aja, et al.
Pubblicazione: (2025)