Designing Parameter and Compute Efficient Diffusion Transformers using Distillation
Fuente:
arXiv
Guardado en:
| Autor principal: | Sundaresha, Vignesh |
|---|---|
| Formato: | Preprint |
| Publicado: |
2025
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
Ejemplares similares
Taming Diffusion Transformer for Efficient Mobile Video Generation in Seconds
por: Wu, Yushu, et al.
Publicado: (2025)
por: Wu, Yushu, et al.
Publicado: (2025)
DiT-IC: Aligned Diffusion Transformer for Efficient Image Compression
por: Shi, Junqi, et al.
Publicado: (2026)
por: Shi, Junqi, et al.
Publicado: (2026)
SALT: Parameter-Efficient Fine-Tuning via Singular Value Adaptation with Low-Rank Transformation
por: Elsayed, Abdelrahman, et al.
Publicado: (2025)
por: Elsayed, Abdelrahman, et al.
Publicado: (2025)
TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
por: Liu, Ruiping, et al.
Publicado: (2022)
por: Liu, Ruiping, et al.
Publicado: (2022)
Multi-Objective Pareto-Front Optimization for Efficient Adaptive VVC Streaming
por: Katsenou, Angeliki, et al.
Publicado: (2026)
por: Katsenou, Angeliki, et al.
Publicado: (2026)
AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation
por: Xie, Rui, et al.
Publicado: (2024)
por: Xie, Rui, et al.
Publicado: (2024)
TransUKAN:Computing-Efficient Hybrid KAN-Transformer for Enhanced Medical Image Segmentation
por: Wu, Yanlin, et al.
Publicado: (2024)
por: Wu, Yanlin, et al.
Publicado: (2024)
One-Step Diffusion-Based Image Compression with Semantic Distillation
por: Xue, Naifu, et al.
Publicado: (2025)
por: Xue, Naifu, et al.
Publicado: (2025)
DiffSegLung: Diffusion Radiomic Distillation for Unsupervised Lung Pathology Segmentation
por: Khiati, Rezkellah Noureddine, et al.
Publicado: (2026)
por: Khiati, Rezkellah Noureddine, et al.
Publicado: (2026)
Accelerating Diffusion for SAR-to-Optical Image Translation via Adversarial Consistency Distillation
por: Bai, Xinyu, et al.
Publicado: (2024)
por: Bai, Xinyu, et al.
Publicado: (2024)
Co-learning Single-Step Diffusion Upsampler and Downsampler with Two Discriminators and Distillation
por: Kim, Sohwi, et al.
Publicado: (2024)
por: Kim, Sohwi, et al.
Publicado: (2024)
Efficient Star Distillation Attention Network for Lightweight Image Super-Resolution
por: Hao, Fangwei, et al.
Publicado: (2025)
por: Hao, Fangwei, et al.
Publicado: (2025)
Large Kernel Distillation Network for Efficient Single Image Super-Resolution
por: Xie, Chengxing, et al.
Publicado: (2024)
por: Xie, Chengxing, et al.
Publicado: (2024)
On Reducing Activity with Distillation and Regularization for Energy Efficient Spiking Neural Networks
por: Louis, Thomas, et al.
Publicado: (2024)
por: Louis, Thomas, et al.
Publicado: (2024)
Real World Federated Learning with a Knowledge Distilled Transformer for Cardiac CT Imaging
por: Tölle, Malte, et al.
Publicado: (2024)
por: Tölle, Malte, et al.
Publicado: (2024)
Swift Parameter-free Attention Network for Efficient Super-Resolution
por: Wan, Cheng, et al.
Publicado: (2023)
por: Wan, Cheng, et al.
Publicado: (2023)
Face to Cartoon Incremental Super-Resolution using Knowledge Distillation
por: Devkatte, Trinetra, et al.
Publicado: (2024)
por: Devkatte, Trinetra, et al.
Publicado: (2024)
HDKD: Hybrid Data-Efficient Knowledge Distillation Network for Medical Image Classification
por: EL-Assiouti, Omar S., et al.
Publicado: (2024)
por: EL-Assiouti, Omar S., et al.
Publicado: (2024)
MedDet: Generative Adversarial Distillation for Efficient Cervical Disc Herniation Detection
por: Zhang, Zeyu, et al.
Publicado: (2024)
por: Zhang, Zeyu, et al.
Publicado: (2024)
Pupil Design for Computational Wavefront Estimation
por: Almuallem, Ali, et al.
Publicado: (2026)
por: Almuallem, Ali, et al.
Publicado: (2026)
Parameter Efficient Fine Tuning for Multi-scanner PET to PET Reconstruction
por: Kim, Yumin, et al.
Publicado: (2024)
por: Kim, Yumin, et al.
Publicado: (2024)
Multi-Task Multi-Scale Contrastive Knowledge Distillation for Efficient Medical Image Segmentation
por: Biswas, Risab
Publicado: (2024)
por: Biswas, Risab
Publicado: (2024)
Comparative Analysis of Diffusion Generative Models in Computational Pathology
por: Thakkar, Denisha, et al.
Publicado: (2024)
por: Thakkar, Denisha, et al.
Publicado: (2024)
Highly Constrained Coded Aperture Imaging Systems Design Via a Knowledge Distillation Approach
por: Suarez-Rodriguez, Leon, et al.
Publicado: (2024)
por: Suarez-Rodriguez, Leon, et al.
Publicado: (2024)
UniUltra: Interactive Parameter-Efficient SAM2 for Universal Ultrasound Segmentation
por: Li, Yue, et al.
Publicado: (2025)
por: Li, Yue, et al.
Publicado: (2025)
U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpening
por: Kim, Sungpyo, et al.
Publicado: (2024)
por: Kim, Sungpyo, et al.
Publicado: (2024)
Efficient Visual Computing with Camera RAW Snapshots
por: Li, Zhihao, et al.
Publicado: (2022)
por: Li, Zhihao, et al.
Publicado: (2022)
Taming Stable Diffusion for Computed Tomography Blind Super-Resolution
por: Li, Chunlei, et al.
Publicado: (2025)
por: Li, Chunlei, et al.
Publicado: (2025)
Semantically-Aware Game Image Quality Assessment
por: Zhu, Kai, et al.
Publicado: (2025)
por: Zhu, Kai, et al.
Publicado: (2025)
Distillation-Driven Diffusion Model for Multi-Scale MRI Super-Resolution: Make 1.5T MRI Great Again
por: Wang, Zhe, et al.
Publicado: (2025)
por: Wang, Zhe, et al.
Publicado: (2025)
ParamISP: Learned Forward and Inverse ISPs using Camera Parameters
por: Kim, Woohyeok, et al.
Publicado: (2023)
por: Kim, Woohyeok, et al.
Publicado: (2023)
Geodesic Diffusion Models for Efficient Medical Image Enhancement
por: Zhang, Teng, et al.
Publicado: (2025)
por: Zhang, Teng, et al.
Publicado: (2025)
DiT-JSCC: Rethinking Deep JSCC with Diffusion Transformers and Semantic Representations
por: Tan, Kailin, et al.
Publicado: (2026)
por: Tan, Kailin, et al.
Publicado: (2026)
MambaLiteSR: Image Super-Resolution with Low-Rank Mamba using Knowledge Distillation
por: Aalishah, Romina, et al.
Publicado: (2025)
por: Aalishah, Romina, et al.
Publicado: (2025)
Training-free Mixed-Resolution Latent Upsampling for Spatially Accelerated Diffusion Transformers
por: Jeong, Wongi, et al.
Publicado: (2025)
por: Jeong, Wongi, et al.
Publicado: (2025)
Exploiting Completeness Perception with Diffusion Transformer for Unified 3D MRI Synthesis
por: Liu, Junkai, et al.
Publicado: (2026)
por: Liu, Junkai, et al.
Publicado: (2026)
Exploring Out-of-distribution Detection for Sparse-view Computed Tomography with Diffusion Models
por: Demircan-Tureyen, Ezgi, et al.
Publicado: (2024)
por: Demircan-Tureyen, Ezgi, et al.
Publicado: (2024)
COSMIC: Compress Satellite Images Efficiently via Diffusion Compensation
por: Zhang, Ziyuan, et al.
Publicado: (2024)
por: Zhang, Ziyuan, et al.
Publicado: (2024)
Efficient Semantic Diffusion Architectures for Model Training on Synthetic Echocardiograms
por: Stojanovski, David, et al.
Publicado: (2024)
por: Stojanovski, David, et al.
Publicado: (2024)
Leveraging Motion Estimation for Efficient Bayer-Domain Computer Vision
por: Wang, Haichao, et al.
Publicado: (2025)
por: Wang, Haichao, et al.
Publicado: (2025)
Ejemplares similares
-
Taming Diffusion Transformer for Efficient Mobile Video Generation in Seconds
por: Wu, Yushu, et al.
Publicado: (2025) -
DiT-IC: Aligned Diffusion Transformer for Efficient Image Compression
por: Shi, Junqi, et al.
Publicado: (2026) -
SALT: Parameter-Efficient Fine-Tuning via Singular Value Adaptation with Low-Rank Transformation
por: Elsayed, Abdelrahman, et al.
Publicado: (2025) -
TransKD: Transformer Knowledge Distillation for Efficient Semantic Segmentation
por: Liu, Ruiping, et al.
Publicado: (2022) -
Multi-Objective Pareto-Front Optimization for Efficient Adaptive VVC Streaming
por: Katsenou, Angeliki, et al.
Publicado: (2026)