Cover Image

Exploring Magnitude Preservation and Rotation Modulation in Diffusion Transformers

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Bill, Eric Tillman, Jensen, Cristian Perez, Anagnostidis, Sotiris, von Rütte, Dimitri
Format:	Preprint
Published:	2025
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Navigating Scaling Laws: Compute Optimality in Adaptive Model Training
by: Anagnostidis, Sotiris, et al.
Published: (2023)

FlexiDiT: Your Diffusion Transformer Can Easily Generate High-Quality Samples with Less Compute
by: Anagnostidis, Sotiris, et al.
Published: (2025)

Towards Meta-Pruning via Optimal Transport
by: Theus, Alexander, et al.
Published: (2024)

MegaPortrait: Revisiting Diffusion Control for High-fidelity Portrait Generation
by: Yang, Han, et al.
Published: (2024)

Efficient Distillation of Classifier-Free Guidance using Adapters
by: Jensen, Cristian Perez, et al.
Published: (2025)

JEDI: The Force of Jensen-Shannon Divergence in Disentangling Diffusion Models
by: Bill, Eric Tillmann, et al.
Published: (2025)

SiT: Exploring Flow and Diffusion-based Generative Models with Scalable Interpolant Transformers
by: Ma, Nanye, et al.
Published: (2024)

Autoregressive Distillation of Diffusion Transformers
by: Kim, Yeongmin, et al.
Published: (2025)

DiRotQ: Rotation-Aware Quantization for 4-bit Diffusion Transformers
by: Sharify, Sayeh, et al.
Published: (2026)

Structure Preserving Diffusion Models
by: Lu, Haoye, et al.
Published: (2024)

TRACE: Transformer-based Risk Assessment for Clinical Evaluation
by: Christopoulos, Dionysis, et al.
Published: (2024)

Explorations of the Softmax Space: Knowing When the Neural Network Doesn't Know
by: Sikar, Daniel, et al.
Published: (2025)

Eff-GRot: Efficient and Generalizable Rotation Estimation with Transformers
by: Mathioulakis, Fanis, et al.
Published: (2025)

Modulated Diffusion: Accelerating Generative Modeling with Modulated Quantization
by: Gao, Weizhi, et al.
Published: (2025)

Beyond the Permutation Symmetry of Transformers: The Role of Rotation for Model Fusion
by: Zhang, Binchi, et al.
Published: (2025)

Erasing Undesirable Concepts in Diffusion Models with Adversarial Preservation
by: Bui, Anh, et al.
Published: (2024)

Hausdorff Distance Matching with Adaptive Query Denoising for Rotated Detection Transformer
by: Lee, Hakjin, et al.
Published: (2023)

m2mKD: Module-to-Module Knowledge Distillation for Modular Transformers
by: Lo, Ka Man, et al.
Published: (2024)

Attention Frequency Modulation: Training-Free Spectral Modulation of Diffusion Cross-Attention
by: Oh, Seunghun, et al.
Published: (2026)

Diffusion Transformers with Representation Autoencoders
by: Zheng, Boyang, et al.
Published: (2025)

Hybrid-Regularized Magnitude Pruning for Robust Federated Learning under Covariate Shift
by: Goksu, Ozgu, et al.
Published: (2024)

Privacy-Preserving in Connected and Autonomous Vehicles Through Vision to Text Transformation
by: Rezaei, Abdolazim, et al.
Published: (2025)

Efficient Fine-Tuning with Domain Adaptation for Privacy-Preserving Vision Transformer
by: Nagamori, Teru, et al.
Published: (2024)

A Language Model's Guide Through Latent Space
by: von Rütte, Dimitri, et al.
Published: (2024)

Is Complexity Required for Neural Network Pruning? A Case Study on Global Magnitude Pruning
by: Gupta, Manas, et al.
Published: (2022)

Point-Based Shape Representation Generation with a Correspondence-Preserving Diffusion Model
by: Zhu, Shen, et al.
Published: (2025)

Identity-Preserving Pose-Guided Character Animation via Facial Landmarks Transformation
by: Mu, Lianrui, et al.
Published: (2024)

CORP: Closed-Form One-shot Representation-Preserving Structured Pruning for Transformers
by: Zhang, Boxiang, et al.
Published: (2026)

Efficient Diversity-Preserving Diffusion Alignment via Gradient-Informed GFlowNets
by: Liu, Zhen, et al.
Published: (2024)

Token Caching for Diffusion Transformer Acceleration
by: Lou, Jinming, et al.
Published: (2024)

Data-independent Module-aware Pruning for Hierarchical Vision Transformers
by: He, Yang, et al.
Published: (2024)

Unlearning Concepts in Diffusion Model via Concept Domain Correction and Concept Preserving Gradient
by: Wu, Yongliang, et al.
Published: (2024)

EHRDiff: Exploring Realistic EHR Synthesis with Diffusion Models
by: Yuan, Hongyi, et al.
Published: (2023)

Exploring Diffusion and Flow Matching Under Generator Matching
by: Patel, Zeeshan, et al.
Published: (2024)

TerDiT: Ternary Diffusion Models with Transformers
by: Lu, Xudong, et al.
Published: (2024)

Relational Feature Caching for Accelerating Diffusion Transformers
by: Son, Byunggwan, et al.
Published: (2026)

IC-Portrait: In-Context Matching for View-Consistent Personalized Portrait
by: Yang, Han, et al.
Published: (2025)

RadRotator: 3D Rotation of Radiographs with Diffusion Models
by: Rouzrokh, Pouria, et al.
Published: (2024)

EDiT: Efficient Diffusion Transformers with Linear Compressed Attention
by: Becker, Philipp, et al.
Published: (2025)

Guiding a Diffusion Transformer with the Internal Dynamics of Itself
by: Zhou, Xingyu, et al.
Published: (2025)