Copertina

Multi-Subspace Multi-Modal Modeling for Diffusion Models: Estimation, Convergence and Mixture of Experts

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Yang, Ruofeng, Li, Yongcan, Jiang, Bo, Chen, Cheng, Li, Shuai
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Elucidating Rectified Flow with Deterministic Sampler: Polynomial Discretization Complexity for Multi and One-step Models
di: Yang, Ruofeng, et al.
Pubblicazione: (2025)

ARIS: Autonomous Research via Adversarial Multi-Agent Collaboration
di: Yang, Ruofeng, et al.
Pubblicazione: (2026)

Understanding Representation Learnability of Nonlinear Self-Supervised Learning
di: Yang, Ruofeng, et al.
Pubblicazione: (2024)

Dynamic Adaptive Shared Experts with Grouped Multi-Head Attention Mixture of Experts
di: Li, Cheng, et al.
Pubblicazione: (2025)

Multi-Modal Time Series Prediction via Mixture of Modulated Experts
di: Zhang, Lige, et al.
Pubblicazione: (2026)

Efficient and Effective Weight-Ensembling Mixture of Experts for Multi-Task Model Merging
di: Shen, Li, et al.
Pubblicazione: (2024)

Sub-MoE: Efficient Mixture-of-Expert LLMs Compression via Subspace Expert Merging
di: Li, Lujun, et al.
Pubblicazione: (2025)

Facet-Aware Multi-Head Mixture-of-Experts Model for Sequential Recommendation
di: Liu, Mingrui, et al.
Pubblicazione: (2024)

Towards Convergence Rates for Parameter Estimation in Gaussian-gated Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2023)

Subspace Optimization for Large Language Models with Convergence Guarantees
di: He, Yutong, et al.
Pubblicazione: (2024)

MixTTE: Multi-Level Mixture-of-Experts for Scalable and Adaptive Travel Time Estimation
di: Jiang, Wenzhao, et al.
Pubblicazione: (2026)

PhysVarMix: Physics-Informed Variational Mixture Model for Multi-Modal Trajectory Prediction
di: Li, Haichuan, et al.
Pubblicazione: (2025)

EEGMamba: Bidirectional State Space Model with Mixture of Experts for EEG Multi-task Classification
di: Gui, Yiyu, et al.
Pubblicazione: (2024)

Grassmannian Mixture-of-Experts: Concentration-Controlled Routing on Subspace Manifolds
di: Shihab, Ibne Farabi, et al.
Pubblicazione: (2026)

Merging Multi-Task Models via Weight-Ensembling Mixture of Experts
di: Tang, Anke, et al.
Pubblicazione: (2024)

Dimension-Free Convergence of Diffusion Models for Approximate Gaussian Mixtures
di: Li, Gen, et al.
Pubblicazione: (2025)

Efficiently Editing Mixture-of-Experts Models with Compressed Experts
di: He, Yifei, et al.
Pubblicazione: (2025)

Model Selection and Parameter Estimation of Multi-dimensional Gaussian Mixture Model
di: Liu, Xinyu, et al.
Pubblicazione: (2026)

Convergence Rates for Softmax Gating Mixture of Experts
di: Nguyen, Huy, et al.
Pubblicazione: (2025)

MoE-I$^2$: Compressing Mixture of Experts Models through Inter-Expert Pruning and Intra-Expert Low-Rank Decomposition
di: Yang, Cheng, et al.
Pubblicazione: (2024)

Interpretable Preferences via Multi-Objective Reward Modeling and Mixture-of-Experts
di: Wang, Haoxiang, et al.
Pubblicazione: (2024)

Language-Conditioned Representations and Mixture-of-Experts Policy for Robust Multi-Task Robotic Manipulation
di: Zhang, Xiucheng, et al.
Pubblicazione: (2025)

FarSkip-Collective: Unhobbling Blocking Communication in Mixture of Experts Models
di: Dukler, Yonatan, et al.
Pubblicazione: (2025)

M$^3$TN: Multi-gate Mixture-of-Experts based Multi-valued Treatment Network for Uplift Modeling
di: Sun, Zexu, et al.
Pubblicazione: (2024)

Multi-Head Mixture-of-Experts
di: Wu, Xun, et al.
Pubblicazione: (2024)

Mitigating the Backdoor Effect for Multi-Task Model Merging via Safety-Aware Subspace
di: Yang, Jinluan, et al.
Pubblicazione: (2024)

Each Rank Could be an Expert: Single-Ranked Mixture of Experts LoRA for Multi-Task Learning
di: Zhao, Ziyu, et al.
Pubblicazione: (2025)

Unveiling Hidden Collaboration within Mixture-of-Experts in Large Language Models
di: Tang, Yuanbo, et al.
Pubblicazione: (2025)

Mixture-of-Experts with Gradient Conflict-Driven Subspace Topology Pruning for Emergent Modularity
di: Gan, Yuxing, et al.
Pubblicazione: (2025)

T-REX: Mixture-of-Rank-One-Experts with Semantic-aware Intuition for Multi-task Large Language Model Finetuning
di: Zhang, Rongyu, et al.
Pubblicazione: (2024)

Towards Unified Modeling in Federated Multi-Task Learning via Subspace Decoupling
di: Wei, Yipan, et al.
Pubblicazione: (2025)

Chain-of-Experts: Unlocking the Communication Power of Mixture-of-Experts Models
di: Wang, Zihan, et al.
Pubblicazione: (2025)

Separation and Collaboration: Two-Level Routing Grouped Mixture-of-Experts for Multi-Domain Continual Learning
di: Zhou, Jialu, et al.
Pubblicazione: (2025)

Customized Multiple Clustering via Multi-Modal Subspace Proxy Learning
di: Yao, Jiawei, et al.
Pubblicazione: (2024)

HMoE: Heterogeneous Mixture of Experts for Language Modeling
di: Wang, An, et al.
Pubblicazione: (2024)

Flex-MoE: Modeling Arbitrary Modality Combination via the Flexible Mixture-of-Experts
di: Yun, Sukwon, et al.
Pubblicazione: (2024)

Multi-fidelity Parameter Estimation Using Conditional Diffusion Models
di: Tatsuoka, Caroline, et al.
Pubblicazione: (2025)

SMILE: Zero-Shot Sparse Mixture of Low-Rank Experts Construction From Pre-Trained Foundation Models
di: Tang, Anke, et al.
Pubblicazione: (2024)

Multi-Task Reinforcement Learning with Mixture of Orthogonal Experts
di: Hendawy, Ahmed, et al.
Pubblicazione: (2023)

Dynamic Expert Sharing: Decoupling Memory from Parallelism in Mixture-of-Experts Diffusion LLMs
di: Chen, Hao Mark, et al.
Pubblicazione: (2026)