Mixture-of-Mamba: Enhancing Multi-Modal State-Space Models with Modality-Aware Sparsity

Documenti analoghi

• Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Models
  di: Liang, Weixin, et al.
  Pubblicazione: (2024)
• LMFusion: Adapting Pretrained Language Models for Multimodal Generation
  di: Shi, Weijia, et al.
  Pubblicazione: (2024)
• ML-Mamba: Efficient Multi-Modal Large Language Model Utilizing Mamba-2
  di: Huang, Wenjun, et al.
  Pubblicazione: (2024)
• Closing the Modality Gap for Mixed Modality Search
  di: Li, Binxu, et al.
  Pubblicazione: (2025)
• Enhancing Meme Emotion Understanding with Multi-Level Modality Enhancement and Dual-Stage Modal Fusion
  di: Shi, Yi, et al.
  Pubblicazione: (2025)