Cover Image

Towards Multi-modal Transformers in Federated Learning

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Sun, Guangyu, Mendieta, Matias, Dutta, Aritra, Li, Xin, Chen, Chen
Format:	Preprint
Published:	2024
Subjects:	Computer Vision and Pattern Recognition Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Navigating Heterogeneity and Privacy in One-Shot Federated Learning with Diffusion Models
by: Mendieta, Matias, et al.
Published: (2024)

Exploring Parameter-Efficient Fine-Tuning to Enable Foundation Models in Federated Learning
by: Sun, Guangyu, et al.
Published: (2022)

Closer to Reality: Practical Semi-Supervised Federated Learning for Foundation Model Adaptation
by: Sun, Guangyu, et al.
Published: (2025)

Overcome Modal Bias in Multi-modal Federated Learning via Balanced Modality Selection
by: Fan, Yunfeng, et al.
Published: (2023)

UNIC-Adapter: Unified Image-instruction Adapter with Multi-modal Transformer for Image Generation
by: Duan, Lunhao, et al.
Published: (2024)

Balanced Multi-modal Federated Learning via Cross-Modal Infiltration
by: Fan, Yunfeng, et al.
Published: (2023)

Learnable Cross-modal Knowledge Distillation for Multi-modal Learning with Missing Modality
by: Wang, Hu, et al.
Published: (2023)

Multi-level Cross-modal Alignment for Image Clustering
by: Qiu, Liping, et al.
Published: (2024)

Towards Understanding Adversarial Transferability in Federated Learning
by: Li, Yijiang, et al.
Published: (2023)

Delving into Multi-modal Multi-task Foundation Models for Road Scene Understanding: From Learning Paradigm Perspectives
by: Luo, Sheng, et al.
Published: (2024)

FedHCA$^2$: Towards Hetero-Client Federated Multi-Task Learning
by: Lu, Yuxiang, et al.
Published: (2023)

cadrille: Multi-modal CAD Reconstruction with Reinforcement Learning
by: Kolodiazhnyi, Maksim, et al.
Published: (2025)

FedMGP: Personalized Federated Learning with Multi-Group Text-Visual Prompts
by: Bo, Weihao, et al.
Published: (2025)

Learning from True-False Labels via Multi-modal Prompt Retrieving
by: Li, Zhongnian, et al.
Published: (2024)

Improving Medical Multi-modal Contrastive Learning with Expert Annotations
by: Kumar, Yogesh, et al.
Published: (2024)

Multi-modal Representation Learning for Cross-modal Prediction of Continuous Weather Patterns from Discrete Low-Dimensional Data
by: Qayyum, Alif Bin Abdul, et al.
Published: (2024)

ConvTransSeg: A Multi-resolution Convolution-Transformer Network for Medical Image Segmentation
by: Gong, Zhendi, et al.
Published: (2022)

Multi-level and Multi-modal Action Anticipation
by: Kim, Seulgi, et al.
Published: (2025)

Path-GPTOmic: A Balanced Multi-modal Learning Framework for Survival Outcome Prediction
by: Wang, Hongxiao, et al.
Published: (2024)

Forgettable Federated Linear Learning with Certified Data Unlearning
by: Jin, Ruinan, et al.
Published: (2023)

Multi-modal Data Spectrum: Multi-modal Datasets are Multi-dimensional
by: Madaan, Divyam, et al.
Published: (2025)

Fairness in Multi-modal Medical Diagnosis with Demonstration Selection
by: Li, Dawei, et al.
Published: (2025)

Federated Adaptive Prompt Tuning for Multi-Domain Collaborative Learning
by: Su, Shangchao, et al.
Published: (2022)

XR-MBT: Multi-modal Full Body Tracking for XR through Self-Supervision with Learned Depth Point Cloud Registration
by: Rozumnyi, Denys, et al.
Published: (2024)

Cross-modal Active Complementary Learning with Self-refining Correspondence
by: Qin, Yang, et al.
Published: (2023)

Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections
by: Kirchner, Max, et al.
Published: (2025)

Towards Unified Modeling in Federated Multi-Task Learning via Subspace Decoupling
by: Wei, Yipan, et al.
Published: (2025)

Multi-modal learning for geospatial vegetation forecasting
by: Benson, Vitus, et al.
Published: (2023)

FLIP: Towards Comprehensive and Reliable Evaluation of Federated Prompt Learning
by: Liao, Dongping, et al.
Published: (2025)

TransDiffuser: Diverse Trajectory Generation with Decorrelated Multi-modal Representation for End-to-end Autonomous Driving
by: Jiang, Xuefeng, et al.
Published: (2025)

A Concise yet Effective model for Non-Aligned Incomplete Multi-view and Missing Multi-label Learning
by: Li, Xiang, et al.
Published: (2020)

ECBench: Can Multi-modal Foundation Models Understand the Egocentric World? A Holistic Embodied Cognition Benchmark
by: Dang, Ronghao, et al.
Published: (2025)

ETSCL: An Evidence Theory-Based Supervised Contrastive Learning Framework for Multi-modal Glaucoma Grading
by: Yang, Zhiyuan, et al.
Published: (2024)

Multi-modal MRI-Based Alzheimer's Disease Diagnosis with Transformer-based Image Synthesis and Transfer Learning
by: Qiu, Jason
Published: (2026)

Exploring the Practicality of Federated Learning: A Survey Towards the Communication Perspective
by: Le, Khiem, et al.
Published: (2024)

Multi-Space Alignments Towards Universal LiDAR Segmentation
by: Liu, Youquan, et al.
Published: (2024)

ProxyFL: A Proxy-Guided Framework for Federated Semi-Supervised Learning
by: Chen, Duowen, et al.
Published: (2026)

Towards Redundancy-Free Sub-networks in Continual Learning
by: Chen, Cheng, et al.
Published: (2023)

Taming Cross-Domain Representation Variance in Federated Prototype Learning with Heterogeneous Data Domains
by: Wang, Lei, et al.
Published: (2024)

Towards Better Alignment: Training Diffusion Models with Reinforcement Learning Against Sparse Rewards
by: Hu, Zijing, et al.
Published: (2025)