Copertina

A Step Toward Federated Pretraining of Multimodal Large Language Models

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Xiong, Baochen, Xu, Yifan, Yang, Xiaoshan, Song, Yaguang, Wang, Yaowei, Xu, Changsheng
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Pilot: Building the Federated Multimodal Instruction Tuning Framework
di: Xiong, Baochen, et al.
Pubblicazione: (2025)

Harmony: A Unified Framework for Modality Incremental Learning
di: Song, Yaguang, et al.
Pubblicazione: (2025)

PivotMerge: Bridging Heterogeneous Multimodal Pre-training via Post-Alignment Model Merging
di: Shao, Zibo, et al.
Pubblicazione: (2026)

FedNano: Toward Lightweight Federated Tuning for Pretrained Multimodal Large Language Models
di: Zhang, Yao, et al.
Pubblicazione: (2025)

Libra: Building Decoupled Vision System on Large Language Models
di: Xu, Yifan, et al.
Pubblicazione: (2024)

Spectral Probe-Circuits: A Three-Step Recipe for Identifying Attention-Head Circuits in Pretrained Transformers
di: Xu, Yongzhong
Pubblicazione: (2026)

Scaffold-Conditioned Preference Triplets for Controllable Molecular Optimization with Large Language Models
di: Xiong, Yi, et al.
Pubblicazione: (2026)

Does Unification Come at a Cost? Uni-SafeBench: A Safety Benchmark for Unified Multimodal Large Models
di: Peng, Zixiang, et al.
Pubblicazione: (2026)

Efficient Table Retrieval and Understanding with Multimodal Large Language Models
di: Xu, Zhuoyan, et al.
Pubblicazione: (2026)

LBLLM: Lightweight Binarization of Large Language Models via Three-Stage Distillation
di: Song, Siqing, et al.
Pubblicazione: (2026)

Routing-Based Continual Learning for Multimodal Large Language Models
di: Mohta, Jay, et al.
Pubblicazione: (2025)

Pretraining Large Language Models with NVFP4
di: NVIDIA, et al.
Pubblicazione: (2025)

MLLM-LLaVA-FL: Multimodal Large Language Model Assisted Federated Learning
di: Zhang, Jianyi, et al.
Pubblicazione: (2024)

Dynamic Loss-Based Sample Reweighting for Improved Large Language Model Pretraining
di: Sow, Daouda, et al.
Pubblicazione: (2025)

MHARFedLLM: Multimodal Human Activity Recognition Using Federated Large Language Model
di: Bandyopadhyay, Asmit, et al.
Pubblicazione: (2025)

Unlock the Potential of Large Language Models for Predictive Tabular Tasks in Data Science with Table-Specific Pretraining
di: Yang, Yazheng, et al.
Pubblicazione: (2024)

Benchmarking Multimodal Knowledge Conflict for Large Multimodal Models
di: Jia, Yifan, et al.
Pubblicazione: (2025)

Towards Reasoning-Preserving Unlearning in Multimodal Large Language Models
di: Li, Hongji, et al.
Pubblicazione: (2025)

Towards Understanding Multi-Round Large Language Model Reasoning: Approximability, Learnability and Generalizability
di: Xu, Chenhui, et al.
Pubblicazione: (2025)

Exploring Federated Pruning for Large Language Models
di: Guo, Pengxin, et al.
Pubblicazione: (2025)

Discrete Diffusion in Large Language and Multimodal Models: A Survey
di: Yu, Runpeng, et al.
Pubblicazione: (2025)

Towards Auto-Modeling of Formal Verification for NextG Protocols: A Multimodal cross- and self-attention Large Language Model Approach
di: Yang, Jingda, et al.
Pubblicazione: (2023)

Towards Trustable Language Models: Investigating Information Quality of Large Language Models
di: Rejeleene, Rick, et al.
Pubblicazione: (2024)

FHBench: Towards Efficient and Personalized Federated Learning for Multimodal Healthcare
di: Wang, Penghao, et al.
Pubblicazione: (2025)

Revealing Multimodal Causality with Large Language Models
di: Li, Jin, et al.
Pubblicazione: (2025)

MuRating: A High Quality Data Selecting Approach to Multilingual Large Language Model Pretraining
di: Chen, Zhixun, et al.
Pubblicazione: (2025)

Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
di: Liu, Chengwu, et al.
Pubblicazione: (2025)

Watch Every Step! LLM Agent Learning via Iterative Step-Level Process Refinement
di: Xiong, Weimin, et al.
Pubblicazione: (2024)

FLAME: Towards Federated Fine-Tuning Large Language Models Through Adaptive SMoE
di: Le, Khiem, et al.
Pubblicazione: (2025)

From Token to Rhythm: A Multi-Scale Approach for ECG-Language Pretraining
di: Wang, Fuying, et al.
Pubblicazione: (2025)

Multimodal Federated Learning: A Survey through the Lens of Different FL Paradigms
di: Peng, Yuanzhe, et al.
Pubblicazione: (2025)

CodeFuse-13B: A Pretrained Multi-lingual Code Large Language Model
di: Di, Peng, et al.
Pubblicazione: (2023)

Data-centric Federated Graph Learning with Large Language Models
di: Yan, Bo, et al.
Pubblicazione: (2025)

DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Execution
di: Yue, Yang, et al.
Pubblicazione: (2024)

PTQ1.61: Push the Real Limit of Extremely Low-Bit Post-Training Quantization Methods for Large Language Models
di: Zhao, Jiaqi, et al.
Pubblicazione: (2025)

Unifying Perplexing Behaviors in Modified BP Attributions through Alignment Perspective
di: Zheng, Guanhua, et al.
Pubblicazione: (2025)

Revisiting Essential and Nonessential Settings of Evidential Deep Learning
di: Chen, Mengyuan, et al.
Pubblicazione: (2024)

BEAR: Towards Beam-Search-Aware Optimization for Recommendation with Large Language Models
di: Yang, Weiqin, et al.
Pubblicazione: (2026)

Large Language Models are Few-shot Multivariate Time Series Classifiers
di: Chen, Yakun, et al.
Pubblicazione: (2025)

PRIME: Prototype-Driven Multimodal Pretraining for Cancer Prognosis with Missing Modalities
di: Yu, Kai, et al.
Pubblicazione: (2026)