Cover Image

Sequential Compression Layers for Efficient Federated Learning in Foundational Models

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Mahla, Navyansh, Gupta, Sunny, Sethi, Amit
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Exploring Gradient Subspaces: Addressing and Overcoming LoRA's Limitations in Federated Fine-Tuning of Large Language Models
by: Mahla, Navyansh, et al.
Published: (2024)

Federated Cross-Modal Style-Aware Prompt Generation
by: Prasad, Suraj, et al.
Published: (2025)

BiPrompt: Bilateral Prompt Optimization for Visual and Textual Debiasing in Vision-Language Models
by: Gupta, Sunny, et al.
Published: (2026)

FedHypeVAE: Federated Learning with Hypernetwork Generated Conditional VAEs for Differentially Private Embedding Sharing
by: Gupta, Sunny, et al.
Published: (2026)

CCVA-FL: Cross-Client Variations Adaptive Federated Learning for Medical Imaging
by: Gupta, Sunny, et al.
Published: (2024)

Personalized Federated Learning via Sequential Layer Expansion in Representation Learning
by: Jang, Jaewon, et al.
Published: (2024)

IDAL: Improved Domain Adaptive Learning for Natural Images Dataset
by: Gupta, Ravi Kant, et al.
Published: (2025)

A Survey on Parameter-Efficient Fine-Tuning for Foundation Models in Federated Learning
by: Bian, Jieming, et al.
Published: (2025)

Federated Generative Learning with Foundation Models
by: Zhang, Jie, et al.
Published: (2023)

Communication-Efficient Federated Learning with Adaptive Compression under Dynamic Bandwidth
by: Zhuansun, Ying, et al.
Published: (2024)

Towards Learning Foundation Models for Heuristic Functions to Solve Pathfinding Problems
by: Khandelwal, Vedant, et al.
Published: (2024)

Synergizing Foundation Models and Federated Learning: A Survey
by: Li, Shenghui, et al.
Published: (2024)

Federated Learning Framework via Distributed Mutual Learning
by: Gupta, Yash
Published: (2025)

Synthetic Data Aided Federated Learning Using Foundation Models
by: Abacha, Fatima, et al.
Published: (2024)

UniVarFL: Uniformity and Variance Regularized Federated Learning for Heterogeneous Data
by: Gupta, Sunny, et al.
Published: (2025)

CALR: Corrective Adaptive Low-Rank Decomposition for Efficient Large Language Model Layer Compression
by: Kautsar, Muchammad Daniyal, et al.
Published: (2025)

MedSAGa: Few-shot Memory Efficient Medical Image Segmentation using Gradient Low-Rank Projection in SAM
by: Mahla, Navyansh, et al.
Published: (2024)

FedStein: Enhancing Multi-Domain Federated Learning Through James-Stein Estimator
by: Gupta, Sunny, et al.
Published: (2024)

Parametric Feature Transfer: One-shot Federated Learning with Foundation Models
by: Beitollahi, Mahdi, et al.
Published: (2024)

Scalable Whole Slide Image Representation Using K-Mean Clustering and Fisher Vector Aggregation
by: Gupta, Ravi Kant, et al.
Published: (2025)

Federated Learning with Layer Skipping: Efficient Training of Large Language Models for Healthcare NLP
by: Zhang, Lihong, et al.
Published: (2025)

Grounding Foundation Models through Federated Transfer Learning: A General Framework
by: Kang, Yan, et al.
Published: (2023)

Advances and Open Challenges in Federated Foundation Models
by: Ren, Chao, et al.
Published: (2024)

Ten Challenging Problems in Federated Foundation Models
by: Fan, Tao, et al.
Published: (2025)

Lattice: Learning to Efficiently Compress the Memory
by: Karami, Mahdi, et al.
Published: (2025)

Constraining Sequential Model Editing with Editing Anchor Compression
by: Xu, Hao-Xiang, et al.
Published: (2025)

Deep Networks Learn Deep Hierarchical Models
by: Daniely, Amit
Published: (2026)

TuneComp: Joint Fine-tuning and Compression for Large Foundation Models
by: Chen, Xiangyu, et al.
Published: (2025)

Towards Layer-Wise Personalized Federated Learning: Adaptive Layer Disentanglement via Conflicting Gradients
by: Nguyen, Minh Duong, et al.
Published: (2024)

Resource-efficient Layer-wise Federated Self-supervised Learning
by: Tun, Ye Lin, et al.
Published: (2024)

Federated Foundation Models: Privacy-Preserving and Collaborative Learning for Large Models
by: Yu, Sixing, et al.
Published: (2023)

FEDKIM: Adaptive Federated Knowledge Injection into Medical Foundation Models
by: Wang, Xiaochen, et al.
Published: (2024)

FedPFT: Federated Proxy Fine-Tuning of Foundation Models
by: Peng, Zhaopeng, et al.
Published: (2024)

Discrete Prototypical Memories for Federated Time Series Foundation Models
by: Deng, Liwei, et al.
Published: (2026)

Is One Layer Enough? Understanding Inference Dynamics in Tabular Foundation Models
by: Balef, Amir Rezaei, et al.
Published: (2026)

ECG-Soup: Harnessing Multi-Layer Synergy for ECG Foundation Models
by: Nguyen, Phu X., et al.
Published: (2025)

When Attention Collapses: How Degenerate Layers in LLMs Enable Smaller, Stronger Models
by: Sanyal, Sunny, et al.
Published: (2024)

$\texttt{MiniMol}$: A Parameter-Efficient Foundation Model for Molecular Learning
by: Kläser, Kerstin, et al.
Published: (2024)

EnECG: Efficient Ensemble Learning for Electrocardiogram Multi-task Foundation Model
by: Xu, Yuhao, et al.
Published: (2025)

TangledFeatures: Robust Feature Selection in Highly Correlated Spaces
by: Sunny, Allen Daniel
Published: (2025)