Copertina

PrE-Text: Training Language Models on Private Federated Data in the Age of LLMs

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Hou, Charlie, Shrivastava, Akshat, Zhan, Hongyuan, Conway, Rylan, Le, Trang, Sagar, Adithya, Fanti, Giulia, Lazar, Daniel
Natura:	Preprint
Pubblicazione:	2024
Soggetti:	Machine Learning Artificial Intelligence Computation and Language Cryptography and Security Distributed, Parallel, and Cluster Computing
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

POPri: Private Federated Learning using Preference-Optimized Synthetic Data
di: Hou, Charlie, et al.
Pubblicazione: (2025)

FedOptimus: Optimizing Vertical Federated Learning for Scalability and Efficiency
di: Shrivastava, Nikita, et al.
Pubblicazione: (2025)

OpenFLAME: A Federated Spatial Naming Infrastructure
di: Bharadwaj, Sagar, et al.
Pubblicazione: (2024)

A System for Microserving of LLMs
di: Jin, Hongyi, et al.
Pubblicazione: (2024)

One-Bit Model Aggregation for Differentially Private and Byzantine-Robust Personalized Federated Learning
di: Lan, Muhang, et al.
Pubblicazione: (2025)

Age Aware Scheduling for Differentially-Private Federated Learning
di: Lin, Kuan-Yu, et al.
Pubblicazione: (2024)

LoongTrain: Efficient Training of Long-Sequence LLMs with Head-Context Parallelism
di: Gu, Diandian, et al.
Pubblicazione: (2024)

Power Aware Container Placement in Cloud Computing with Affinity and Cubic Power Model
di: Sarkar, Suvarthi, et al.
Pubblicazione: (2024)

Efficient Profit Maximization in Reliability Concerned Static Vehicular Cloud System
di: Sarkar, Suvarthi, et al.
Pubblicazione: (2023)

Federated Learning Using Coupled Tensor Train Decomposition
di: Zhang, Xiangtao, et al.
Pubblicazione: (2024)

BGTplanner: Maximizing Training Accuracy for Differentially Private Federated Recommenders via Strategic Privacy Budget Allocation
di: Zhang, Xianzhi, et al.
Pubblicazione: (2024)

Optimizing Federated Learning in the Era of LLMs: Message Quantization and Streaming
di: Xu, Ziyue, et al.
Pubblicazione: (2025)

Towards the Next Frontier of LLMs, Training on Private Data: A Cross-Domain Benchmark for Federated Fine-Tuning
di: Jimenez-Gutierrez, Daniel M., et al.
Pubblicazione: (2026)

CFT-Forensics: High-Performance Byzantine Accountability for Crash Fault Tolerant Protocols
di: Tang, Weizhao, et al.
Pubblicazione: (2023)

Uniting the World by Dividing it: Federated Maps to Enable Spatial Applications
di: Bharadwaj, Sagar, et al.
Pubblicazione: (2025)

Sketched Gaussian Mechanism for Private Federated Learning
di: Li, Qiaobo, et al.
Pubblicazione: (2025)

Age-Aware Partial Gradient Update Strategy for Federated Learning Over the Air
di: Du, Ruihao, et al.
Pubblicazione: (2025)

PowerTrip: Exploiting Federated Heterogeneous Datacenter Power for Distributed ML Training
di: Mehboob, Talha, et al.
Pubblicazione: (2025)

Tackling Privacy Heterogeneity in Differentially Private Federated Learning
di: Xu, Ruichen, et al.
Pubblicazione: (2026)

HexiSeq: Accommodating Long Context Training of LLMs over Heterogeneous Hardware
di: Liang, Yan, et al.
Pubblicazione: (2026)

Training LLMs with Fault Tolerant HSDP on 100,000 GPUs
di: Salpekar, Omkar, et al.
Pubblicazione: (2026)

Ira: Efficient Transaction Replay for Distributed Systems
di: Bhat, Adithya, et al.
Pubblicazione: (2026)

Cronus: Efficient LLM inference on Heterogeneous GPU Clusters via Partially Disaggregated Prefill
di: Liu, Yunzhao, et al.
Pubblicazione: (2025)

Empowering Distributed Training with Sparsity-driven Data Synchronization
di: Wang, Zhuang, et al.
Pubblicazione: (2023)

Locally Differentially Private Online Federated Learning With Correlated Noise
di: Zhang, Jiaojiao, et al.
Pubblicazione: (2024)

TACTFL: Temporal Contrastive Training for Multi-modal Federated Learning with Similarity-guided Model Aggregation
di: Sun, Guanxiong, et al.
Pubblicazione: (2025)

SAF: Scalable Acceleration Framework for dynamic and flexible scaling of FPGAs
di: Quraishi, Masudul Hassan, et al.
Pubblicazione: (2025)

PPipe: Efficient Video Analytics Serving on Heterogeneous GPU Clusters via Pool-Based Pipeline Parallelism
di: Kong, Z. Jonny, et al.
Pubblicazione: (2025)

IM-PIR: In-Memory Private Information Retrieval
di: Mwaisela, Mpoki, et al.
Pubblicazione: (2025)

Availability Modeling for Blockchain Provisioning in Private Clouds
di: Dantas, J, et al.
Pubblicazione: (2025)

Efficient Pre-Training of LLMs via Topology-Aware Communication Alignment on More Than 9600 GPUs
di: He, Guoliang, et al.
Pubblicazione: (2025)

A Federated and Parameter-Efficient Framework for Large Language Model Training in Medicine
di: Li, Anran, et al.
Pubblicazione: (2026)

Air-FedGA: A Grouping Asynchronous Federated Learning Mechanism Exploiting Over-the-air Computation
di: Ma, Qianpiao, et al.
Pubblicazione: (2025)

AGoQ: Activation and Gradient Quantization for Memory-Efficient Distributed Training of LLMs
di: Lin, Wenxiang, et al.
Pubblicazione: (2026)

Game Theoretic Liquidity Provisioning in Concentrated Liquidity Market Makers
di: Tang, Weizhao, et al.
Pubblicazione: (2024)

Adversarial Analysis of the Differentially-Private Federated Learning in Cyber-Physical Critical Infrastructures
di: Hossain, Md Tamjid, et al.
Pubblicazione: (2022)

DualScale: Energy-Efficient Disaggregated LLM Serving via Phase-Aware Placement and DVFS
di: Basit, Omar, et al.
Pubblicazione: (2026)

FunLess: Functions-as-a-Service for Private Edge Cloud Systems
di: De Palma, Giuseppe, et al.
Pubblicazione: (2024)

Photon: Federated LLM Pre-Training
di: Sani, Lorenzo, et al.
Pubblicazione: (2024)

Approximated Coded Computing: Towards Fast, Private and Secure Distributed Machine Learning
di: Qiu, Houming, et al.
Pubblicazione: (2024)