Cover Image

On Sampling Strategies for Spectral Model Sharding

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Korzhenkov, Denis, Louizos, Christos
Format:	Preprint
Published:	2024
Subjects:	Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

A Mutual Information Perspective on Federated Contrastive Learning
by: Louizos, Christos, et al.
Published: (2024)

Guarding the Meaning: Self-Supervised Training for Semantic Robustness in Guard Models
by: Pinneri, Cristina, et al.
Published: (2025)

Non-exchangeable Conformal Prediction with Optimal Transport: Tackling Distribution Shifts with Unlabeled Data
by: Correia, Alvaro H. C., et al.
Published: (2025)

Variational Learning ISTA
by: Massoli, Fabio Valerio, et al.
Published: (2024)

On Adaptivity in Zeroth-Order Optimization
by: Dbouk, Hassan, et al.
Published: (2026)

Masks Can Be Distracting: On Context Comprehension in Diffusion Language Models
by: Piskorz, Julianna, et al.
Published: (2025)

Approximating Full Conformal Prediction for Neural Network Regression with Gauss-Newton Influence
by: Tailor, Dharmesh, et al.
Published: (2025)

A Probabilistic Approach to Pose Synchronization for Multi-Reference Alignment with Applications to MIMO Wireless Communication Systems
by: Romijnders, Rob, et al.
Published: (2025)

Stable Diffusion-based Data Augmentation for Federated Learning with Non-IID Data
by: Morafah, Mahdi, et al.
Published: (2024)

Protect Your Score: Contact Tracing With Differential Privacy Guarantees
by: Romijnders, Rob, et al.
Published: (2023)

Multi-Draft Speculative Sampling: Canonical Decomposition and Theoretical Limits
by: Khisti, Ashish, et al.
Published: (2024)

An Information Theoretic Perspective on Conformal Prediction
by: Correia, Alvaro H. C., et al.
Published: (2024)

DNA: Differentially private Neural Augmentation for contact tracing
by: Romijnders, Rob, et al.
Published: (2024)

InterroGate: Learning to Share, Specialize, and Prune Representations for Multi-task Learning
by: Bejnordi, Babak Ehteshami, et al.
Published: (2024)

Private PoEtry: Private In-Context Learning via Product of Experts
by: Romijnders, Rob, et al.
Published: (2026)

Analyzing and Improving Chain-of-Thought Monitorability Through Information Theory
by: Anwar, Usman, et al.
Published: (2026)

FedShard: Federated Unlearning with Efficiency Fairness and Performance Fairness
by: Wen, Siyuan, et al.
Published: (2025)

Cascade: Token-Sharded Private LLM Inference
by: Thomas, Rahul, et al.
Published: (2025)

Learning to Shard: RL for Co-optimizing the Parallelism Degrees and Per-operator Sharding Dimensions in Distributed LLM Inference
by: Yin, Ruokai, et al.
Published: (2025)

MoS: Unleashing Parameter Efficiency of Low-Rank Adaptation with Mixture of Shards
by: Wang, Sheng, et al.
Published: (2024)

Fundamental bounds on efficiency-confidence trade-off for transductive conformal prediction
by: Behboodi, Arash, et al.
Published: (2025)

Accelerating MoE Model Inference with Expert Sharding
by: Balmau, Oana, et al.
Published: (2025)

ERIS: Enhancing Privacy and Scalability in Federated Learning via Federated Shard Aggregation
by: Fenoglio, Dario, et al.
Published: (2026)

Scalable Federated Unlearning via Isolated and Coded Sharding
by: Lin, Yijing, et al.
Published: (2024)

ShardTensor: Domain Parallelism for Scientific Machine Learning
by: Adams, Corey, et al.
Published: (2026)

SCRec: A Scalable Computational Storage System with Statistical Sharding and Tensor-train Decomposition for Recommendation Models
by: Yang, Jinho, et al.
Published: (2025)

Text Classification: Neural Networks VS Machine Learning Models VS Pre-trained Models
by: Petridis, Christos
Published: (2024)

ACCO: Accumulate While You Communicate for Communication-Overlapped Sharded LLM Training
by: Nabli, Adel, et al.
Published: (2024)

Implicit Bias of Spectral Descent and Muon on Multiclass Separable Data
by: Fan, Chen, et al.
Published: (2025)

Isoperimetry is All We Need: Langevin Posterior Sampling for RL with Sublinear Regret
by: Jorge, Emilio, et al.
Published: (2024)

Consistency of Selection Strategies for Fraud Detection
by: Revelas, Christos, et al.
Published: (2025)

High-Resolution Convolutional Neural Networks on Homomorphically Encrypted Data via Sharding Ciphertexts
by: Maloney, Vivian, et al.
Published: (2023)

How Muon's Spectral Design Benefits Generalization: A Study on Imbalanced Data
by: Vasudeva, Bhavya, et al.
Published: (2025)

Sampling Strategies for Mitigating Bias in Face Synthesis Methods
by: Maragkoudakis, Emmanouil, et al.
Published: (2024)

Enhancing Split Learning with Sharded and Blockchain-Enabled SplitFed Approaches
by: Sokhankhosh, Amirreza, et al.
Published: (2025)

Memory and Bandwidth are All You Need for Fully Sharded Data Parallel
by: Wang, Jiangtao, et al.
Published: (2025)

An Empirical Study of Sample Selection Strategies for Large Language Model Repair
by: Li, Xuran, et al.
Published: (2025)

Flatness and Gradient Alignment Are Both Necessary: Spectral-Aware Gradient-Aligned Exploration for Multi-Distribution Learning
by: Ballas, Aristotelis, et al.
Published: (2026)

High-Resolution Daytime Translation Without Domain Labels
by: Anokhin, Ivan, et al.
Published: (2020)

Goal-Driven Adaptive Sampling Strategies for Machine Learning Models Predicting Fields
by: Parekh, Jigar, et al.
Published: (2026)