:: Library Catalog

Copertina

Salvato in:

Dettagli Bibliografici
Autori principali:	Jovanović, Andrej, Iacob, Alex, Safaryan, Mher, Modoranu, Ionut-Vlad, Sani, Lorenzo, Shen, William F., Qiu, Xinchi, Alistarh, Dan, Lane, Nicholas D.
Natura:	Preprint
Pubblicazione:	2026
Soggetti:	Machine Learning Artificial Intelligence
Accesso online:	https://arxiv.org/abs/2602.04396
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

MatryoshkaLoRA: Learning Accurate Hierarchical Low-Rank Representations for LLM Fine-Tuning
di: Modoranu, Ionut-Vlad, et al.
Pubblicazione: (2026)

LDAdam: Adaptive Optimization from Low-Dimensional Gradient Statistics
di: Robert, Thomas, et al.
Pubblicazione: (2024)

FFT-based Dynamic Subspace Selection for Low-Rank Adaptive Optimization of Large Language Models
di: Modoranu, Ionut-Vlad, et al.
Pubblicazione: (2025)

The Iterative Optimal Brain Surgeon: Faster Sparse Recovery by Leveraging Second-Order Information
di: Wu, Diyuan, et al.
Pubblicazione: (2024)

DASH: Faster Shampoo via Batched Block Preconditioning and Efficient Inverse-Root Solvers
di: Modoranu, Ionut-Vlad, et al.
Pubblicazione: (2026)

MT-DAO: Multi-Timescale Distributed Adaptive Optimizers with Local Updates
di: Iacob, Alex, et al.
Pubblicazione: (2025)

Unified Scaling Laws for Compressed Representations
di: Panferov, Andrei, et al.
Pubblicazione: (2025)

DES-LOC: Desynced Low Communication Adaptive Optimizers for Training Foundation Models
di: Iacob, Alex, et al.
Pubblicazione: (2025)

MicroAdam: Accurate Adaptive Optimization with Low Space Overhead and Provable Convergence
di: Modoranu, Ionut-Vlad, et al.
Pubblicazione: (2024)

Error Feedback Can Accurately Compress Preconditioners
di: Modoranu, Ionut-Vlad, et al.
Pubblicazione: (2023)

Towards Robust Scaling Laws for Optimizers
di: Volkova, Alexandra, et al.
Pubblicazione: (2026)

CAGE: Curvature-Aware Gradient Estimation For Accurate Quantization-Aware Training
di: Tabesh, Soroush, et al.
Pubblicazione: (2025)

DEPT: Decoupled Embeddings for Pre-training Language Models
di: Iacob, Alex, et al.
Pubblicazione: (2024)

LLM Unlearning via Neural Activation Redirection
di: Shen, William F., et al.
Pubblicazione: (2025)

Position: It's Time to Act on the Risk of Efficient Personalized Text Generation
di: Iofinova, Eugenia, et al.
Pubblicazione: (2025)

GradSkip: Communication-Accelerated Local Gradient Methods with Better Computational Complexity
di: Maranjyan, Artavazd, et al.
Pubblicazione: (2022)

Sheaf HyperNetworks for Personalized Federated Learning
di: Nguyen, Bao, et al.
Pubblicazione: (2024)

Pollen: High-throughput Federated Learning Simulation via Resource-Aware Client Placement
di: Sani, Lorenzo, et al.
Pubblicazione: (2023)

FedAnchor: Enhancing Federated Semi-Supervised Learning with Label Contrastive Loss for Unlabeled Clients
di: Qiu, Xinchi, et al.
Pubblicazione: (2024)

On Biased Compression for Distributed Learning
di: Beznosikov, Aleksandr, et al.
Pubblicazione: (2020)

SparsyFed: Sparse Adaptive Federated Training
di: Guastella, Adriano, et al.
Pubblicazione: (2025)

Optimizers Qualitatively Alter Solutions And We Should Leverage This
di: Pascanu, Razvan, et al.
Pubblicazione: (2025)

Photon: Federated LLM Pre-Training
di: Sani, Lorenzo, et al.
Pubblicazione: (2024)

AbbIE: Autoregressive Block-Based Iterative Encoder for Efficient Sequence Modeling
di: Aleksandrov, Preslav, et al.
Pubblicazione: (2025)

The Future of Large Language Model Pre-training is Federated
di: Sani, Lorenzo, et al.
Pubblicazione: (2024)

Worldwide Federated Training of Language Models
di: Iacob, Alex, et al.
Pubblicazione: (2024)

Response-Conditioned Parallel-to-Sequential Orchestration for Multi-Agent Systems
di: Tastan, Nurbek, et al.
Pubblicazione: (2026)

SEAT: Sparse Entity-Aware Tuning for Knowledge Adaptation while Preserving Epistemic Abstention
di: Shen, William F., et al.
Pubblicazione: (2025)

Gradient-less Federated Gradient Boosting Trees with Learnable Learning Rates
di: Ma, Chenyang, et al.
Pubblicazione: (2023)

Breaking Physical and Linguistic Borders: Multilingual Federated Prompt Tuning for Low-Resource Languages
di: Zhao, Wanru, et al.
Pubblicazione: (2025)

Panza: Design and Analysis of a Fully-Local Personalized Text Writing Assistant
di: Nicolicioiu, Armand, et al.
Pubblicazione: (2024)

Hymnographic Indicators of the Armenian Renaissance
di: Mher Navoyan
Pubblicazione: (2026)

Speculative Decoding Speed-of-Light: Optimal Lower Bounds via Branching Random Walks
di: Pankratov, Sergey, et al.
Pubblicazione: (2025)

Simple Opinion Dynamics for No-Regret Learning
di: Lazarsfeld, John, et al.
Pubblicazione: (2023)

Behemoth: Benchmarking Unlearning in LLMs Using Fully Synthetic Data
di: Iofinova, Eugenia, et al.
Pubblicazione: (2026)

LLMQ: Efficient Lower-Precision Pretraining for Consumer GPUs
di: Schultheis, Erik, et al.
Pubblicazione: (2025)

Model Compression with Exact Budget Constraints via Riemannian Manifolds
di: Helcig, Michael, et al.
Pubblicazione: (2026)

Communication-Efficient Federated Learning With Data and Client Heterogeneity
di: Zakerinia, Hossein, et al.
Pubblicazione: (2022)

Optimizing Classification of Infrequent Labels by Reducing Variability in Label Distribution
di: Agarwal, Ashutosh
Pubblicazione: (2025)

Deep Unrolling of Sparsity-Induced RDO for 3D Point Cloud Attribute Coding
di: Do, Tam Thuc, et al.
Pubblicazione: (2025)