Cover Image

Newton Meets Marchenko-Pastur: Massively Parallel Second-Order Optimization with Hessian Sketching and Debiasing

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Romanov, Elad, Zhang, Fangzhao, Pilanci, Mert
Format:	Preprint
Published:	2024
Subjects:	Optimization and Control Information Theory Signal Processing Machine Learning
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Optimal Shrinkage for Distributed Second-Order Optimization
by: Zhang, Fangzhao, et al.
Published: (2024)

Analyzing Neural Network-Based Generative Diffusion Models through Convex Optimization
by: Zhang, Fangzhao, et al.
Published: (2024)

Nonconvex Factorization and Manifold Formulations are Almost Equivalent in Low-rank Matrix Optimization
by: Luo, Yuetian, et al.
Published: (2021)

Quantized Constant-Envelope Waveform Design for Massive MIMO DFRC Systems
by: Wu, Zheyu, et al.
Published: (2024)

Optimal Pilot and Payload Power Control in Single-Cell Massive MIMO Systems
by: Cheng, Hei Victor, et al.
Published: (2016)

Uplink Pilot and Data Power Control for Single Cell Massive MIMO Systems with MRC
by: Cheng, Hei Victor, et al.
Published: (2015)

Covariance-Based Device Activity Detection with Massive MIMO for Near-Field Correlated Channels
by: Wang, Ziyue, et al.
Published: (2024)

Covariance-Based Activity Detection in Cooperative Multi-Cell Massive MIMO: Scaling Law and Efficient Algorithms
by: Wang, Ziyue, et al.
Published: (2023)

Riemannian Preconditioned LoRA for Fine-Tuning Foundation Models
by: Zhang, Fangzhao, et al.
Published: (2024)

A Survey of Recent Advances in Optimization Methods for Wireless Communications
by: Liu, Ya-Feng, et al.
Published: (2024)

Active Learning of Deep Neural Networks via Gradient-Free Cutting Planes
by: Zhang, Erica, et al.
Published: (2024)

Optimization of Beyond Diagonal RIS: A Universal Framework Applicable to Arbitrary Architectures
by: Wu, Zheyu, et al.
Published: (2024)

ConvexECG: Lightweight and Explainable Neural Networks for Personalized, Continuous Cardiac Monitoring
by: Ansari, Rayan, et al.
Published: (2024)

ODELoRA: Training Low-Rank Adaptation by Solving Ordinary Differential Equations
by: Gao, Yihang, et al.
Published: (2026)

Automatic Rank Determination for Low-Rank Adaptation via Submodular Function Maximization
by: Gao, Yihang, et al.
Published: (2025)

Adaptive Learning for IRS-Assisted Wireless Networks: Securing Opportunistic Communications Against Byzantine Eavesdroppers
by: Taherpour, Amirhossein, et al.
Published: (2025)

Weighed l1 on the simplex: Compressive sensing meets locality
by: Tasissa, Abiy, et al.
Published: (2021)

K-Deep Simplex: Deep Manifold Learning via Local Dictionaries
by: Tankala, Pranay, et al.
Published: (2020)

Joint Satellite Power Consumption and Handover Optimization for LEO Constellations
by: Afif, Yassine, et al.
Published: (2025)

An Efficient Benders Decomposition Approach for Optimal Large-Scale Network Slicing
by: Chen, Wei-Kun, et al.
Published: (2023)

BICM-compatible Rate Adaptive Geometric Constellation Shaping Using Optimized Many-to-one Labeling
by: Yankov, Metodi Plamenov, et al.
Published: (2023)

An Adaptive Proximal Inexact Gradient Framework and Its Application to Per-Antenna Constrained Joint Beamforming and Compression Design
by: Fan, Xilai, et al.
Published: (2025)

Waterfilling at the Edge: Optimal Percentile Resource Allocation via Risk-Averse Reduction
by: Yaylali, Gokberk, et al.
Published: (2025)

A New Adaptive Balanced Augmented Lagrangian Method with Application to ISAC Beamforming Design
by: Wu, Jiageng, et al.
Published: (2024)

QoS-based Beamforming and Compression Design for Cooperative Cellular Networks via Lagrangian Duality
by: Fan, Xilai, et al.
Published: (2023)

Beamforming Design for Integrated Sensing and Communications Using Uplink-Downlink Duality
by: Attiah, Kareem M., et al.
Published: (2024)

Analytically Characterized Optimal Power Control for Signal-Level-Integrated Sensing, Computing and Communication in Federated Learning
by: Zheng, Paul, et al.
Published: (2026)

QoS-Aware and Routing-Flexible Network Slicing for Service-Oriented Networks
by: Chen, Wei-Kun, et al.
Published: (2024)

Computing Capacity-Cost Functions for Continuous Channels in Wasserstein Space
by: Li, Xinyang, et al.
Published: (2025)

Asymptotics of Proximity Operator for Squared Loss and Performance Prediction of Nonconvex Sparse Signal Recovery
by: Hayakawa, Ryo
Published: (2021)

Duality-Based Fixed Point Iteration Algorithm for Beamforming Design in ISAC Systems
by: Fan, Xilai, et al.
Published: (2025)

Computation of Capacity-Distortion-Cost Functions for Continuous Memoryless Channels
by: Li, Xinyang, et al.
Published: (2025)

Quickest Change Detection with Confusing Change
by: Chen, Yu-Zhen Janice, et al.
Published: (2024)

The Local Landscape of Phase Retrieval Under Limited Samples
by: Liu, Kaizhao, et al.
Published: (2023)

Efficient Incremental SLAM via Information-Guided and Selective Optimization
by: Arablouei, Reza
Published: (2026)

RIS-Assisted Interference Mitigation for Uplink NOMA
by: Tabeshnezhad, Azadeh, et al.
Published: (2023)

Strong Duality in Risk-Constrained Nonconvex Functional Programming
by: Kalogerias, Dionysis, et al.
Published: (2022)

Accelerated First-Order Optimization under Nonlinear Constraints
by: Muehlebach, Michael, et al.
Published: (2023)

Optimizer-Induced Mode Connectivity: From AdamW to Muon
by: Zhang, Fangzhao, et al.
Published: (2026)

Stochastic Zeroth-Order Optimization under Strongly Convexity and Lipschitz Hessian: Minimax Sample Complexity
by: Yu, Qian, et al.
Published: (2024)