Cover Image

Perturbation-efficient Zeroth-order Optimization for Hardware-friendly On-device Training

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Tan, Qitao, Chang, Sung-En, Xia, Rui, Ji, Huidong, Yang, Chence, Zhang, Ci, Liu, Jun, Zhan, Zheng, Fang, Zhenman, Zou, Zhou, Wang, Yanzhi, Lu, Jin, Yuan, Geng
Format:	Preprint
Published:	2025
Subjects:	Machine Learning Artificial Intelligence
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Harmony in Divergence: Towards Fast, Accurate, and Memory-efficient Zeroth-order LLM Fine-tuning
by: Tan, Qitao, et al.
Published: (2025)

Towards Fast LLM Fine-tuning through Zeroth-Order Optimization with Projected Gradient-Aligned Perturbations
by: Mi, Zhendong, et al.
Published: (2025)

KerZOO: Kernel Function Informed Zeroth-Order Optimization for Accurate and Accelerated LLM Fine-Tuning
by: Mi, Zhendong, et al.
Published: (2025)

Rethinking the Potential of Layer Freezing for Efficient DNN Training
by: Yang, Chence, et al.
Published: (2025)

Variable-order fractional Laplacian and its accurate and efficient computations with meshfree methods
by: Wu, Yixuan, et al.
Published: (2024)

Quasar-ViT: Hardware-Oriented Quantization-Aware Architecture Search for Vision Transformers
by: Li, Zhengang, et al.
Published: (2024)

Elucidating Subspace Perturbation in Zeroth-Order Optimization: Theory and Practice at Scale
by: Park, Sihwan, et al.
Published: (2025)

Q-realign: Piggybacking Realignment on Quantization for Safe and Efficient LLM Deployment
by: Tan, Qitao, et al.
Published: (2026)

SQ-format: A Unified Sparse-Quantized Hardware-friendly Data Format for LLMs
by: Huang, Ruixuan, et al.
Published: (2025)

FEDS: Feature and Entropy-Based Distillation Strategy for Efficient Learned Image Compression
by: Fu, Haisheng, et al.
Published: (2025)

SELIC: Semantic-Enhanced Learned Image Compression via High-Level Textual Guidance
by: Fu, Haisheng, et al.
Published: (2025)

Zeroth-order Logconcave Sampling
by: Kook, Yunbum, et al.
Published: (2025)

Zeroth-order parallel sampling
by: Pozza, Francesco, et al.
Published: (2026)

MobileQuant: Mobile-friendly Quantization for On-device Language Models
by: Tan, Fuwen, et al.
Published: (2024)

Palette: A Modular, Controllable, and Efficient Framework for On-demand Authorized Safety Alignment Relaxation in LLMs
by: Tan, Qitao, et al.
Published: (2026)

Frequency-Guided Diffusion Model with Perturbation Training for Skeleton-Based Video Anomaly Detection
by: Tan, Xiaofeng, et al.
Published: (2024)

Riemannian Accelerated Zeroth-order Algorithm: Improved Robustness and Lower Query Complexity
by: He, Chang, et al.
Published: (2024)

Advancing time series completion via RFAMoE and MDFF
by: Zhang, Ci, et al.
Published: (2025)

Huizhou
by: Guo, Qitao
Published: (2022)

Roots Beneath the Cut: Uncovering the Risk of Concept Revival in Pruning-Based Unlearning for Diffusion Models
by: Zhang, Ci, et al.
Published: (2026)

Stochastic Zeroth order Descent with Structured Directions
by: Rando, Marco, et al.
Published: (2022)

Navigating Teledermatology in the Post‐ COVID Era
by: Valencia Long, et al.
Published: (2026)

Motor‐sparing regional analgesia for hip arthroplasty: refining the evidence base
by: Ci‐En Li, et al.
Published: (2025)

Distributed Zeroth-Order Optimization with Rademacher Perturbations and Momentum Gradient Tracking
by: Su, Yanxu, et al.
Published: (2026)

Hardware-friendly IR-HARQ for Polar SCL Decoders
by: Jalaleddine, Marwan, et al.
Published: (2025)

A Controlled Diagnostic Study of Hardware-Induced Distortions in Hardware-Aware Training
by: Fang, Yunxuan, et al.
Published: (2026)

Can a One-Point Feedback Zeroth-order Algorithm Achieve Linear Dimension Dependent Sample Complexity?
by: Ye, Haishan, et al.
Published: (2025)

Reading Between the Lines: Towards Reliable Black-box LLM Fingerprinting via Zeroth-order Gradient Estimation
by: Shao, Shuo, et al.
Published: (2025)

Efficient Knowledge Graph Unlearning with Zeroth-order Information
by: Xiao, Yang, et al.
Published: (2025)

Zeroth-order Stochastic Cubic Newton Method Revisited
by: Liu, Yu, et al.
Published: (2024)

Experimental device-independent certification of indefinite causal order
by: Qu, Dengke, et al.
Published: (2025)

SmartFRZ: An Efficient Training Framework using Attention-Based Layer Freezing
by: Li, Sheng, et al.
Published: (2024)

Lotus: learning-based online thermal and latency variation management for two-stage detectors on edge devices
by: Gong, Yifan, et al.
Published: (2024)

Complexity of Zeroth- and First-order Stochastic Trust-Region Algorithms
by: Ha, Yunsoo, et al.
Published: (2024)

Fine-tuning Quantized Neural Networks with Zeroth-order Optimization
by: Shang, Sifeng, et al.
Published: (2025)

An Inexact Preconditioned Zeroth-order Proximal Method for Composite Optimization
by: Liu, Shanglin, et al.
Published: (2024)

The rIC3 Hardware Model Checker
by: Su, Yuheng, et al.
Published: (2025)

Establish seedling quality classification standard for Chrysanthemum efficiently with help of deep clustering algorithm
by: Jing, Yanzhi, et al.
Published: (2024)

Towards Accurate and Efficient Sub-8-Bit Integer Training
by: Guo, Wenjin, et al.
Published: (2024)

WeConvene: Learned Image Compression with Wavelet-Domain Convolution and Entropy Model
by: Fu, Haisheng, et al.
Published: (2024)