Image de couverture de livre

On-Device Fine-Tuning via Backprop-Free Zeroth-Order Optimization

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Katti, Prabodh, Sifaou, Houssem, Park, Sangwoo, Rajendran, Bipin, Simeone, Osvaldo
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning Computation and Language
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

Stochastic Spiking Attention: Accelerating Attention with Stochastic Computing in Spiking Networks
par: Song, Zihang, et autres
Publié: (2024)

Bayesian Inference on Binary Spiking Networks Leveraging Nanoscale Device Stochasticity
par: Katti, Prabodh, et autres
Publié: (2023)

Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximization
par: Sifaou, Houssem, et autres
Publié: (2025)

Baseline Drift Tolerant Signal Encoding for ECG Classification with Deep Learning
par: Shea, Robert O, et autres
Publié: (2024)

Xpikeformer: Hybrid Analog-Digital Hardware Acceleration for Spiking Transformers
par: Song, Zihang, et autres
Publié: (2024)

Stochastic Quantum Spiking Neural Networks with Quantum Memory and Local Learning
par: Chen, Jiechen, et autres
Publié: (2025)

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
par: Zhang, Yihua, et autres
Publié: (2024)

Semi-Supervised Learning via Cross-Prediction-Powered Inference for Wireless Systems
par: Sifaou, Houssem, et autres
Publié: (2024)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
par: Wang, Fei, et autres
Publié: (2024)

Context-Aware Doubly-Robust Semi-Supervised Learning
par: Ruah, Clement, et autres
Publié: (2025)

Prior-Informed Zeroth-Order Optimization with Adaptive Direction Alignment for Memory-Efficient LLM Fine-Tuning
par: Jin, Feihu, et autres
Publié: (2026)

Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
par: Gautam, Tanmay, et autres
Publié: (2024)

How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networks
par: Ruah, Clement, et autres
Publié: (2025)

Conservative and Risk-Aware Offline Multi-Agent Reinforcement Learning
par: Eldeeb, Eslam, et autres
Publié: (2024)

Hi-ZFO: Hierarchical Zeroth- and First-Order LLM Fine-Tuning via Importance-Guided Tensor Selection
par: Jin, Feihu, et autres
Publié: (2026)

On the Convergence of Zeroth-Order Federated Tuning for Large Language Models
par: Ling, Zhenqing, et autres
Publié: (2024)

Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
par: Li, Zeman, et autres
Publié: (2024)

Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
par: Liu, Yong, et autres
Publié: (2024)

Bayesian Optimization with Formal Safety Guarantees via Online Conformal Prediction
par: Zhang, Yunchuan, et autres
Publié: (2023)

Knowing When to Stop: Delay-Adaptive Spiking Neural Network Classifiers with Reliability Guarantees
par: Chen, Jiechen, et autres
Publié: (2023)

Bayes2IMC: In-Memory Computing for Bayesian Binary Neural Networks
par: Katti, Prabodh, et autres
Publié: (2024)

Quantile Learn-Then-Test: Quantile-Based Risk Control for Hyperparameter Optimization
par: Farzaneh, Amirmohammad, et autres
Publié: (2024)

Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
par: Yang, Yifan, et autres
Publié: (2024)

Sparsity-Aware Optimization of In-Memory Bayesian Binary Neural Network Accelerators
par: Katti, Prabodh, et autres
Publié: (2024)

Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Search
par: Zhang, Yunchuan, et autres
Publié: (2024)

Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons
par: Wu, Dengyu, et autres
Publié: (2025)

Neuromorphic Wireless Split Computing with Multi-Level Spikes
par: Wu, Dengyu, et autres
Publié: (2024)

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
par: Park, Juneyoung, et autres
Publié: (2026)

Optimizing In-Context Learning for Efficient Full Conformal Prediction
par: Deng, Weicao, et autres
Publié: (2025)

Calibrating Bayesian Learning via Regularization, Confidence Minimization, and Selective Inference
par: Huang, Jiayi, et autres
Publié: (2024)

Programming by Backprop: An Instruction is Worth 100 Examples When Finetuning LLMs
par: Cook, Jonathan, et autres
Publié: (2025)

Zeroth-Order Sharpness-Aware Learning with Exponential Tilting
par: Gong, Xuchen, et autres
Publié: (2025)

Fine-tuning Quantized Neural Networks with Zeroth-order Optimization
par: Shang, Sifeng, et autres
Publié: (2025)

Private Fine-tuning of Large Language Models with Zeroth-order Optimization
par: Tang, Xinyu, et autres
Publié: (2024)

Calibration-Aware Bayesian Learning
par: Huang, Jiayi, et autres
Publié: (2023)

Memory-Efficient Fine-Tuning of Transformers via Token Selection
par: Simoulin, Antoine, et autres
Publié: (2025)

Personalized Collaborative Fine-Tuning for On-Device Large Language Models
par: Wagner, Nicolas, et autres
Publié: (2024)

PocketLLM: Enabling On-Device Fine-Tuning for Personalized LLMs
par: Peng, Dan, et autres
Publié: (2024)

Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guarantees
par: Park, Sangwoo, et autres
Publié: (2025)