Copertina

On-Device Fine-Tuning via Backprop-Free Zeroth-Order Optimization

Fuente: arXiv

Salvato in:

Dettagli Bibliografici
Autori principali:	Katti, Prabodh, Sifaou, Houssem, Park, Sangwoo, Rajendran, Bipin, Simeone, Osvaldo
Natura:	Preprint
Pubblicazione:	2025
Soggetti:	Machine Learning Computation and Language
Accesso online:	Acceder al recurso
Tags:	Aggiungi Tag Nessun Tag, puoi essere il primo ad aggiungerne!!

Documenti analoghi

Stochastic Spiking Attention: Accelerating Attention with Stochastic Computing in Spiking Networks
di: Song, Zihang, et al.
Pubblicazione: (2024)

Bayesian Inference on Binary Spiking Networks Leveraging Nanoscale Device Stochasticity
di: Katti, Prabodh, et al.
Pubblicazione: (2023)

Multi-Fidelity Hybrid Reinforcement Learning via Information Gain Maximization
di: Sifaou, Houssem, et al.
Pubblicazione: (2025)

Baseline Drift Tolerant Signal Encoding for ECG Classification with Deep Learning
di: Shea, Robert O, et al.
Pubblicazione: (2024)

Xpikeformer: Hybrid Analog-Digital Hardware Acceleration for Spiking Transformers
di: Song, Zihang, et al.
Pubblicazione: (2024)

Stochastic Quantum Spiking Neural Networks with Quantum Memory and Local Learning
di: Chen, Jiechen, et al.
Pubblicazione: (2025)

Revisiting Zeroth-Order Optimization for Memory-Efficient LLM Fine-Tuning: A Benchmark
di: Zhang, Yihua, et al.
Pubblicazione: (2024)

Semi-Supervised Learning via Cross-Prediction-Powered Inference for Wireless Systems
di: Sifaou, Houssem, et al.
Pubblicazione: (2024)

Simultaneous Computation and Memory Efficient Zeroth-Order Optimizer for Fine-Tuning Large Language Models
di: Wang, Fei, et al.
Pubblicazione: (2024)

Context-Aware Doubly-Robust Semi-Supervised Learning
di: Ruah, Clement, et al.
Pubblicazione: (2025)

Prior-Informed Zeroth-Order Optimization with Adaptive Direction Alignment for Memory-Efficient LLM Fine-Tuning
di: Jin, Feihu, et al.
Pubblicazione: (2026)

Variance-reduced Zeroth-Order Methods for Fine-Tuning Language Models
di: Gautam, Tanmay, et al.
Pubblicazione: (2024)

How to Bridge the Sim-to-Real Gap in Digital Twin-Aided Telecommunication Networks
di: Ruah, Clement, et al.
Pubblicazione: (2025)

Conservative and Risk-Aware Offline Multi-Agent Reinforcement Learning
di: Eldeeb, Eslam, et al.
Pubblicazione: (2024)

Hi-ZFO: Hierarchical Zeroth- and First-Order LLM Fine-Tuning via Importance-Guided Tensor Selection
di: Jin, Feihu, et al.
Pubblicazione: (2026)

On the Convergence of Zeroth-Order Federated Tuning for Large Language Models
di: Ling, Zhenqing, et al.
Pubblicazione: (2024)

Addax: Utilizing Zeroth-Order Gradients to Improve Memory Efficiency and Performance of SGD for Fine-Tuning Language Models
di: Li, Zeman, et al.
Pubblicazione: (2024)

Sparse MeZO: Less Parameters for Better Performance in Zeroth-Order LLM Fine-Tuning
di: Liu, Yong, et al.
Pubblicazione: (2024)

Bayesian Optimization with Formal Safety Guarantees via Online Conformal Prediction
di: Zhang, Yunchuan, et al.
Pubblicazione: (2023)

Knowing When to Stop: Delay-Adaptive Spiking Neural Network Classifiers with Reliability Guarantees
di: Chen, Jiechen, et al.
Pubblicazione: (2023)

Bayes2IMC: In-Memory Computing for Bayesian Binary Neural Networks
di: Katti, Prabodh, et al.
Pubblicazione: (2024)

Quantile Learn-Then-Test: Quantile-Based Risk Control for Hyperparameter Optimization
di: Farzaneh, Amirmohammad, et al.
Pubblicazione: (2024)

Memory-Efficient Structured Backpropagation for On-Device LLM Fine-Tuning
di: Park, Juneyoung, et al.
Pubblicazione: (2026)

AdaZeta: Adaptive Zeroth-Order Tensor-Train Adaption for Memory-Efficient Large Language Models Fine-Tuning
di: Yang, Yifan, et al.
Pubblicazione: (2024)

Sparsity-Aware Optimization of In-Memory Bayesian Binary Neural Network Accelerators
di: Katti, Prabodh, et al.
Pubblicazione: (2024)

Multi-Fidelity Bayesian Optimization With Across-Task Transferable Max-Value Entropy Search
di: Zhang, Yunchuan, et al.
Pubblicazione: (2024)

Neuromorphic Wireless Split Computing with Resonate-and-Fire Neurons
di: Wu, Dengyu, et al.
Pubblicazione: (2025)

Neuromorphic Wireless Split Computing with Multi-Level Spikes
di: Wu, Dengyu, et al.
Pubblicazione: (2024)

LCSB: Layer-Cyclic Selective Backpropagation for Memory-Efficient On-Device LLM Fine-Tuning
di: Park, Juneyoung, et al.
Pubblicazione: (2026)

Optimizing In-Context Learning for Efficient Full Conformal Prediction
di: Deng, Weicao, et al.
Pubblicazione: (2025)

Calibrating Bayesian Learning via Regularization, Confidence Minimization, and Selective Inference
di: Huang, Jiayi, et al.
Pubblicazione: (2024)

Programming by Backprop: An Instruction is Worth 100 Examples When Finetuning LLMs
di: Cook, Jonathan, et al.
Pubblicazione: (2025)

Zeroth-Order Sharpness-Aware Learning with Exponential Tilting
di: Gong, Xuchen, et al.
Pubblicazione: (2025)

Fine-tuning Quantized Neural Networks with Zeroth-order Optimization
di: Shang, Sifeng, et al.
Pubblicazione: (2025)

Private Fine-tuning of Large Language Models with Zeroth-order Optimization
di: Tang, Xinyu, et al.
Pubblicazione: (2024)

Calibration-Aware Bayesian Learning
di: Huang, Jiayi, et al.
Pubblicazione: (2023)

Memory-Efficient Fine-Tuning of Transformers via Token Selection
di: Simoulin, Antoine, et al.
Pubblicazione: (2025)

Personalized Collaborative Fine-Tuning for On-Device Large Language Models
di: Wagner, Nicolas, et al.
Pubblicazione: (2024)

PocketLLM: Enabling On-Device Fine-Tuning for Personalized LLMs
di: Peng, Dan, et al.
Pubblicazione: (2024)

Adaptive Prediction-Powered AutoEval with Reliability and Efficiency Guarantees
di: Park, Sangwoo, et al.
Pubblicazione: (2025)