Learning an Efficient Optimizer via Hybrid-Policy Sub-Trajectory Balance
Fuente:
arXiv
Enregistré dans:
| Auteurs principaux: | , , , , , , , , , , |
|---|---|
| Format: | Preprint |
| Publié: |
2025
|
| Sujets: | |
| Accès en ligne: | |
| Tags: |
Ajouter un tag
Pas de tags, Soyez le premier à ajouter un tag!
|
| _version_ | 1866914130046222336 |
|---|---|
| author | Guan, Yunchuan Liu, Yu Zhou, Ke Li, Hui Jia, Sen Shen, Zhiqi Wang, Ziyang Zhang, Xinglin Chen, Tao Hwang, Jenq-Neng Li, Lei |
| author_facet | Guan, Yunchuan Liu, Yu Zhou, Ke Li, Hui Jia, Sen Shen, Zhiqi Wang, Ziyang Zhang, Xinglin Chen, Tao Hwang, Jenq-Neng Li, Lei |
| contents | Recent advances in generative modeling enable neural networks to generate weights without relying on gradient-based optimization. However, current methods are limited by issues of over-coupling and long-horizon. The former tightly binds weight generation with task-specific objectives, thereby limiting the flexibility of the learned optimizer. The latter leads to inefficiency and low accuracy during inference, caused by the lack of local constraints. In this paper, we propose Lo-Hp, a decoupled two-stage weight generation framework that enhances flexibility through learning various optimization policies. It adopts a hybrid-policy sub-trajectory balance objective, which integrates on-policy and off-policy learning to capture local optimization policies. Theoretically, we demonstrate that learning solely local optimization policies can address the long-horizon issue while enhancing the generation of global optimal weights. In addition, we validate Lo-Hp's superior accuracy and inference efficiency in tasks that require frequent weight updates, such as transfer learning, few-shot learning, domain generalization, and large language model adaptation. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2511_00543 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | Learning an Efficient Optimizer via Hybrid-Policy Sub-Trajectory Balance Guan, Yunchuan Liu, Yu Zhou, Ke Li, Hui Jia, Sen Shen, Zhiqi Wang, Ziyang Zhang, Xinglin Chen, Tao Hwang, Jenq-Neng Li, Lei Machine Learning Computer Vision and Pattern Recognition Recent advances in generative modeling enable neural networks to generate weights without relying on gradient-based optimization. However, current methods are limited by issues of over-coupling and long-horizon. The former tightly binds weight generation with task-specific objectives, thereby limiting the flexibility of the learned optimizer. The latter leads to inefficiency and low accuracy during inference, caused by the lack of local constraints. In this paper, we propose Lo-Hp, a decoupled two-stage weight generation framework that enhances flexibility through learning various optimization policies. It adopts a hybrid-policy sub-trajectory balance objective, which integrates on-policy and off-policy learning to capture local optimization policies. Theoretically, we demonstrate that learning solely local optimization policies can address the long-horizon issue while enhancing the generation of global optimal weights. In addition, we validate Lo-Hp's superior accuracy and inference efficiency in tasks that require frequent weight updates, such as transfer learning, few-shot learning, domain generalization, and large language model adaptation. |
| title | Learning an Efficient Optimizer via Hybrid-Policy Sub-Trajectory Balance |
| topic | Machine Learning Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2511.00543 |