Salvato in:
Dettagli Bibliografici
Autori principali: Li, Tao, Huang, Zhehao, Wu, Yingwen, He, Zhengbao, Tao, Qinghua, Huang, Xiaolin, Lin, Chih-Jen
Natura: Preprint
Pubblicazione: 2022
Soggetti:
Accesso online:https://arxiv.org/abs/2205.13104
Tags: Aggiungi Tag
Nessun Tag, puoi essere il primo ad aggiungerne!!
_version_ 1866916604707602432
author Li, Tao
Huang, Zhehao
Wu, Yingwen
He, Zhengbao
Tao, Qinghua
Huang, Xiaolin
Lin, Chih-Jen
author_facet Li, Tao
Huang, Zhehao
Wu, Yingwen
He, Zhengbao
Tao, Qinghua
Huang, Xiaolin
Lin, Chih-Jen
contents Weight averaging is a widely used technique for accelerating training and improving the generalization of deep neural networks (DNNs). While existing approaches like stochastic weight averaging (SWA) rely on pre-set weighting schemes, they can be suboptimal when handling diverse weights. We introduce Trainable Weight Averaging (TWA), a novel optimization method that operates within a reduced subspace spanned by candidate weights and learns optimal weighting coefficients through optimization. TWA offers greater flexibility and can be applied to different training scenarios. For large-scale applications, we develop a distributed training framework that combines parallel computation with low-bit compression for the projection matrix, effectively managing memory and computational demands. TWA can be implemented using either training data (TWA-t) or validation data (TWA-v), with the latter providing more effective averaging. Extensive experiments showcase TWA's advantages: (i) it consistently outperforms SWA in generalization performance and flexibility, (ii) when applied during early training, it reduces training time by over 40\% on CIFAR datasets and 30\% on ImageNet while maintaining comparable performance, and (iii) during fine-tuning, it significantly enhances generalization by weighted averaging of model checkpoints. In summary, we present an efficient and effective framework for trainable weight averaging. The code is available at https://github.com/nblt/TWA.
format Preprint
id arxiv_https___arxiv_org_abs_2205_13104
institution arXiv
publishDate 2022
record_format arxiv
spellingShingle Trainable Weight Averaging: Accelerating Training and Improving Generalization
Li, Tao
Huang, Zhehao
Wu, Yingwen
He, Zhengbao
Tao, Qinghua
Huang, Xiaolin
Lin, Chih-Jen
Machine Learning
Weight averaging is a widely used technique for accelerating training and improving the generalization of deep neural networks (DNNs). While existing approaches like stochastic weight averaging (SWA) rely on pre-set weighting schemes, they can be suboptimal when handling diverse weights. We introduce Trainable Weight Averaging (TWA), a novel optimization method that operates within a reduced subspace spanned by candidate weights and learns optimal weighting coefficients through optimization. TWA offers greater flexibility and can be applied to different training scenarios. For large-scale applications, we develop a distributed training framework that combines parallel computation with low-bit compression for the projection matrix, effectively managing memory and computational demands. TWA can be implemented using either training data (TWA-t) or validation data (TWA-v), with the latter providing more effective averaging. Extensive experiments showcase TWA's advantages: (i) it consistently outperforms SWA in generalization performance and flexibility, (ii) when applied during early training, it reduces training time by over 40\% on CIFAR datasets and 30\% on ImageNet while maintaining comparable performance, and (iii) during fine-tuning, it significantly enhances generalization by weighted averaging of model checkpoints. In summary, we present an efficient and effective framework for trainable weight averaging. The code is available at https://github.com/nblt/TWA.
title Trainable Weight Averaging: Accelerating Training and Improving Generalization
topic Machine Learning
url https://arxiv.org/abs/2205.13104