FGP: Feature-Gradient-Prune for Efficient Convolutional Layer Pruning
Fuente:
arXiv
Guardado en:
| Autores principales: | , , , , , , , , |
|---|---|
| Formato: | Preprint |
| Publicado: |
2024
|
| Materias: | |
| Acceso en línea: | |
| Etiquetas: |
Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
|
| _version_ | 1866909396358922240 |
|---|---|
| author | Lv, Qingsong Sun, Jiasheng Zhou, Sheng Zhang, Xu Li, Liangcheng Gao, Yun Qiao, Sun Song, Jie Bu, Jiajun |
| author_facet | Lv, Qingsong Sun, Jiasheng Zhou, Sheng Zhang, Xu Li, Liangcheng Gao, Yun Qiao, Sun Song, Jie Bu, Jiajun |
| contents | To reduce computational overhead while maintaining model performance, model pruning techniques have been proposed. Among these, structured pruning, which removes entire convolutional channels or layers, significantly enhances computational efficiency and is compatible with hardware acceleration. However, existing pruning methods that rely solely on image features or gradients often result in the retention of redundant channels, negatively impacting inference efficiency. To address this issue, this paper introduces a novel pruning method called Feature-Gradient Pruning (FGP). This approach integrates both feature-based and gradient-based information to more effectively evaluate the importance of channels across various target classes, enabling a more accurate identification of channels that are critical to model performance. Experimental results demonstrate that the proposed method improves both model compactness and practicality while maintaining stable performance. Experiments conducted across multiple tasks and datasets show that FGP significantly reduces computational costs and minimizes accuracy loss compared to existing methods, highlighting its effectiveness in optimizing pruning outcomes. The source code is available at: https://github.com/FGP-code/FGP. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2411_12781 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FGP: Feature-Gradient-Prune for Efficient Convolutional Layer Pruning Lv, Qingsong Sun, Jiasheng Zhou, Sheng Zhang, Xu Li, Liangcheng Gao, Yun Qiao, Sun Song, Jie Bu, Jiajun Computer Vision and Pattern Recognition To reduce computational overhead while maintaining model performance, model pruning techniques have been proposed. Among these, structured pruning, which removes entire convolutional channels or layers, significantly enhances computational efficiency and is compatible with hardware acceleration. However, existing pruning methods that rely solely on image features or gradients often result in the retention of redundant channels, negatively impacting inference efficiency. To address this issue, this paper introduces a novel pruning method called Feature-Gradient Pruning (FGP). This approach integrates both feature-based and gradient-based information to more effectively evaluate the importance of channels across various target classes, enabling a more accurate identification of channels that are critical to model performance. Experimental results demonstrate that the proposed method improves both model compactness and practicality while maintaining stable performance. Experiments conducted across multiple tasks and datasets show that FGP significantly reduces computational costs and minimizes accuracy loss compared to existing methods, highlighting its effectiveness in optimizing pruning outcomes. The source code is available at: https://github.com/FGP-code/FGP. |
| title | FGP: Feature-Gradient-Prune for Efficient Convolutional Layer Pruning |
| topic | Computer Vision and Pattern Recognition |
| url | https://arxiv.org/abs/2411.12781 |