FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion
Fuente:
arXiv
Saved in:
| Main Authors: | , , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2024
|
| Subjects: | |
| Online Access: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866912746968186880 |
|---|---|
| author | Tang, Anke Shen, Li Luo, Yong Yang, Enneng Hu, Han Zhang, Lefei Du, Bo Tao, Dacheng |
| author_facet | Tang, Anke Shen, Li Luo, Yong Yang, Enneng Hu, Han Zhang, Lefei Du, Bo Tao, Dacheng |
| contents | Deep model fusion is an emerging technique that unifies the predictions or parameters of several deep neural networks into a single better-performing model in a cost-effective and data-efficient manner. Although a variety of deep model fusion techniques have been introduced, their evaluations tend to be inconsistent and often inadequate to validate their effectiveness and robustness. We present FusionBench, the first benchmark and a unified library designed specifically for deep model fusion. Our benchmark consists of multiple tasks, each with different settings of models and datasets. This variety allows us to compare fusion methods across different scenarios and model scales. Additionally, FusionBench serves as a unified library for easy implementation and testing of new fusion techniques. FusionBench is open source and actively maintained, with community contributions encouraged. Homepage https://github.com/tanganke/fusion_bench |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2406_03280 |
| institution | arXiv |
| publishDate | 2024 |
| record_format | arxiv |
| spellingShingle | FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion Tang, Anke Shen, Li Luo, Yong Yang, Enneng Hu, Han Zhang, Lefei Du, Bo Tao, Dacheng Machine Learning Artificial Intelligence Computation and Language Deep model fusion is an emerging technique that unifies the predictions or parameters of several deep neural networks into a single better-performing model in a cost-effective and data-efficient manner. Although a variety of deep model fusion techniques have been introduced, their evaluations tend to be inconsistent and often inadequate to validate their effectiveness and robustness. We present FusionBench, the first benchmark and a unified library designed specifically for deep model fusion. Our benchmark consists of multiple tasks, each with different settings of models and datasets. This variety allows us to compare fusion methods across different scenarios and model scales. Additionally, FusionBench serves as a unified library for easy implementation and testing of new fusion techniques. FusionBench is open source and actively maintained, with community contributions encouraged. Homepage https://github.com/tanganke/fusion_bench |
| title | FusionBench: A Unified Library and Comprehensive Benchmark for Deep Model Fusion |
| topic | Machine Learning Artificial Intelligence Computation and Language |
| url | https://arxiv.org/abs/2406.03280 |