Saved in:
| Main Authors: | , , , , , , |
|---|---|
| Format: | Preprint |
| Published: |
2025
|
| Subjects: | |
| Online Access: | https://arxiv.org/abs/2506.03109 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1866913872881909760 |
|---|---|
| author | Yao, Wei Xu, Gengze Tang, Huayi Yang, Wenkai Di, Donglin Wang, Ziqiao Liu, Yong |
| author_facet | Yao, Wei Xu, Gengze Tang, Huayi Yang, Wenkai Di, Donglin Wang, Ziqiao Liu, Yong |
| contents | Weak-to-strong generalization (W2SG) has emerged as a promising paradigm for stimulating the capabilities of strong pre-trained models by leveraging supervision from weaker supervisors. To improve the performance of the strong model, existing methods often require additional weak models or complex procedures, leading to substantial computational and memory overhead. Motivated by the effectiveness of $f$-divergence loss in various machine learning domains, we introduce $f$-divergence as an information-theoretic loss function framework in W2SG. Our theoretical analysis reveals fundamental limitations and equivalence of different $f$-divergence losses in W2SG, supported by sample complexity bounds and information-theoretic insights. We empirically demonstrate that $f$-divergence loss, which generalizes widely-used metrics like KL divergence, effectively improves generalization and noise tolerance of the strong model in practice. |
| format | Preprint |
| id |
arxiv_https___arxiv_org_abs_2506_03109 |
| institution | arXiv |
| publishDate | 2025 |
| record_format | arxiv |
| spellingShingle | On Weak-to-Strong Generalization and f-Divergence Yao, Wei Xu, Gengze Tang, Huayi Yang, Wenkai Di, Donglin Wang, Ziqiao Liu, Yong Machine Learning Weak-to-strong generalization (W2SG) has emerged as a promising paradigm for stimulating the capabilities of strong pre-trained models by leveraging supervision from weaker supervisors. To improve the performance of the strong model, existing methods often require additional weak models or complex procedures, leading to substantial computational and memory overhead. Motivated by the effectiveness of $f$-divergence loss in various machine learning domains, we introduce $f$-divergence as an information-theoretic loss function framework in W2SG. Our theoretical analysis reveals fundamental limitations and equivalence of different $f$-divergence losses in W2SG, supported by sample complexity bounds and information-theoretic insights. We empirically demonstrate that $f$-divergence loss, which generalizes widely-used metrics like KL divergence, effectively improves generalization and noise tolerance of the strong model in practice. |
| title | On Weak-to-Strong Generalization and f-Divergence |
| topic | Machine Learning |
| url | https://arxiv.org/abs/2506.03109 |