Image de couverture de livre

On Weak-to-Strong Generalization and f-Divergence

Fuente: arXiv

Enregistré dans:

Détails bibliographiques
Auteurs principaux:	Yao, Wei, Xu, Gengze, Tang, Huayi, Yang, Wenkai, Di, Donglin, Wang, Ziqiao, Liu, Yong
Format:	Preprint
Publié:	2025
Sujets:	Machine Learning
Accès en ligne:	Acceder al recurso
Tags:	Ajouter un tag Pas de tags, Soyez le premier à ajouter un tag!

Documents similaires

The Capabilities and Limitations of Weak-to-Strong Generalization: Generalization and Calibration
par: Yao, Wei, et autres
Publié: (2025)

On the Emergence of Weak-to-Strong Generalization: A Bias-Variance Perspective
par: Xu, Gengze, et autres
Publié: (2025)

On the Blessing of Pre-training in Weak-to-Strong Generalization
par: Yao, Wei, et autres
Publié: (2026)

Revisiting Weak-to-Strong Generalization in Theory and Practice: Reverse KL vs. Forward KL
par: Yao, Wei, et autres
Publié: (2025)

On $f$-Divergence Principled Domain Adaptation: An Improved Framework
par: Wang, Ziqiao, et autres
Publié: (2024)

Information-Theoretic Generalization Bounds for Transductive Learning and its Applications
par: Tang, Huayi, et autres
Publié: (2023)

PAC-Bayesian Generalization Bounds for Graph Convolutional Networks on Inductive Node Classification
par: Tang, Huayi, et autres
Publié: (2025)

Generalization Bounds via Conditional $f$-Information
par: Wang, Ziqiao, et autres
Publié: (2024)

Understanding Model Ensemble in Transferable Adversarial Attack
par: Yao, Wei, et autres
Publié: (2024)

Theoretical Insights into Fine-Tuning Attention Mechanism: Generalization and Optimization
par: Yao, Xinhao, et autres
Publié: (2024)

Perfect Alignment May be Poisonous to Graph Contrastive Learning
par: Liu, Jingyu, et autres
Publié: (2023)

Towards Auto-Regressive Next-Token Prediction: In-Context Learning Emerges from Generalization
par: Gong, Zixuan, et autres
Publié: (2025)

Loss Functions and Operators Generated by f-Divergences
par: Roulet, Vincent, et autres
Publié: (2025)

Robust Offline Reinforcement Learning with Linearly Structured f-Divergence Regularization
par: Tang, Cheng, et autres
Publié: (2024)

Transformers as Intrinsic Optimizers: Forward Inference through the Energy Principle
par: Ren, Ruifeng, et autres
Publié: (2025)

Sparsity is Combinatorial Depth: Quantifying MoE Expressivity via Tropical Geometry
par: Su, Ye, et autres
Publié: (2026)

Weak-to-Strong Generalization with Failure Trajectories: A Tree-based Approach to Elicit Optimal Policy in Strong Models
par: Ye, Ruimeng, et autres
Publié: (2025)

Generalization Error of $f$-Divergence Stabilized Algorithms via Duality
par: Daunas, Francisco, et autres
Publié: (2025)

Minimizing $f$-Divergences by Interpolating Velocity Fields
par: Liu, Song, et autres
Publié: (2023)

$f$-Divergence Regularized RLHF: Two Tales of Sampling and Unified Analyses
par: Wu, Di, et autres
Publié: (2026)

SteinGen: Generating Fidelitous and Diverse Graph Samples
par: Reinert, Gesine, et autres
Publié: (2024)

CLID-MU: Cross-Layer Information Divergence Based Meta Update Strategy for Learning with Noisy Labels
par: Hu, Ruofan, et autres
Publié: (2025)

Theoretical Analysis of Weak-to-Strong Generalization
par: Lang, Hunter, et autres
Publié: (2024)

Quantifying the Gain in Weak-to-Strong Generalization
par: Charikar, Moses, et autres
Publié: (2024)

Regularized $f$-Divergence Kernel Tests
par: Ribero, Mónica, et autres
Publié: (2026)

On the Mechanisms of Weak-to-Strong Generalization: A Theoretical Perspective
par: Moniri, Behrad, et autres
Publié: (2025)

Provable Weak-to-Strong Generalization via Benign Overfitting
par: Wu, David X., et autres
Publié: (2024)

Weak-to-Strong Generalization is Nearly Inevitable (in Linear Models)
par: Geng, Scott, et autres
Publié: (2026)

Two Facets of SDE Under an Information-Theoretic Lens: Generalization of SGD via Training Trajectories and via Terminal States
par: Wang, Ziqiao, et autres
Publié: (2022)

Efficient 4D fMRI ASD Classification using Spatial-Temporal-Omics-based Learning Framework
par: Weng, Ziqiao, et autres
Publié: (2025)

Weak-to-Strong Generalization under Distribution Shifts
par: Jeon, Myeongho, et autres
Publié: (2025)

Empirical Risk Minimization with $f$-Divergence Regularization
par: Daunas, Francisco, et autres
Publié: (2026)

Weak-to-Strong Generalization Even in Random Feature Networks, Provably
par: Medvedev, Marko, et autres
Publié: (2025)

f-GRPO and Beyond: Divergence-Based Reinforcement Learning Algorithms for General LLM Alignment
par: Haldar, Rajdeep, et autres
Publié: (2026)

Effective Frontiers: A Unification of Neural Scaling Laws
par: Zou, Jiaxuan, et autres
Publié: (2026)

Partition Function Estimation under Bounded f-Divergence
par: Block, Adam, et autres
Publié: (2026)

Displacement-Resistant Extensions of DPO with Nonconvex $f$-Divergences
par: Pipano, Idan, et autres
Publié: (2026)

The Mechanism of Weak-to-Strong Generalization: Feature Elicitation from Latent Knowledge
par: Awano, Ryoya, et autres
Publié: (2026)

Generalizing Trust: Weak-to-Strong Trustworthiness in Language Models
par: Pawelczyk, Martin, et autres
Publié: (2024)

Weak-to-Strong Generalization Through the Data-Centric Lens
par: Shin, Changho, et autres
Publié: (2024)