Cover Image

Understanding Forgetting in LLM Supervised Fine-Tuning and Preference Learning -- A Convex Optimization Perspective

Fuente: arXiv

Saved in:

Bibliographic Details
Main Authors:	Fernando, Heshan, Shen, Han, Ram, Parikshit, Zhou, Yi, Samulowitz, Horst, Baracaldo, Nathalie, Chen, Tianyi
Format:	Preprint
Published:	2024
Subjects:	Machine Learning Artificial Intelligence Computation and Language Optimization and Control
Online Access:	Acceder al recurso
Tags:	Add Tag No Tags, Be the first to tag this record!

Similar Items

Balancing Multi-modal Sensor Learning via Multi-objective Optimization
by: Fernando, Heshan, et al.
Published: (2025)

Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach
by: Fernando, Heshan, et al.
Published: (2022)

Parameter-Efficient Subspace Optimization for LLM Fine-Tuning
by: Lou, Yuchen, et al.
Published: (2025)

Enhancing In-context Learning via Linear Probe Calibration
by: Abbas, Momin, et al.
Published: (2024)

A Geometric Perspective on Polynomially Solvable Convex Maximization
by: Han, Shaoning, et al.
Published: (2026)

Optimistic Safety for Online Convex Optimization with Unknown Linear Constraints
by: Hutchinson, Spencer, et al.
Published: (2024)

A Proximal Descent Method for Minimizing Weakly Convex Optimization
by: Liao, Feng-Yi, et al.
Published: (2025)

Zero-Order Optimization for LLM Fine-Tuning via Learnable Direction Sampling
by: Parfenov, Valery, et al.
Published: (2026)

Variable Aggregation-based Perspective Reformulation for Mixed-Integer Convex Optimization with Symmetry
by: Wu, Junhao, et al.
Published: (2026)

Piecewise Linearization of Quadratic Branch Flow Limits by Irregular Polygon
by: Pareek, Parikshit, et al.
Published: (2018)

Policy Optimization in Robust Control: Weak Convexity and Subgradient Methods
by: Watanabe, Yuto, et al.
Published: (2025)

Asymmetric Feedback Learning in Online Convex Games
by: Wang, Zifan, et al.
Published: (2023)

AdaBB: Adaptive Barzilai-Borwein Method for Convex Optimization
by: Zhou, Danqing, et al.
Published: (2024)

Differentiable Convex Optimization Layers in Neural Architectures: Foundations and Perspectives
by: Katyal, Calder
Published: (2024)

Contaminated Online Convex Optimization
by: Kamijima, Tomoya, et al.
Published: (2024)

Mirror Duality in Convex Optimization
by: Kim, Jaeyeon, et al.
Published: (2023)

Geometric Foundations of Tuning without Forgetting in Neural ODEs
by: Bayram, Erkan, et al.
Published: (2025)

FERERO: A Flexible Framework for Preference-Guided Multi-Objective Learning
by: Chen, Lisha, et al.
Published: (2024)

Distributed Adaptive Gradient Algorithm with Gradient Tracking for Stochastic Non-Convex Optimization
by: Han, Dongyu, et al.
Published: (2024)

New Outer Approximation Algorithms for Nonsmooth Convex MINLP Problems
by: Wei, Zhou, et al.
Published: (2026)

Are Convex Optimization Curves Convex?
by: Barzilai, Guy, et al.
Published: (2025)

Distributed Event-Triggered Bandit Convex Optimization with Time-Varying Constraints
by: Zhang, Kunpeng, et al.
Published: (2024)

Polyak Minorant Method for Convex Optimization
by: Devanathan, Nikhil, et al.
Published: (2023)

Cooling Under Convexity: An Inventory Control Perspective on Industrial Refrigeration
by: Shah, Vade, et al.
Published: (2025)

Robust Online Convex Optimization for Disturbance Rejection
by: Lai, Joyce, et al.
Published: (2024)

Convex Synthesis of First-Order Methods for Time-Varying Smooth Strongly Convex Optimization
by: Van Scoy, Bryan, et al.
Published: (2026)

Convex Chance-Constrained Programs with Wasserstein Ambiguity
by: Shen, Haoming, et al.
Published: (2021)

Lagrangian Dual Sections: A Topological Perspective on Hidden Convexity
by: Chandrasekaran, Venkat, et al.
Published: (2025)

Nonlinear Optimization Filters for Stochastic Time-Varying Convex Optimization
by: Simonetto, Andrea, et al.
Published: (2023)

Joint Inference of Trajectory and Obstacle in Mean-Field Games via Bilevel Optimization
by: Huang, Han, et al.
Published: (2025)

Convex Submodular Minimization with Indicator Variables
by: Gomez, Andres, et al.
Published: (2025)

Convex Submodular Minimization with Indicator Variables
by: Han, Shaoning, et al.
Published: (2022)

Regularization in Data-driven Predictive Control: A Convex Relaxation Perspective
by: Shang, Xu, et al.
Published: (2025)

Accelerated Backward Forward Method for Convex Optimization
by: Wang, Zepeng, et al.
Published: (2026)

Optimal Decentralized Composite Optimization for Convex Functions
by: Ye, Haishan, et al.
Published: (2023)

Universal Gradient Methods for Stochastic Convex Optimization
by: Rodomanov, Anton, et al.
Published: (2024)

Broximal Alignment for Global Non-Convex Optimization
by: Gruntkowska, Kaja, et al.
Published: (2026)

Gradient Descent for Convex and Smooth Noisy Optimization
by: Hu, Feifei, et al.
Published: (2024)

Adaptive Clutter Suppression via Convex Optimization
by: He, Yifan, et al.
Published: (2025)

Subgradient Gliding Method for Nonsmooth Convex Optimization
by: Zhu, Zhihan, et al.
Published: (2026)