Saved in:
Bibliographic Details
Main Authors: Bégout, Pascal, Bolte, Jérôme, Mariotti, Thomas, Silva, Francisco
Format: Preprint
Published: 2026
Subjects:
Online Access:https://arxiv.org/abs/2604.11213
Tags: Add Tag
No Tags, Be the first to tag this record!
_version_ 1866915934640275456
author Bégout, Pascal
Bolte, Jérôme
Mariotti, Thomas
Silva, Francisco
author_facet Bégout, Pascal
Bolte, Jérôme
Mariotti, Thomas
Silva, Francisco
contents Gradient extremals are loci along which the gradient is an eigenvector of the Hessian. These objects provide a natural geometric framework connecting several notions, notably valleys and talwegs, which we analyze from a variational viewpoint in the generic case. We then show that trajectories of the gradient flow and of its discrete counterpart exhibit directional alignment with the tangent spaces to gradient extremals, and generically to the talweg. Under non-resonance assumptions, and in contrast with the quadratic case, alignment rates are governed either by the first spectral gap or by the smallest eigenvalue of the Hessian at the limit point. Nonlinearities and the step length may both distort these rates in a complex manner. We further prove a volume concentration phenomenon emphasizing the structuring role of gradient extremals: for large times, the images of sets of initial conditions concentrate inside valleys and asymptotically around talwegs.
format Preprint
id arxiv_https___arxiv_org_abs_2604_11213
institution arXiv
publishDate 2026
record_format arxiv
spellingShingle Gradient extremals, talwegs, valleys, and directional alignment for generic gradient descent
Bégout, Pascal
Bolte, Jérôme
Mariotti, Thomas
Silva, Francisco
Optimization and Control
Gradient extremals are loci along which the gradient is an eigenvector of the Hessian. These objects provide a natural geometric framework connecting several notions, notably valleys and talwegs, which we analyze from a variational viewpoint in the generic case. We then show that trajectories of the gradient flow and of its discrete counterpart exhibit directional alignment with the tangent spaces to gradient extremals, and generically to the talweg. Under non-resonance assumptions, and in contrast with the quadratic case, alignment rates are governed either by the first spectral gap or by the smallest eigenvalue of the Hessian at the limit point. Nonlinearities and the step length may both distort these rates in a complex manner. We further prove a volume concentration phenomenon emphasizing the structuring role of gradient extremals: for large times, the images of sets of initial conditions concentrate inside valleys and asymptotically around talwegs.
title Gradient extremals, talwegs, valleys, and directional alignment for generic gradient descent
topic Optimization and Control
url https://arxiv.org/abs/2604.11213