Nicolas Boumal (EPFL)
GT « Analyse, Algorithmique, Apprentissage »
Nicolas Boumal (EPFL) Title: The center-stable manifold theorem for saddle avoidance, with all the details Abstract: Gradient descent (with random initialization) almost surely avoids convergence to a (strict) saddle point. The now standard proof of that fact relies on the center-stable manifold theorem. That is an old result in dynamical systems. It is powerful, but also rigid; and the […]