Thu, 06 May 2021
14:00
Virtual

A proximal quasi-Newton trust-region method for nonsmooth regularized optimization

Dominique Orban
(École Polytechnique Montréal)
Abstract

We develop a trust-region method for minimizing the sum of a smooth term f and a nonsmooth term h, both of which can be nonconvex. Each iteration of our method minimizes a possibly nonconvex model of f+h in a trust region. The model coincides with f+h in value and subdifferential at the center. We establish global convergence to a first-order stationary point when f satisfies a smoothness condition that holds, in particular, when it has Lipschitz-continuous gradient, and h is proper and lower semi-continuous. The model of h is required to be proper, lower-semi-continuous and prox-bounded. Under these weak assumptions, we establish a worst-case O(1/ε^2) iteration complexity bound that matches the best known complexity bound of standard trust-region methods for smooth optimization. We detail a special instance in which we use a limited-memory quasi-Newton model of f and compute a step with the proximal gradient method, resulting in a practical proximal quasi-Newton method. We describe our Julia implementations and report numerical results on inverse problems from sparse optimization and signal processing. Our trust-region algorithm exhibits promising performance and compares favorably with linesearch proximal quasi-Newton methods based on convex models.

This is joint work with Aleksandr Aravkin and Robert Baraldi.

-

A link for this talk will be sent to our mailing list a day or two in advance.  If you are not on the list and wish to be sent a link, please contact @email.

Mathematical Models in Population Genetics
Barton, N Etheridge, A Handbook of Statistical Genomics 115-120 (29 Jul 2019)
Mon, 29 Mar 2021

16:00 - 17:00
Virtual

Intro to Lawrence-Venkatesh's proof of Mordell-Faltings

Jay Swar
Abstract

This talk will be the first in a spin-off series on the Lawrence-Venkatesh approach to showing that every hyperbolic curve$/K$ has finitely many $K$-points. In this talk, we will give the overall outline of the approach and prove several of  the preliminary results, such as Faltings' finiteness theorem for semisimple Galois representations.

Subscribe to