15:30
Higher Order Lipschitz Functions in Data Science
Abstract
The notion of Lip(gamma) Functions, for a parameter gamma > 0, introduced by Stein in the 1970s (building on earlier work of Whitney) is a notion of smoothness that is well-defined on arbitrary closed subsets (including, in particular, finite subsets) that is instrumental in the area of Rough Path Theory initiated by Lyons and central in recent works of Fefferman. Lip(gamma) functions provide a higher order notion of Lipschitz regularity that is well-defined on arbitrary closed subsets, and interacts well with the more classical notion of smoothness on open subsets. In this talk we will survey the historical development of Lip(gamma) functions and illustrate some fundamental properties that make them an attractive class of function to work with from a machine learning perspective. In particular, models learnt within the class of Lip(gamma) functions are well-suited for both inference on new unseen input data, and for allowing cost-effective inference via the use of sparse approximations found via interpolation-based reduction techniques. Parts of this talk will be based upon the works https://arxiv.org/abs/2404.06849 and https://arxiv.org/abs/2406.03232.