Seminar series
Date
Mon, 06 May 2024
Time
14:00 -
15:00
Location
Lecture Room 3
Speaker
Boris Hanin
Organisation
Princeton University
This talk, based on joint work with Alexander Zlokapa, concerns Bayesian inference with neural networks.
I will begin by presenting a result giving exact non-asymptotic formulas for Bayesian posteriors in deep linear networks. A key takeaway is the appearance of a novel scaling parameter, given by # data * depth / width, which controls the effective depth of the posterior in the limit of large model and dataset size.
Additionally, I will explain some quite recent results on the role of this effective depth parameter in Bayesian inference with deep non-linear neural networks that have shaped activations.