Group-invariant tensor train networks for supervised learning
Abstract
Invariance under selected transformations has recently proven to be a powerful inductive bias in several machine learning models. One class of such models are tensor train networks. In this talk, we impose invariance relations on tensor train networks. We introduce a new numerical algorithm to construct a basis of tensors that are invariant under the action of normal matrix representations of an arbitrary discrete group. This method can be up to several orders of magnitude faster than previous approaches. The group-invariant tensors are then combined into a group-invariant tensor train network, which can be used as a supervised machine learning model. We applied this model to a protein binding classification problem, taking into account problem-specific invariances, and obtained prediction accuracy in line with state-of-the-art invariant deep learning approaches. This is joint work with Brent Sprangers.
appendix with Dawid Kielak
Nonlinear Fokker-Planck equations modelling large networks of neurons
Abstract
We will start from the description of a particle system modelling a finite size network of interacting neurons described by their voltage. After a quick description of the non-rigorous and rigorous mean-field limit results, we will do a detailed analytical study of the associated Fokker-Planck equation, which will be the occasion to introduce in context powerful general methods like the reduction to a free boundary Stefan-like problem, the relative entropy methods, the study of finite time blowup and the numerical and theoretical exploration of periodic solutions for the delayed version of the model. I will then present some variants and related models, like nonlinear kinetic Fokker-Planck equations and continuous systems of Fokker-Planck equations coupled by convolution.
Sessions led by Dr Pierre Roux will take place on
30 May 2023 10:00 - 12:00 C2
6 June 2023 15:00 - 17:00 C2
8 June 2023 10:00 - 12:00 C2
13 June 2023 15:00 - 17:00 C2
Participants should have a good knowledge of Functional Analysis; basic knowledge about PDEs and distributions; and notions in probability. Should you be interested in taking part in the course, please send an email to @email.
Nonlinear Fokker-Planck equations modelling large networks of neurons
Abstract
We will start from the description of a particle system modelling a finite size network of interacting neurons described by their voltage. After a quick description of the non-rigorous and rigorous mean-field limit results, we will do a detailed analytical study of the associated Fokker-Planck equation, which will be the occasion to introduce in context powerful general methods like the reduction to a free boundary Stefan-like problem, the relative entropy methods, the study of finite time blowup and the numerical and theoretical exploration of periodic solutions for the delayed version of the model. I will then present some variants and related models, like nonlinear kinetic Fokker-Planck equations and continuous systems of Fokker-Planck equations coupled by convolution.
Sessions led by Dr Pierre Roux will take place on
30 May 2023 10:00 - 12:00 C2
6 June 2023 15:00 - 17:00 C2
8 June 2023 10:00 - 12:00 C2
13 June 2023 15:00 - 17:00 C2
Participants should have a good knowledge of Functional Analysis; basic knowledge about PDEs and distributions; and notions in probability. Should you be interested in taking part in the course, please send an email to @email.
Nonlinear Fokker-Planck equations modelling large networks of neurons
Abstract
We will start from the description of a particle system modelling a finite size network of interacting neurons described by their voltage. After a quick description of the non-rigorous and rigorous mean-field limit results, we will do a detailed analytical study of the associated Fokker-Planck equation, which will be the occasion to introduce in context powerful general methods like the reduction to a free boundary Stefan-like problem, the relative entropy methods, the study of finite time blowup and the numerical and theoretical exploration of periodic solutions for the delayed version of the model. I will then present some variants and related models, like nonlinear kinetic Fokker-Planck equations and continuous systems of Fokker-Planck equations coupled by convolution.
Sessions led by Dr Pierre Roux will take place on
30 May 2023 10:00 - 12:00 C2
6 June 2023 15:00 - 17:00 C2
8 June 2023 10:00 - 12:00 C2
13 June 2023 15:00 - 17:00 C2
Participants should have a good knowledge of Functional Analysis; basic knowledge about PDEs and distributions; and notions in probability. Should you be interested in taking part in the course, please send an email to @email.
Nonlinear Fokker-Planck equations modelling large networks of neurons
Abstract
We will start from the description of a particle system modelling a finite size network of interacting neurons described by their voltage. After a quick description of the non-rigorous and rigorous mean-field limit results, we will do a detailed analytical study of the associated Fokker-Planck equation, which will be the occasion to introduce in context powerful general methods like the reduction to a free boundary Stefan-like problem, the relative entropy methods, the study of finite time blowup and the numerical and theoretical exploration of periodic solutions for the delayed version of the model. I will then present some variants and related models, like nonlinear kinetic Fokker-Planck equations and continuous systems of Fokker-Planck equations coupled by convolution.
30 May 2023 10:00 - 12:00 C2
6 June 2023 15:00 - 17:00 C2
8 June 2023 10:00 - 12:00 C2
13 June 2023 15:00 - 17:00 C2
Participants should have a good knowledge of Functional Analysis; basic knowledge about PDEs and distributions; and notions in probability. Should you be interested in taking part in the course, please send an email to @email.
applications
Modelling the impact of rock heterogeneity on geological CO2 storage
Abstract
Permanent geological carbon storage will reduce greenhouse gas emissions and help mitigate climate change. Storage security is increased by CO2 capillary trapping in cm-to-m scale, layered rock heterogeneities; features that are ubiquitous across storage sites worldwide. This talk will outline the challenges associated with modelling the impact of small-scale heterogeneity on large scale saturation distributions and trapping during geological CO2 storage, including the difficulties in incorporating petrophysical and geological uncertainty into field-scale numerical models. Experimental results demonstrate the impact of cm-scale heterogeneity on pore-scale processes, which in turn influence large scale behaviour. Heterogeneity is shown to have a leading order impact on saturation distribution and storage capacity during geological CO2 storage.