Understanding the Behaviour of Large Networks
Abstract
tba
tba
I will discuss some new results on the Iwasawa theory for the $3$-dimensional symmetric square Galois representation of a modular form, using the Euler system of Beilinson-Flach elements I constructed in joint work with Kings, Lei and Loeffler.
We describe how cross-kernel matrices, that is, kernel matrices between the data and a custom chosen set of `feature spanning points' can be used for learning. The main potential of cross-kernel matrices is that (a) they provide Nyström-type speed-ups for kernel learning without relying on subsampling, thus avoiding potential problems with sampling degeneracy, while preserving the usual approximation guarantees and the attractive linear scaling of standard Nyström methods and (b) the use of non-square matrices for kernel learning provides a non-linear generalization of the singular value decomposition and singular features. We present a novel algorithm, Ideal PCA (IPCA), which is a cross-kernel matrix variant of PCA, showcasing both advantages: we demonstrate on real and synthetic data that IPCA allows to (a) obtain kernel PCA-like features faster and (b) to extract novel features of empirical advantage in non-linear manifold learning and classification.
We consider three nonparametric hypothesis testing problems: (1) Given samples from distributions p and q, a homogeneity test determines whether to accept or reject p=q; (2) Given a joint distribution p_xy over random variables x and y, an independence test investigates whether p_xy = p_x p_y, (3) Given a joint distribution over several variables, we may test for whether there exist a factorization (e.g., P_xyz = P_xyP_z, or for the case of total independence, P_xyz=P_xP_yP_z).
We present nonparametric tests for the three cases above, based on distances between embeddings of probability measures to reproducing kernel Hilbert spaces (RKHS), which constitute the test statistics (eg for independence, the distance is between the embedding of the joint, and that of the product of the marginals). The tests benefit from years of machine research on kernels for various domains, and thus apply to distributions on high dimensional vectors, images, strings, graphs, groups, and semigroups, among others. The energy distance and distance covariance statistics are also shown to fall within the RKHS family, when semimetrics of negative type are used. The final test (3) is of particular interest, as it may be used in detecting cases where two independent causes individually have weak influence on a third dependent variable, but their combined effect has a strong influence, even when these variables have high dimension.
I will explain some recent joint work with Georgios Dimitroglou Rizell in which we use moduli spaces of holomorphic discs with boundary on a monotone Lagrangian torus in ${\mathbb C}^n$ to prove that all such tori are smoothly isotopic when $n$ is odd and at least 5
We discuss the problem of estimating a structured matrix with a large number of elements. A key motivation for this problem occurs in multi-task learning. In this case, the columns of the matrix correspond to the parameters of different regression or classification tasks, and there is structure due to relations between the tasks. We present a general method to learn the tasks' parameters as well as their structure. Our approach is based on solving a convex optimization problem, involving a data term and a penalty term. We highlight different types of penalty terms which are of practical and theoretical importance. They implement structural relations between the tasks and achieve a sparse representations of parameters. We address computational issues as well as the predictive performance of the method. Finally we discuss how these ideas can be extended to learn non-linear task functions by means of reproducing kernels.
Nonnormality is a well studied subject in the context of partial differential operators. Yet, only little is known for boundary integral operators. The only well studied case is the unit ball, where the standard single layer, double layer and conjugate double layer potential operators in acoustic scattering diagonalise in a unitary basis. In this talk we present recent results for the analysis of spectral decompositions and nonnormality of boundary integral operators on more general domains. One particular application is the analysis of stability constants for boundary element discretisations. We demonstrate how these are effected by nonnormality and give several numerical examples, illustrating these issues on various domains.