Abstract: In many situations, one needs to decide between acting to reveal data about a system and acting to generate profit; this is the trade-off between exploration and exploitation. A simple situation where we face this trade-off is a multiarmed bandit problem, where one has M ‘bandits’ which generate reward from an unknown distribution, and one must choose which bandit to play at each time. The key difficulty in the multi-armed bandit problem is that the action often affects the information obtained. Due to the curse of dimensionality, solving the bandit problem directly is often computationally intractable.

In this talk, we will formulate a general class of the multi-armed bandit problem as a relaxed stochastic control problem. By introducing an entropy premium, we obtain a smooth asymptotic approximation to the value function. This yields a novel semi-index approximation of the optimal decision process, obtained numerically by solving a fixed point problem, which can be interpreted as explicitly balancing an exploration–exploitation trade-off.  Performance of the resulting Asymptotic Randomised Control (ARC) algorithm compares favourably with other approaches to correlated multi-armed bandits.

As an application of the multi-armed bandit, we also consider a multi-armed bandit problem where the observation from each bandit arrive from a Generalised Linear Model. We then use such model to consider a dynamic online pricing problem. The numerical simulation shows that the ARC algorithm also performs well compared to others.
============

One of the very unique properties of AdS_3 spacetimes is that we can introduce a finite number of massless higher spin fields without yielding an inconsistent theory. In this talk, we would like to comment on what the spectrum of these theories looks like: from the known contribution of the light spectrum, that corresponds to the vacuum character of the W_N algebra, we can use modular invariance to constraint the heavy spectrum of the theory. However, in doing so, we find negative norm states, inconsistent with unitarity. We propose a possible cure by adding light states that can be interpreted as massive particles with a conical defect associated to them, and study what scenario we are left with. The results that we will revisit are those presented in 2009.01830. 

Simple mathematical models have had remarkable successes in biology, framing how we understand a host of mechanisms and processes. However, with the advent of a host of new experimental technologies, the last ten years has seen an explosion in the amount and types of quantitative data now being generated. This sets a new challenge for the field – to develop, calibrate and analyse new, biologically realistic models to interpret these data. In this talk I will showcase how quantitative comparisons between models and data can help tease apart subtle details of biological mechanisms, as well as present some steps we have taken to tackle the mathematical challenges in developing models that are both identifiable and can be efficiently calibrated to quantitative data.