Monte Carlo integration: variance reduction by function approximation
Abstract
Classical algorithms for numerical integration (quadrature/cubature) proceed by approximating the integrand with a simple function (e.g. a polynomial), and integrate the approximant exactly. In high-dimensional integration, such methods quickly become infeasible due to the curse of dimensionality.
A common alternative is the Monte Carlo method (MC), which simply takes the average of random samples, improving the estimate as more and more samples are taken. The main issue with MC is its slow "sqrt(variance/#samples)" convergence, and various techniques have been proposed to reduce the variance.
In this work we reveal a numerical analyst's interpretation of MC: it approximates the integrand with a simple(st) function, and integrates that function exactly. This observation leads naturally to MC-like methods that combines MC with function approximation theory, including polynomial approximation and sparse grids. The resulting method can be regarded as another variance reduction technique for Monte Carlo.
Oxford Mathematics now has up to 50 fully-funded studentships available each year for doctoral degrees. All home, EU and overseas applicants are eligible to apply – up to 20 studentships each year will be available to applicants regardless of nationality.
Find out more about postgraduate study and research life in Oxford.
The Oxford Master’s in Mathematical Sciences (or 'OMMS') is now admitting students to start in October 2018. This new master’s degree is run jointly by the Mathematical Institute and the Department of Statistics at the University of Oxford. For the first time we are able to offer students from across the world a masters course that draws on the full range of our research across the mathematical sciences, from fundamental themes in the core to interdisciplinary applications.