Machine Learning and Data Science Seminar

Recent years have witnessed a surge of interest in deep learning methods to tackle inverse problems arising in various domains such as medical imaging, remote sensing, and the arts and humanities. This talk offers an overview of recent advances in the foundations and applications of deep learning for inverse problems, with a focus on model-based deep learning methods. Concretely, this talk will overview our work relating to theoretical advances in the area of mode-based learning, including learning guarantees; algorithmic advances in model-based learning; and, finally it will showcase a portfolio of emerging signal & image processing challenges that benefit from model based learning, including image separation / deconvolution challenges arising in the arts and humanities.

Bio:

Miguel Rodrigues is a Professor of Information Theory and Processing at University College London; he leads the Information, Inference and Machine Learning Lab at UCL, and he has also been the founder and director of the master programme in Integrated Machine Learning Systems at UCL. He has also been the UCL Turing University Lead and a Turing Fellow with the Alan Turing Institute — the UK National Institute of Data Science and Artificial Intelligence.

He held various appointments with various institutions worldwide including Cambridge University, Princeton University, Duke University, and the University of Porto, Portugal. He obtained the undergraduate degree in Electrical and Computer Engineering from the Faculty of Engineering of the University of Porto, Portugal and the PhD degree in Electronic and Electrical Engineering from University College London.

Dr. Rodrigues's research lies in the general areas of information theory, information processing, and machine learning. His most relevant contributions have ranged from the information-theoretic analysis and design of communications systems, information-theoretic security, information-theoretic analysis and design of sensing systems, and the information-theoretic foundations of machine learning.

He serves or has served as Editor of IEEE BITS, Editor of the IEEE Transactions on Information Theory, and Lead Guest Editor of various Special Issues of the IEEE Journal on Selected Topics in Signal Processing, Information and Inference, and Foundations and Trends in Signal Processing.

Dr. Rodrigues has been the recipient of various prizes and awards including the Prize for Merit from the University of Porto, the Prize Engenheiro Cristian Spratley, the Prize Engenheiro Antonio de Almeida, fellowships from the Portuguese Foundation for Science and Technology, and fellowships from the Foundation Calouste Gulbenkian. Dr. Rodrigues research on information-theoretic security has also attracted the IEEE Communications and Information Theory Societies Joint Paper Award 2011.  

He has also been elevated to Fellow of the Institute of Electronics and Electrical Engineers (IEEE) for his contributions to the ‘multi-modal data processing and reliable and secure communications.’

The accurate semantic segmentation of individual tree crowns within remotely sensed data is crucial for scientific endeavours such as forest management, biodiversity studies, and carbon sequestration quantification. However, precise segmentation remains challenging due to complexities in the forest canopy, including shadows, intricate backgrounds, scale variations, and subtle spectral differences among tree species. While deep learning models improve accuracy by learning hierarchical features, they often fail to effectively capture fine-grained details and long-range dependencies within complex forest canopies.

This seminar introduces PerceptiveNet, a novel model that incorporates a Logarithmic Gabor-implemented convolutional layer alongside a backbone designed to extract salient features while capturing extensive context and spatial information through a wider receptive field. The presentation will explore the impact of Log-Gabor, Gabor, and standard convolutional layers on semantic segmentation performance, providing a comprehensive analysis of experimental findings. An ablation study will assess the contributions of individual layers and their interactions to overall model effectiveness. Furthermore, PerceptiveNet will be evaluated as a backbone within a hybrid CNN-Transformer model, demonstrating how improved feature representation and long-range dependency modelling enhance segmentation accuracy.

I will present some ongoing work on solving parametric linear systems arising from the application of the finite elements method on elliptic partial differential trial equations. The focus of the talk will be on leveraging randomised numerical linear algebra to solve these equations in high-dimensional parameter spaces with special emphasis on the multi-query context where optimal sampling is not practical. In this context I will discuss some ideas on choosing a suitable low-dimensional approximation of the solution, as well as reducing the variance of the sketched systems. This research aims at exploring the potential of randomisation as a probabilistic framework for model order reduction, with potential applications to online simulations, uncertainty quantification and inverse problems, via the research grant EPSRC EP/V028618/1

Bio: Nick Polydorides is a professor in computational engineering at the University of Edinburgh and has interests in randomised numerical linear algebra, inverse problems and edge computing. Previously, he was a faculty at the Cyprus Institute, and a postdoctoral fellow at MIT’s lab for Information and Decision Systems. He has a PhD in Electrical Engineering from the University of Manchester.