Adaptive Optics Mediated Sub-Pixel Super Resolution

Sub-Pixel Super Resolution (SPSR) is an established technique for extracting high-resolution information by combining multiple low-resolution images. Typically these images are related by very small, known deformations along the sensor plane and can be analytically reconstructed into one large image. Unlike previous methods which largely rely on naturally occurring changes to the optical system (e.g., hand-shake, rotations, etc.) adaptive optics (AO) systems are capable of inducing customized optical changes at very high temporal resolutions. We propose a method for SPSR which leverages the AO deformable mirror by finding the optimal phases for sub-pixel shifting. We accomplish this by end-to-end optimization of the phase and super resolution method while taking into account the underlying optical system. This technique can be applied to both analytical and state of the art deep learning methods.