Computing Multiple Image Reconstructions with a Single Hypernetwork

Alan Q. Wang1,2, Adrian V. Dalca3,4, Mert R. Sabuncu1,2
1: Cornell Tech, New York, 2: Weill Cornell Medical School, New York, 3: Massachusetts Institute of Technology, 4: Massachusetts General Hospital,
June 2022 issue
Publication date: 2022/06/16
PDF · arXiv · Code

Abstract

Deep learning based techniques achieve state-of-the-art results in a wide range of image reconstruction tasks like compressed sensing. These methods almost always have hyperparameters, such as the weight coefficients that balance the different terms in the optimized loss function. The typical approach is to train the model for a hyperparameter setting determined with some empirical or theoretical justification. Thus, at inference time, the model can only compute reconstructions corresponding to the pre-determined hyperparameter values. In this work, we present a hypernetwork-based approach, called HyperRecon, to train reconstruction models that are agnostic to hyperparameter settings. At inference time, HyperRecon can efficiently produce diverse reconstructions, which would each correspond to different hyperparameter values. In this framework, the user is empowered to select the most useful output(s) based on their own judgement. We demonstrate our method in compressed sensing, super-resolution and denoising tasks, using two large-scale and publicly-available MRI datasets. Our code is available at https://github.com/alanqrwang/hyperrecon.

Keywords

Computer Vision · Pattern Recognition · MRI reconstruction

Bibtex @article{melba:2022:017:wang, title = "Computing Multiple Image Reconstructions with a Single Hypernetwork", author = "Wang, Alan Q. and Dalca, Adrian V. and Sabuncu, Mert R.", journal = "Machine Learning for Biomedical Imaging", volume = "1", issue = "June 2022 issue", year = "2022", issn = "2766-905X", url = "https://melba-journal.org/papers/2022:017.html" }
RISTY - JOUR AU - Wang, Alan Q. AU - Dalca, Adrian V. AU - Sabuncu, Mert R. PY - 2022 TI - Computing Multiple Image Reconstructions with a Single Hypernetwork T2 - Machine Learning for Biomedical Imaging VL - 1 IS - June 2022 issue SN - 2766-905X UR - https://www.melba-journal.org/papers/2022:017.html ER -

2022:017 cover