Locally orderless tensor networks for classifying two- and three-dimensional medical images

Raghavendra Selvan1,20000-0003-4302-0207, Silas Ørting1, Erik B Dam1
1: Department of Computer Science, University of Copenhagen, Denmark, 2: Department of Neuroscience, University of Copenhagen, Denmark
Publication date: 2021/03/23
https://doi.org/10.59275/j.melba.2021-g65b
PDF · Code · Video · arXiv

Abstract

Tensor networks are factorisations of high rank tensors into networks of lower rank tensors and have primarily been used to analyse quantum many-body problems. Tensor networks have seen a recent surge of interest in relation to supervised learning tasks with a focus on image classification. In this work, we improve upon the matrix product state (MPS) tensor networks that can operate on one-dimensional vectors to be useful for working with 2D and 3D medical images. We treat small image regions as orderless, squeeze their spatial information into feature dimensions and then perform MPS operations on these locally orderless regions. These local representations are then aggregated in a hierarchical manner to retain global structure. The proposed locally orderless tensor network (LoTeNet) is compared with relevant methods on three datasets. The architecture of LoTeNet is fixed in all experiments and we show it requires lesser computational resources to attain performance on par or superior to the compared methods.

Keywords

tensor networks · image classification · histopathology · computed tomography · mri

Bibtex @article{melba:2021:005:selvan, title = "Locally orderless tensor networks for classifying two- and three-dimensional medical images", author = "Selvan, Raghavendra and Ørting, Silas and Dam, Erik B", journal = "Machine Learning for Biomedical Imaging", volume = "1", issue = "MIDL 2020 special issue", year = "2021", pages = "1--21", issn = "2766-905X", doi = "https://doi.org/10.59275/j.melba.2021-g65b", url = "https://melba-journal.org/2021:005" }
RISTY - JOUR AU - Selvan, Raghavendra AU - Ørting, Silas AU - Dam, Erik B PY - 2021 TI - Locally orderless tensor networks for classifying two- and three-dimensional medical images T2 - Machine Learning for Biomedical Imaging VL - 1 IS - MIDL 2020 special issue SP - 1 EP - 21 SN - 2766-905X DO - https://doi.org/10.59275/j.melba.2021-g65b UR - https://melba-journal.org/2021:005 ER -

2021:005 cover