Patch-based Medical Image Segmentation using Matrix Product State Tensor Networks

Raghavendra SelvanUniversity of Copenhagen, Erik B DamUniversity of Copenhagen, Søren Alexander FlensborgUniversity of Copenhagen, Jens Petersen
Rigshospitalet, Denmark
IPMI 2021 special issue
Publication date: 2022/02/24
PDF · arXiv · Video · Code


Tensor networks are efficient factorisations of high dimensional tensors into network of lower order tensors. They have been most commonly used to model entanglement in quantum many-body systems and more recently are witnessing increased applications in supervised machine learning. In this work, we formulate image segmentation in a supervised setting with tensor networks. The key idea is to first lift the pixels in image patches to exponentially high dimensional feature spaces and using a linear decision hyper-plane to classify the input pixels into foreground and background classes. The high dimensional linear model itself is approximated using the matrix product state (MPS) tensor network. The MPS is weight-shared between the non-overlapping image patches resulting in our strided tensor network model. The performance of the proposed model is evaluated on three three 2D- and one 3D- biomedical imaging datasets. The performance of the proposed tensor network segmentation model is compared with relevant baseline methods. In the 2D experiments, the tensor network model yeilds competitive performance compared to the baseline methods while being more resource efficient.


segmentation · quantum tensor networks · linear models

Bibtex @article{melba:2022:005:selvan, title = "Patch-based Medical Image Segmentation using Matrix Product State Tensor Networks", authors = "Selvan, Raghavendra and Dam, Erik B and Flensborg, Søren Alexander and Petersen, Jens", journal = "Machine Learning for Biomedical Imaging", volume = "1", issue = "IPMI 2021 special issue", year = "2022" }

2022:005 cover