Circle Representation for Medical Instance Object Segmentation

Juming Xiong1, Ethan H. Nguyen2, Yilin Liu2, Ruining Deng2, Regina N Tyree3, Hernan Correa4, Girish Hiremath3, Yaohong Wang4, Haichun Yang4, Agnes B. Fogo4, Yuankai Huo1,2,4
1: Department of Electrical and Computer Engineering, Vanderbilt University, Nashville, TN, USA, 2: Department of Computer Science, Vanderbilt University, Nashville, TN, USA, 3: Division of Pediatric Gastroenterology, Hepatology, and Nutrition, Vanderbilt University Medical Center, Nashville, TN, USA, 4: Department of Pathology, Microbiology and Immunology, Vanderbilt University Medical Center, Nashville, TN, USA
Publication date: 2025/10/20
https://doi.org/10.59275/j.melba.2025-8bad
PDF · Code

Abstract

Recently, circle representation has been introduced for medical imaging, designed specifically to enhance the detection of instance objects that are spherically shaped (e.g., cells, glomeruli, and nuclei). Given its outstanding effectiveness in instance detection, it is compelling to consider the application of circle representation for segmenting instance medical objects. In this study, we introduce CircleSnake, a simple end-to-end segmentation approach that utilizes circle contour deformation for segmenting ball-shaped medical objects at the instance level. The innovation of CircleSnake lies in these three areas: (1) It substitutes the complex bounding box-to-octagon contour transformation with a more consistent and rotation-invariant bounding circle-to-circle contour adaptation. This adaptation specifically targets ball-shaped medical objects. (2) The circle representation employed in CircleSnake significantly reduces the degrees of freedom to two, compared to eight in the octagon representation. This reduction enhances both the robustness of the segmentation performance and the rotational consistency of the method. (3) CircleSnake is the first end-to-end deep instance segmentation pipeline to incorporate circle representation, encompassing consistent circle detection, circle contour proposal, and circular convolution in a unified framework. This integration is achieved through the novel application of circular convolution within the context of circle detection and instance segmentation. In practical applications, such as the detection of glomeruli, nuclei, and eosinophils in pathological images, CircleSnake has demonstrated superior performance and greater rotation invariance when compared to benchmarks. The code has been made publicly available at: https://github.com/hrlblab/CircleSnake.

Keywords

Contour-based · CircleSnake · Detection · Segmentation · Image Analysis · Pathology

Bibtex @article{melba:2025:024:xiong, title = "Circle Representation for Medical Instance Object Segmentation", author = "Xiong, Juming and Nguyen, Ethan H. and Liu, Yilin and Deng, Ruining and Tyree, Regina N and Correa, Hernan and Hiremath, Girish and Wang, Yaohong and Yang, Haichun and Fogo, Agnes B. and Huo, Yuankai", journal = "Machine Learning for Biomedical Imaging", volume = "3", issue = "October 2025 issue", year = "2025", pages = "545--558", issn = "2766-905X", doi = "https://doi.org/10.59275/j.melba.2025-8bad", url = "https://melba-journal.org/2025:024" }
RISTY - JOUR AU - Xiong, Juming AU - Nguyen, Ethan H. AU - Liu, Yilin AU - Deng, Ruining AU - Tyree, Regina N AU - Correa, Hernan AU - Hiremath, Girish AU - Wang, Yaohong AU - Yang, Haichun AU - Fogo, Agnes B. AU - Huo, Yuankai PY - 2025 TI - Circle Representation for Medical Instance Object Segmentation T2 - Machine Learning for Biomedical Imaging VL - 3 IS - October 2025 issue SP - 545 EP - 558 SN - 2766-905X DO - https://doi.org/10.59275/j.melba.2025-8bad UR - https://melba-journal.org/2025:024 ER -

2025:024 cover