The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI
Ahmed W. Moawad1,2,3,4, Anastasia Janas5,2,3,4,6, Ujjwal Baid7,2,3,4, Divya Ramakrishnan5,2,3,4, Rachit Saluja8,9,2,3,4,10, Nader Ashraf11,12,2,3,4,10, Nazanin Maleki5,11,2,3,4,6, Leon Jekel13,2,3,4, Nikolay Yordanov14,6,15, Pascal Fehringer16,6,15, Athanasios Gkampenis17,6,15, Raisa Amiruddin11,3,6, Amirreza Manteghinejad11,3, Maruf Adewole18,3, Jake Albrecht19,3, Udunna Anazodo18,20,3, Sanjay Aneja21,3, Syed Muhammad Anwar22,3, Timothy Bergquist23,3, Veronica Chiang24,3, Verena Chung19,3, Gian Marco Conte23,3, Farouk Dako25,3, James Eddy19,3, Ivan Ezhov26,3, Nastaran Khalili27,3, Keyvan Farahani28,3, Juan Eugenio Iglesias29,3, Zhifan Jiang30,3, Elaine Johanson31,3, Anahita Fathi Kazerooni27,32,33,3, Florian Kofler34,3, Kiril Krantchev5,3,4,35,6, Dominic LaBella36,3, Koen Van Leemput37,3, Hongwei Bran Li29,3, Marius George Linguraru22,38,3, Xinyang Liu30,3, Zeke Meier39,3, Bjoern H Menze40,3, Harrison Moy5,3,4,35, Klara Osenberg5,3,4, Marie Piraud41,3, Zachary Reitman36,3, Russell Takeshi Shinohara42,3, Chunhao Wang36,3, Benedikt Wiestler34,3, Walter Wiggins43,3, Umber Shafique44,3,45, Klara Willms5,4, Arman Avesta5,46,4, Khaled Bousabarah47,4,35, Satrajit Chakrabarty48,49,4, Nicolo Gennaro50,4, Wolfgang Holler47,4,35, Manpreet Kaur51,4,35, Pamela LaMontagne52,4, MingDe Lin53,4,35, Jan Lost54,4,35, Daniel S. Marcus52,4, Ryan Maresca21,4,35, Sarah Merkaj55,4,35, Gabriel Cassinelli Pedersen56,4,35, Marc von Reppert57,4,35, Aristeidis Sotiras52,58,4, Oleg Teytelboym1,4, Niklas Tillmans59,4,35, Malte Westerhoff47,4,35, Ayda Youssef60,4, Devon Godfrey36,4, Scott Floyd36,4, Andreas Rauschecker61,4, Javier Villanueva-Meyer61,4, Irada Pflüger62,4, Jaeyoung Cho62,4, Martin Bendszus62,4, Gianluca Brugnara62,4, Justin Cramer63,45, Gloria J. Guzman Perez-Carillo64,45, Derek R. Johnson23,45, Anthony Kam65,45, Benjamin Yin Ming Kwan66,45, Lillian Lai67,45, Neil U. Lall68,45, Fatima Memon69,70,71,45, Mark Krycia69,45, Satya Narayana Patro72,45, Bojan Petrovic73,45, Tiffany Y. So74,45, Gerard Thompson75,76,45, Lei Wu77,45, E. Brooke Schrickel78,45, Anu Bansal79,80, Frederik Barkhof81,82,80, Cristina Besada83,80, Sammy Chu77,80, Jason Druzgal84,80, Alexandru Dusoi85,80, Luciano Farage86,80, Fabricio Feltrin87,80, Amy Fong88,80, Steve H. Fung89,80, R. Ian Gray90,80, Ichiro Ikuta63,80, Michael Iv91,80, Alida A. Postma92,93,80, Amit Mahajan5,80, David Joyner84,80, Chase Krumpelman50,80, Laurent Letourneau-Guillon94,80, Christie M. Lincoln95,80, Mate E. Maros96,80, Elka Miller97,80, Fanny Morón98,80, Esther A. Nimchinsky99,80, Ozkan Ozsarlak100,80, Uresh Patel101,80, Saurabh Rohatgi46,80, Atin Saha102,103,80, Anousheh Sayah104,80, Eric D. Schwartz105,106,80, Robert Shih107,80, Mark S. Shiroishi108,80, Juan E. Small109,80, Manoj Tanwar110,80, Jewels Valerie111,80, Brent D. Weinberg112,80, Matthew L. White113,80, Robert Young102,80, Vahe M. Zohrabian114,80, Aynur Azizova115,80, Melanie Maria Theresa Brüßeler51,15, Mohanad Ghonim116,15, Abdullah Okar117,15, Luca Pasquini102,15, Yasaman Sharifi118,15, Gagandeep Singh119,15, Nico Sollmann120,121,122,15, Theodora Soumala17,15, Mahsa Taherzadeh123,15, Philipp Vollmuth62,124,4,10, Martha Foltyn-Dumitru62,4,10, Ajay Malhotra5,4,10, Aly H. Abayazeed91,10, Francesco Dellepiane125,10, Philipp Lohmann126,127,10, Víctor M. Pérez-García128,10, Hesham Elhalawani129,10, Maria Correia de Verdier130,131,10, Sanaria Al-Rubaiey132,133, Rui Duarte Armindo134,133, Kholod Ashraf60,133, Moamen M. Asla135,133, Mohamed Badawy136,133, Jeroen Bisschop137,133, Nima Broomand Lomer138,133, Jan Bukatz132,133, Jim Chen139,133, Petra Cimflova140,133, Felix Corr141,133, Alexis Crawley142,133, Lisa Deptula143,133, Tasneem Elakhdar60,133, Islam H. Shawali60,133, Shahriar Faghani23,133, Alexandra Frick144,133, Vaibhav Gulati145,133, Muhammad Ammar Haider146,133, Fátima Hierro147,133, Rasmus Holmboe Dahl148,133, Sarah Maria Jacobs149,133, Kuang-chun Jim Hsieh98,133, Sedat G. Kandemirli67,133, Katharina Kersting132,133, Laura Kida132,133, Sofia Kollia150,133, Ioannis Koukoulithras151,133, Xiao Li112,133, Ahmed Abouelatta60,133, Aya Mansour60,133, Ruxandra-Catrinel Maria-Zamfirescu132,133, Marcela Marsiglia152,133, Yohana Sarahi Mateo-Camacho153,133, Mark McArthur154,133, Olivia McDonnell155,133, Maire McHugh156,133, Mana Moassefi157,133, Samah Mostafa Morsi95,133, Alexander Munteanu158,133, Khanak K. Nandolia159,133, Syed Raza Naqvi160,133, Yalda Nikanpour161,133, Mostafa Alnoury162,133, Abdullah Mohamed Aly Nouh163,133, Francesca Pappafava164,133, Markand D. Patel165,133, Samantha Petrucci61,133, Eric Rawie166,133, Scott Raymond167,133, Borna Roohani117,133, Sadeq Sabouhi168,133, Laura M. Sanchez-Garcia169,133, Zoe Shaked132,133, Pokhraj P. Suthar170,133, Talissa Altes171,133, Edvin Isufi171,133, Yaseen Dhemesh172,133, Jaime Gass171,133, Jonathan Thacker171,133, Abdul Rahman Tarabishy173,133, Benjamin Turner174,133, Sebastiano Vacca175,133, George K. Vilanilam174,133, Daniel Warren172,133, David Weiss176,133, Fikadu Worede11,133, Sara Yousry60,133, Wondwossen Lerebo11,177, Alejandro Aristizabal178,179,180, Alexandros Karargyris178,180, Hasan Kassem178,180, Sarthak Pati7,178,181,180, Micah Sheller178,182,180, Katherine E. Link183,3,4, Evan Calabrese184,3,4, Nourel hoda Tahon171,3,4, Ayman Nada171,3,4, Yuri S. Velichko50,3,4, Spyridon Bakas7,44,185,3,4,186, Jeffrey D. Rudie131,187,3,4,45,186, Mariam Aboian11,3,4,45,186
1: Trinity health Mid Atlantic Hospitals, Darby, PA, USA, 2: Equal First Authors, 3: Organizer, 4: Data contributors, 5: Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, USA, 6: International lead, 7: Division of Computational Pathology, Department of Pathology and Laboratory Medicine, School of Medicine, Indiana University, Indianapolis, IN, USA, 8: Department of Electrical and Computer Engineering, Cornell University and Cornell Tech, New York, NY, USA, 9: Department of Radiology, Weill Cornell Medicine, New York, NY, USA, 10: BraTS2024 Organizer, 11: Department of Radiology, Children’s Hospital of Philadelphia, Philadelphia, PA, USA, 12: College of Medicine, Alfaisal University, Riyadh, Saudi Arabia, 13: DKFZ Division of Translational Neurooncology at the WTZ, German Cancer Consortium, DKTK Partner Site, University Hospital Essen, Essen, Germany, 14: Faculty of Medicine, Medical University - Sofia, Sofia, Bulgaria, 15: Super Annotator, 16: Faculty of Medicine, Jena University Hospital, Friedrich Schiller University Jena, Jena, Germany, 17: University of Ioannina School of Medicine, Ioannina, Greece, 18: Medical Artificial Intelligence Lab, Crestview Radiology, Lagos, Nigeria, 19: Sage Bionetworks, Seattle, WA, USA, 20: Montreal Neurological Institute, McGill University, Montreal, Canada, 21: Department of Therapeutic Radiology, Yale School of Medicine, New Haven, CT, USA, 22: Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital, Washington, D.C., USA, 23: Department of Radiology, Mayo Clinic, Rochester, MN, USA, 24: Department of Neurosurgery, Yale School of Medicine, New Haven, CT, USA, 25: Center for Global Health, Perelman School of Medicine, University of Pennsylvania, PA, USA, 26: Department of Informatics, Technical University Munich, Germany, 27: Center for Data-Driven Discovery in Biomedicine, Children’s Hospital of Philadelphia, Philadelphia, PA, USA, 28: Cancer Imaging Program, National Cancer Institute, National Institutes of Health, Bethesda, MD, USA, 29: Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, MA, USA, 30: Children’s National Hospital, Washington, D.C., USA, 31: PrecisionFDA, U.S. Food and Drug Administration, Silver Spring, MD, USA, 32: Department of Neurosurgery, University of Pennsylvania, Philadelphia, PA, USA, 33: Division of Neurosurgery, Children’s Hospital of Philadelphia, Philadelphia, PA, USA, 34: Department of Neuroradiology, Technical University of Munich, Munich, Germany, 35: Annotator, 36: Department of Radiation Oncology, Duke University Medical Center, Durham, NC, USA, 37: Department of Applied Mathematics and Computer Science, Technical University of Denmark, Denmark, 38: Departments of Radiology and Pediatrics, George Washington University School of Medicine and Health Sciences, Washington, D.C., USA, 39: Booz Allen Hamilton, McLean, VA, USA, 40: Biomedical Image Analysis & Machine Learning, Department of Quantitative Biomedicine, University of Zurich, Switzerland, 41: Helmholtz AI, Helmholtz Munich, Germany, 42: Center for Clinical Epidemiology and Biostatistics, University of Pennsylvania, Philadelphia, PA, USA, 43: Duke University School of Medicine, Durham, NC, USA, 44: Department of Radiology and Imaging Sciences, Indiana University, Indianapolis, IN, USA, 45: Super Approver, 46: Department of Radiology, Neuroradiology, Massachusetts General Hospital, Boston, MA, USA, 47: Visage Imaging, GmbH, Berlin, Germany, 48: Department of Electrical and Systems Engineering, Washington University in St. Louis, St. Louis, MO, USA, 49: GE HealthCare, San Ramon, CA, USA, 50: Department of Radiology, Northwestern University, Feinberg School of Medicine, Chicago, IL, USA, 51: Ludwig Maximilian University, Munich, Germany, 52: Mallinckrodt Institute of Radiology, Washington University School of Medicine, St. Louis, MO, USA, 53: Visage Imaging, Inc, San Diego, CA, USA, 54: Department of Neurosurgery, Heinrich-Heine University, Moorenstrasse 5, Dusseldorf, Germany, 55: University of Ulm, Ulm, Germany, 56: University of Göttingen, Göttingen, Germany, 57: University of Leipzig, Leipzig, Germany, 58: Institute for Informatics, Data Science & Biostatistics, Washington University School of Medicine, St. Louis, MO, USA, 59: Department of Diagnostic and Interventional Radiology, Medical Faculty, University Dusseldorf, Dusseldorf, Germany, 60: Cairo University, Cairo, Egypt, 61: Department of Radiology and Biomedical Imaging, University of California San Francisco, CA, USA, 62: Department of Neuroradiology, Heidelberg University Hospital, Heidelberg, Germany, 63: Department of Radiology, Mayo Clinic, Phoenix, AZ, USA, 64: Neuroradiology Section, Mallinckrodt Institute of Radiology, Washington University in St. Louis, St. Louis, MO, USA, 65: Loyola University Medical Center, Hines, IL, USA, 66: Department of Radiology, Queen’s University, Kingston, ON, Canada, 67: Department of Radiology, University of Iowa Hospitals and Clinics, Iowa City, IA, USA, 68: Children’s Healthcare of Atlanta, GA, USA, 69: Carolina Radiology Associates, Myrtle Beach, SC, USA, 70: McLeod Regional Medical Center, Florence, SC, USA, 71: Medical University of South Carolina, Charleston, SC, USA, 72: University of Arkansas Medical Center, Little Rock, AR, USA, 73: NorthShore Endeavor Health, Evanston, IL, USA, 74: Department of Imaging and Interventional Radiology, The Chinese University of Hong Kong, Hong Kong SAR, 75: Centre for Clinical Brain Sciences, University of Edinburgh, Edinburgh, United Kingdom, 76: Department of Clinical Neurosciences, NHS Lothian, Edinburgh, United Kingdom, 77: Department of Radiology, University of Washington, Seattle, WA, USA, 78: Department of Radiology, Ohio State University College of Medicine, Columbus, OH, USA, 79: Albert Einstein Medical Center, Hartford, CT, USA, 80: Rest of Approvers, 81: Amsterdam UMC, location Vrije Universiteir, Netherlands, 82: University College London, United Kingdom, 83: Hospital Italiano de Buenos Aires, Buenos Aires, Argentina, 84: Department of Radiology and Medical Imaging, University of Virginia, Charlottesville, Virginia, USA, 85: Klinikum Hochrhein, Waldshut-Tiengen, Germany, 86: Centro Universitario Euro-Americana (UNIEURO), Bras´ılia, DF, Brazil, 87: Department of Radiology, University of Texas Southwestern Medical Center, Dallas, TX, USA, 88: Southern District Health Board, Dunedin, New Zealand, 89: Department of Radiology, Houston Methodist, Houston, TX, USA, 90: University of Tennessee Medical Center, Knoxville, TN, USA, 91: Department of Radiology, Stanford University, Stanford, CA, USA, 92: Department of Radiology and Nuclear Medicine, Maastricht University Medical Center, Maastricht, the Netherlands, 93: Mental Health and Neuroscience Research Institute, Maastricht University, Maastricht, the Netherlands, 94: Centre Hospitalier de l’Universite de Montreal and Centre de Recherche du CHUM Montreal, Canada, 95: Department of Neuroradiology, MD Anderson Cancer Center, Houston, TX, USA, 96: Departments of Neuroradiology & Biomedical Informatics, Medical Faculty Mannheim, Heidelberg University, Mannheim, Germany, 97: Department of Diagnostic and Interventional Radiology, SickKids Hospital, University of Toronto, Canada, 98: Department of Radiology, Baylor College of Medicine, Houston, TX, USA, 99: Department of Radiology, New Jersey Medical School, Newark, NJ, USA, 100: Department of Radiology, AZ Monica, Antwerp Area, Belgium, 101: Medicolegal Imaging Experts LLC, Mercer Island, WA, USA, 102: Department of Radiology, Memorial Sloan Kettering Cancer Center, New York, NY, USA, 103: Weill Cornell Medical College, New York, NY, USA, 104: MedStar Georgetown University Hospital, Washington, D.C., USA, 105: Department of Radiology, St.Elizabeth’s Medical Center, Boston, MA, USA, 106: Department of Radiology, Tufts University School of Medicine, Boston, MA, USA, 107: Walter Reed National Military Medical Center, Bethesda, MD, USA, 108: Keck School of Medicine, Los Angeles, CA, USA, 109: Lahey Hospital and Medical Center, Burlington, MA, USA, 110: Department of Radiology, University of Alabama, Birmingham, AL, USA, 111: Department of Radiology, University of North Carolina School of Medicine, Chapel Hill, NC, USA, 112: Department of Radiology and Imaging Sciences, Emory University, Atlanta, GA, USA, 113: University of Nebraska Medical Center, Omaha, NE, USA, 114: Northwell Health, Zucker Hofstra School of Medicine at Northwell, North Shore University Hospital, Hempstead, New York, NY, USA, 115: Cancer Center Amsterdam, Imaging and Biomarkers, Amsterdam, The Netherlands, 116: Department of Radiology, Ain Shams University, Cairo, Egypt, 117: University of Hamburg, University Medical Center Hamburg-Eppendorf, Hamburg, Germany, 118: Department of Radiology, Iran University of Medical Sciences, Tehran, Iran, 119: Columbia University Irving Medical Center, New York, NY, USA, 120: Department of Diagnostic and Interventional Radiology, University Hospital Ulm, Ulm, Germany, 121: Department of Diagnostic and Interventional Neuroradiology, School of Medicine, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany, 122: TUM-Neuroimaging Center, Klinikum rechts der Isar, Technical University of Munich, Munich, Germany, 123: Department of Radiology, Arad Hospital, Tehran, Iran, 124: Department of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany, 125: Functional and Interventional Neuroradiology Unit, Bambino Gesù Children’s Hospital, Rome, Italy, 126: Institute of Neuroscience and Medicine (INM-4), Research Center Juelich, Juelich, Germany, 127: Department of Nuclear Medicine, University Hospital RWTH Aachen, Aachen, Germany, 128: Mathematical Oncology Laboratory & Department of Mathematics, University of Castilla-La Mancha, Spain, 129: Department of Radiation Oncology, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA, USA, 130: Department of Surgical Sciences, Section of Neuroradiology, Uppsala University, Sweden, 131: Department of Radiology, University of California San Diego, CA, USA, 132: Charité-Universitätsmedizin Berlin (Corporate Member of Freie Universität Berlin, Humboldt-Universität zu Berlin, and Berlin Institute of Health), Berlin, Germany, 133: Rest of Annotators, 134: Department of Neuroradiology, Western Lisbon Hospital Centre (CHLO), Portugal, 135: Zagazig University, Zagazig, Egypt, 136: Diagnostic Radiology Department, Wayne State University, Detroit, MI, 137: Institute of Diagnostic and Interventional Radiology, University Hospital Zurich, University of Zurich, Zurich, Switzerland., 138: Faculty of Medicine, Guilan University of Medical Sciences, Rasht, Iran, 139: Department of Radiology/Division of Neuroradiology, San Diego Veterans Administration Medical Center/UC San Diego Health System, San Diego, CA, USA, 140: Department of Radiology, University of Calgary, Calgary, Canada, 141: EDU Institute of Higher Education, Villa Bighi, Chaplain’s House, Kalkara, Malta, 142: Bay Imaging Consultants, Walnut Creek, CA, USA, 143: Ross University School of Medicine, Bridgetown, Barbados, 144: Department of Neurosurgery, Vivantes Klinikum Neukölln, Berlin, Germany, 145: Mercy Catholic Medical Center, Darby, PA, USA, 146: C.M.H. Lahore Medical College, Lahore, Pakistan, 147: Neuroradiology Department, Pedro Hispano Hospital, Matosinhos, Portugal, 148: Department of Radiology, Copenhagen University Hospital - Rigshospitalet, Copenhagen, Denmark, 149: Rijnstate Hospital, Arnhem, Netherlands, 150: National and Kapodistrian University of Athens, School of Medicine, Athens, Greece, 151: Department of Neurosurgery, University Hospital of Ioannina, Ioannina, Greece, 152: Department of Radiology, Brigham and Women’s Hospital, Massachusetts General Hospital, Boston, MA, USA, 153: Department of Neuroradiology, Universidad Autónoma de Nuevo León, México, 154: Department of Radiological Sciences, University of California Los Angeles, Los Angeles, CA, USA, 155: Gold Coast University Hospital, Queensland Health, Australia, 156: Department of Radiology Manchester NHS Foundation Trust, North West School of Radiology, Manchester, United Kingdom, 157: Artificial Intelligence Lab, Department of Radiology, Mayo Clinic, Rochester, MN, USA, 158: Corewell Health West, MI, USA, 159: Department of Radiodiagnosis, All India Institute of Medical Sciences Rishikesh, India, 160: Windsor Regional Hospital, Western University, Ontario, Canada, 161: Artificial Intelligence & Informatics, Mayo Clinic, Rochester, MN, USA, 162: Department of Radiology, University of Pennsylvania, PA, USA, 163: Department of Radiology, Life Care Hospital, Freetown, Sierra Leone, 164: Department of Medicine and Surgery, Università degli Studi di Perugia, Italy, 165: Department of Neuroradiology, Imperial College Healthcare NHS Trust, London, United Kingdom, 166: Department of Radiology, Michigan Medicine, Ann Arbor, MI, USA, 167: Department of Radiology, University of Vermont Medical Center, Burlington, VT, USA, 168: Isfahan University of Medical Sciences, Isfahan, Iran, 169: Department of Radiology, The American British Cowdray Medical Center, Mexico City, Mexico, 170: Rush University Medical Center, Chicago, IL, USA, 171: Radiology Department, University of Missouri, Columbia, MO, USA, 172: Washington University School of Medicine in St. Louis, St. Louis, MO, USA, 173: Department of NeuroRadiology, Rockefeller Neuroscience Institute, West Virginia University. Morgantown, WV, USA, 174: Leeds Teaching Hospitals NHS Trust, Leeds, United Kingdom, 175: University of Cagliari, School of Medicine and Surgery, Cagliari, Italy, 176: Department of Diagnostic and Interventional Radiology and Neuroradiology, University Hospital Essen, Essen, Germany, 177: Stats, 178: MLCommons, San Francisco, CA, USA, 179: Factored, Palo Alto, CA, USA, 180: MLCommons, 181: Center For Federated Learning in Medicine, Indiana University, Indianapolis, IN, USA, 182: Intel Corporation, Hillsboro, OR, USA, 183: New York University School of Medicine, New York, NY, USA, 184: Department of Radiology, Duke University Medical Center, Durham, NC, USA, 185: Department of Neurological Surgery, School of Medicine, Indiana University, Indianapolis, IN, USA, 186: Equal Senior Authors, 187: Department of Radiology, Scripps Clinic Medical Group, CA, USA
Publication date: 2025/06/26
https://doi.org/10.59275/j.melba.2025-9bd3
Abstract
The translation of AI-generated brain metastases (BM) segmentation into clinical practice relies heavily on diverse, high-quality annotated medical imaging datasets. The BraTS-METS 2023 challenge has gained momentum for testing and benchmarking algorithms using rigorously annotated internationally compiled real-world datasets. This study presents the results of the segmentation challenge and characterizes the challenging cases that impacted the performance of the winning algorithms. Untreated brain metastases on standard anatomic MRI sequences (T1, T2, FLAIR, T1PG) from eight contributed international datasets were annotated in stepwise method: published UNET algorithms, student, neuroradiologist, final approver neuroradiologist. Segmentations were ranked based on lesion-wise Dice and Hausdorff distance (HD95) scores. False positives (FP) and false negatives (FN) were rigorously penalized, receiving a score of 0 for Dice and a fixed penalty of 374 for HD95. The mean scores for the teams were calculated. Eight datasets comprising 1303 studies were annotated, with 402 studies (3076 lesions) released on Synapse as publicly available datasets to challenge competitors. Additionally, 31 studies (139 lesions) were held out for validation, and 59 studies (218 lesions) were used for testing. Segmentation accuracy was measured as rank across subjects, with the winning team achieving a LesionWise mean score of 7.9. The Dice score for the winning team was 0.65 ± 0.25. Common errors among the leading teams included false negatives for small lesions and misregistration of masks in space. The Dice scores and lesion detection rates of all algorithms diminished with decreasing tumor size, particularly for tumors smaller than 100 mm3. In conclusion, algorithms for BM segmentation require further refinement to balance high sensitivity in lesion detection with the minimization of false positives and negatives. The BraTS-METS 2023 challenge successfully curated well- annotated, diverse datasets and identified common errors, facilitating the translation of BM segmentation across varied environments and providing the tools for future development of personalized volumetric reports to patients undergoing BM treatment.
Keywords
BraTS · BraTS-METS · Medical image analysis challenge · Brain metastasis · Brain tumor segmentation · Machine learning · Artificial Intelligence
Bibtex
@article{melba:2025:011:moawad,
title = "The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI",
author = "Moawad, Ahmed W. and Janas, Anastasia and Baid, Ujjwal and Ramakrishnan, Divya and Saluja, Rachit and Ashraf, Nader and Maleki, Nazanin and Jekel, Leon and Yordanov, Nikolay and Fehringer, Pascal and Gkampenis, Athanasios and Amiruddin, Raisa and Manteghinejad, Amirreza and Adewole, Maruf and Albrecht, Jake and Anazodo, Udunna and Aneja, Sanjay and Anwar, Syed Muhammad and Bergquist, Timothy and Chiang, Veronica and Chung, Verena and Conte, Gian Marco and Dako, Farouk and Eddy, James and Ezhov, Ivan and Khalili, Nastaran and Farahani, Keyvan and Iglesias, Juan Eugenio and Jiang, Zhifan and Johanson, Elaine and Kazerooni, Anahita Fathi and Kofler, Florian and Krantchev, Kiril and LaBella, Dominic and Van Leemput, Koen and Li, Hongwei Bran and Linguraru, Marius George and Liu, Xinyang and Meier, Zeke and Menze, Bjoern H and Moy, Harrison and Osenberg, Klara and Piraud, Marie and Reitman, Zachary and Shinohara, Russell Takeshi and Wang, Chunhao and Wiestler, Benedikt and Wiggins, Walter and Shafique, Umber and Willms, Klara and Avesta, Arman and Bousabarah, Khaled and Chakrabarty, Satrajit and Gennaro, Nicolo and Holler, Wolfgang and Kaur, Manpreet and LaMontagne, Pamela and Lin, MingDe and Lost, Jan and Marcus, Daniel S. and Maresca, Ryan and Merkaj, Sarah and Cassinelli Pedersen, Gabriel and von Reppert, Marc and Sotiras, Aristeidis and Teytelboym, Oleg and Tillmans, Niklas and Westerhoff, Malte and Youssef, Ayda and Godfrey, Devon and Floyd, Scott and Rauschecker, Andreas and Villanueva-Meyer, Javier and Pflüger, Irada and Cho, Jaeyoung and Bendszus, Martin and Brugnara, Gianluca and Cramer, Justin and Guzman Perez-Carillo, Gloria J. and Johnson, Derek R. and Kam, Anthony and Kwan, Benjamin Yin Ming and Lai, Lillian and Lall, Neil U. and Memon, Fatima and Krycia, Mark and Narayana Patro, Satya and Petrovic, Bojan and So, Tiffany Y. and Thompson, Gerard and Wu, Lei and Schrickel, E. Brooke and Bansal, Anu and Barkhof, Frederik and Besada, Cristina and Chu, Sammy and Druzgal, Jason and Dusoi, Alexandru and Farage, Luciano and Feltrin, Fabricio and Fong, Amy and Fung, Steve H. and Gray, R. Ian and Ikuta, Ichiro and Iv, Michael and Postma, Alida A. and Mahajan, Amit and Joyner, David and Krumpelman, Chase and Letourneau-Guillon, Laurent and Lincoln, Christie M. and Maros, Mate E. and Miller, Elka and Morón, Fanny and Nimchinsky, Esther A. and Ozsarlak, Ozkan and Patel, Uresh and Rohatgi, Saurabh and Saha, Atin and Sayah, Anousheh and Schwartz, Eric D. and Shih, Robert and Shiroishi, Mark S. and Small, Juan E. and Tanwar, Manoj and Valerie, Jewels and Weinberg, Brent D. and White, Matthew L. and Young, Robert and Zohrabian, Vahe M. and Azizova, Aynur and Brüßeler, Melanie Maria Theresa and Ghonim, Mohanad and Okar, Abdullah and Pasquini, Luca and Sharifi, Yasaman and Singh, Gagandeep and Sollmann, Nico and Soumala, Theodora and Taherzadeh, Mahsa and Vollmuth, Philipp and Foltyn-Dumitru, Martha and Malhotra, Ajay and Abayazeed, Aly H. and Dellepiane, Francesco and Lohmann, Philipp and Pérez-García, Víctor M. and Elhalawani, Hesham and Correia de Verdier, Maria and Al-Rubaiey, Sanaria and Duarte Armindo, Rui and Ashraf, Kholod and Asla, Moamen M. and Badawy, Mohamed and Bisschop, Jeroen and Broomand Lomer, Nima and Bukatz, Jan and Chen, Jim and Cimflova, Petra and Corr, Felix and Crawley, Alexis and Deptula, Lisa and Elakhdar, Tasneem and Shawali, Islam H. and Faghani, Shahriar and Frick, Alexandra and Gulati, Vaibhav and Haider, Muhammad Ammar and Hierro, Fátima and Holmboe Dahl, Rasmus and Jacobs, Sarah Maria and Hsieh, Kuang-chun Jim and Kandemirli, Sedat G. and Kersting, Katharina and Kida, Laura and Kollia, Sofia and Koukoulithras, Ioannis and Li, Xiao and Abouelatta, Ahmed and Mansour, Aya and Maria-Zamfirescu, Ruxandra-Catrinel and Marsiglia, Marcela and Mateo-Camacho, Yohana Sarahi and McArthur, Mark and McDonnell, Olivia and McHugh, Maire and Moassefi, Mana and Mostafa Morsi, Samah and Munteanu, Alexander and Nandolia, Khanak K. and Raza Naqvi, Syed and Nikanpour, Yalda and Alnoury, Mostafa and Aly Nouh, Abdullah Mohamed and Pappafava, Francesca and Patel, Markand D. and Petrucci, Samantha and Rawie, Eric and Raymond, Scott and Roohani, Borna and Sabouhi, Sadeq and Sanchez-Garcia, Laura M. and Shaked, Zoe and Suthar, Pokhraj P. and Altes, Talissa and Isufi, Edvin and Dhemesh, Yaseen and Gass, Jaime and Thacker, Jonathan and Tarabishy, Abdul Rahman and Turner, Benjamin and Vacca, Sebastiano and Vilanilam, George K. and Warren, Daniel and Weiss, David and Worede, Fikadu and Yousry, Sara and Lerebo, Wondwossen and Aristizabal, Alejandro and Karargyris, Alexandros and Kassem, Hasan and Pati, Sarthak and Sheller, Micah and Link, Katherine E. and Calabrese, Evan and hoda Tahon, Nourel and Nada, Ayman and Velichko, Yuri S. and Bakas, Spyridon and Rudie, Jeffrey D. and Aboian, Mariam",
journal = "Machine Learning for Biomedical Imaging",
volume = "3",
issue = "June 2025 issue",
year = "2025",
pages = "204--260",
issn = "2766-905X",
doi = "https://doi.org/10.59275/j.melba.2025-9bd3",
url = "https://melba-journal.org/2025:011"
}
RIS
TY - JOUR
AU - Moawad, Ahmed W.
AU - Janas, Anastasia
AU - Baid, Ujjwal
AU - Ramakrishnan, Divya
AU - Saluja, Rachit
AU - Ashraf, Nader
AU - Maleki, Nazanin
AU - Jekel, Leon
AU - Yordanov, Nikolay
AU - Fehringer, Pascal
AU - Gkampenis, Athanasios
AU - Amiruddin, Raisa
AU - Manteghinejad, Amirreza
AU - Adewole, Maruf
AU - Albrecht, Jake
AU - Anazodo, Udunna
AU - Aneja, Sanjay
AU - Anwar, Syed Muhammad
AU - Bergquist, Timothy
AU - Chiang, Veronica
AU - Chung, Verena
AU - Conte, Gian Marco
AU - Dako, Farouk
AU - Eddy, James
AU - Ezhov, Ivan
AU - Khalili, Nastaran
AU - Farahani, Keyvan
AU - Iglesias, Juan Eugenio
AU - Jiang, Zhifan
AU - Johanson, Elaine
AU - Kazerooni, Anahita Fathi
AU - Kofler, Florian
AU - Krantchev, Kiril
AU - LaBella, Dominic
AU - Van Leemput, Koen
AU - Li, Hongwei Bran
AU - Linguraru, Marius George
AU - Liu, Xinyang
AU - Meier, Zeke
AU - Menze, Bjoern H
AU - Moy, Harrison
AU - Osenberg, Klara
AU - Piraud, Marie
AU - Reitman, Zachary
AU - Shinohara, Russell Takeshi
AU - Wang, Chunhao
AU - Wiestler, Benedikt
AU - Wiggins, Walter
AU - Shafique, Umber
AU - Willms, Klara
AU - Avesta, Arman
AU - Bousabarah, Khaled
AU - Chakrabarty, Satrajit
AU - Gennaro, Nicolo
AU - Holler, Wolfgang
AU - Kaur, Manpreet
AU - LaMontagne, Pamela
AU - Lin, MingDe
AU - Lost, Jan
AU - Marcus, Daniel S.
AU - Maresca, Ryan
AU - Merkaj, Sarah
AU - Cassinelli Pedersen, Gabriel
AU - von Reppert, Marc
AU - Sotiras, Aristeidis
AU - Teytelboym, Oleg
AU - Tillmans, Niklas
AU - Westerhoff, Malte
AU - Youssef, Ayda
AU - Godfrey, Devon
AU - Floyd, Scott
AU - Rauschecker, Andreas
AU - Villanueva-Meyer, Javier
AU - Pflüger, Irada
AU - Cho, Jaeyoung
AU - Bendszus, Martin
AU - Brugnara, Gianluca
AU - Cramer, Justin
AU - Guzman Perez-Carillo, Gloria J.
AU - Johnson, Derek R.
AU - Kam, Anthony
AU - Kwan, Benjamin Yin Ming
AU - Lai, Lillian
AU - Lall, Neil U.
AU - Memon, Fatima
AU - Krycia, Mark
AU - Narayana Patro, Satya
AU - Petrovic, Bojan
AU - So, Tiffany Y.
AU - Thompson, Gerard
AU - Wu, Lei
AU - Schrickel, E. Brooke
AU - Bansal, Anu
AU - Barkhof, Frederik
AU - Besada, Cristina
AU - Chu, Sammy
AU - Druzgal, Jason
AU - Dusoi, Alexandru
AU - Farage, Luciano
AU - Feltrin, Fabricio
AU - Fong, Amy
AU - Fung, Steve H.
AU - Gray, R. Ian
AU - Ikuta, Ichiro
AU - Iv, Michael
AU - Postma, Alida A.
AU - Mahajan, Amit
AU - Joyner, David
AU - Krumpelman, Chase
AU - Letourneau-Guillon, Laurent
AU - Lincoln, Christie M.
AU - Maros, Mate E.
AU - Miller, Elka
AU - Morón, Fanny
AU - Nimchinsky, Esther A.
AU - Ozsarlak, Ozkan
AU - Patel, Uresh
AU - Rohatgi, Saurabh
AU - Saha, Atin
AU - Sayah, Anousheh
AU - Schwartz, Eric D.
AU - Shih, Robert
AU - Shiroishi, Mark S.
AU - Small, Juan E.
AU - Tanwar, Manoj
AU - Valerie, Jewels
AU - Weinberg, Brent D.
AU - White, Matthew L.
AU - Young, Robert
AU - Zohrabian, Vahe M.
AU - Azizova, Aynur
AU - Brüßeler, Melanie Maria Theresa
AU - Ghonim, Mohanad
AU - Okar, Abdullah
AU - Pasquini, Luca
AU - Sharifi, Yasaman
AU - Singh, Gagandeep
AU - Sollmann, Nico
AU - Soumala, Theodora
AU - Taherzadeh, Mahsa
AU - Vollmuth, Philipp
AU - Foltyn-Dumitru, Martha
AU - Malhotra, Ajay
AU - Abayazeed, Aly H.
AU - Dellepiane, Francesco
AU - Lohmann, Philipp
AU - Pérez-García, Víctor M.
AU - Elhalawani, Hesham
AU - Correia de Verdier, Maria
AU - Al-Rubaiey, Sanaria
AU - Duarte Armindo, Rui
AU - Ashraf, Kholod
AU - Asla, Moamen M.
AU - Badawy, Mohamed
AU - Bisschop, Jeroen
AU - Broomand Lomer, Nima
AU - Bukatz, Jan
AU - Chen, Jim
AU - Cimflova, Petra
AU - Corr, Felix
AU - Crawley, Alexis
AU - Deptula, Lisa
AU - Elakhdar, Tasneem
AU - Shawali, Islam H.
AU - Faghani, Shahriar
AU - Frick, Alexandra
AU - Gulati, Vaibhav
AU - Haider, Muhammad Ammar
AU - Hierro, Fátima
AU - Holmboe Dahl, Rasmus
AU - Jacobs, Sarah Maria
AU - Hsieh, Kuang-chun Jim
AU - Kandemirli, Sedat G.
AU - Kersting, Katharina
AU - Kida, Laura
AU - Kollia, Sofia
AU - Koukoulithras, Ioannis
AU - Li, Xiao
AU - Abouelatta, Ahmed
AU - Mansour, Aya
AU - Maria-Zamfirescu, Ruxandra-Catrinel
AU - Marsiglia, Marcela
AU - Mateo-Camacho, Yohana Sarahi
AU - McArthur, Mark
AU - McDonnell, Olivia
AU - McHugh, Maire
AU - Moassefi, Mana
AU - Mostafa Morsi, Samah
AU - Munteanu, Alexander
AU - Nandolia, Khanak K.
AU - Raza Naqvi, Syed
AU - Nikanpour, Yalda
AU - Alnoury, Mostafa
AU - Aly Nouh, Abdullah Mohamed
AU - Pappafava, Francesca
AU - Patel, Markand D.
AU - Petrucci, Samantha
AU - Rawie, Eric
AU - Raymond, Scott
AU - Roohani, Borna
AU - Sabouhi, Sadeq
AU - Sanchez-Garcia, Laura M.
AU - Shaked, Zoe
AU - Suthar, Pokhraj P.
AU - Altes, Talissa
AU - Isufi, Edvin
AU - Dhemesh, Yaseen
AU - Gass, Jaime
AU - Thacker, Jonathan
AU - Tarabishy, Abdul Rahman
AU - Turner, Benjamin
AU - Vacca, Sebastiano
AU - Vilanilam, George K.
AU - Warren, Daniel
AU - Weiss, David
AU - Worede, Fikadu
AU - Yousry, Sara
AU - Lerebo, Wondwossen
AU - Aristizabal, Alejandro
AU - Karargyris, Alexandros
AU - Kassem, Hasan
AU - Pati, Sarthak
AU - Sheller, Micah
AU - Link, Katherine E.
AU - Calabrese, Evan
AU - hoda Tahon, Nourel
AU - Nada, Ayman
AU - Velichko, Yuri S.
AU - Bakas, Spyridon
AU - Rudie, Jeffrey D.
AU - Aboian, Mariam
PY - 2025
TI - The Brain Tumor Segmentation (BraTS-METS) Challenge 2023: Brain Metastasis Segmentation on Pre-treatment MRI
T2 - Machine Learning for Biomedical Imaging
VL - 3
IS - June 2025 issue
SP - 204
EP - 260
SN - 2766-905X
DO - https://doi.org/10.59275/j.melba.2025-9bd3
UR - https://melba-journal.org/2025:011
ER -