BreastPathQ Challenge participants were tasked with developing an automated method for analyzing microscopy images of breast tissue and ranking them according to their tumor cell content, to provide a reliable assessment score. As reported in SPIE's Journal of Medical Imaging (JMI), the challenge produced encouraging results that indicate a path toward integrating artificial intelligence (AI) to streamline clinical assessment of breast cancer.
Medical imaging for neoadjuvant treatment
Treatment for large or aggressive breast cancers has often turned to mastectomy as the most reliable therapy. However, therapy known as "neoadjuvant treatment" can result in reduced tumor size, density, and spread, making patients candidates for breast-conserving surgery rather than mastectomy.Medical imaging allows doctors to assess the effects of neoadjuvant treatment. While the processes of analyzing medical images for cancer detection are typically performed manually and rely on expert interpretation of complex tissue structures, machine-learning algorithms for identifying cancer may increase the reliability and efficiency of those processes. In addition to reducing variability, which is inherent to human pathologists, fully automated methods like these are expected to increase the speed of image analysis.
Intensive focus, international effort
A total of 39 teams from 12 different countries worldwide engaged in the BreastPathQ Challenge. A total of 100 algorithms were developed, validated, and tested. Teams were able to compare their algorithms with those of others from academia, industry, and government, as structured by the Grand Challenge framework, which requires a shared set of source data.Most of the teams used an ensemble of machine-learning algorithms instead of limiting themselves to a single AI architecture. Top algorithms performed at levels comparable to the pathologists who provided the reference standards for the study, and the best performing algorithm slightly surpassed the scores of the pathologists. The algorithms generally performed well on easier patches of images but struggled on the difficult patches - those for which AI would be especially beneficial to pathologists.
The BreastPathQ Challenge was successful because the organizing committee brought together experts in multiple fields. According to Nicholas Petrick, deputy director for the Division of Imaging, Diagnostics and Software Reliability in the US FDA Center for Devices and Radiological Health, and representative for the BreastPathQ Challenge Group, advance collaborative groundwork meant that participants were able to move quickly and efficiently to address the task, access the data set, and develop their algorithms.
Petrick N, Akbar S, Cha KH, Nofech-Mozes S, Sahiner B, Gavrielides MA, Kalpathy-Cramer J, Drukker K, Martel AL; BreastPathQ Challenge Group.
SPIE-AAPM-NCI BreastPathQ challenge: an image analysis challenge for quantitative tumor cellularity assessment in breast cancer histology images following neoadjuvant treatment.
J Med Imaging (Bellingham). 2021, doi: 10.1117/1.JMI.8.3.034501