A comparison of histopathology imaging comprehension algorithms based on multiple instance learning

Adam Saunders, Sajal Dash, Aristeidis Tsaris, Hong Jun Yoon

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Whole slide imaging (WSI), also called digital virtual microscopy, is a new imaging modality. It allows for the application of AI and machine learning methods to cancer pathology to help establish a means for the automatic diagnosis of cancer cases. However, designing machine-learning models for WSI is computationally challenging due to its required ultra-high resolution. The current state-of-the-art models use multiple instance learning (MIL). MIL is a weakly-supervised learning method in which the model uses an array of inferences from many smaller instances to make a final classification about the entire set. In the context of WSI, researchers divide the ultra-high-resolution image into many patches. The model then classifies the slide based on an array of inferences from the patches. Among several ways of making the final classification, attention-based mechanisms have resulted in superb accuracy scores. The Transformer, one attention-based algorithm, has reported substantial improvements for WSI comprehension tasks. In this project, we studied and compared several WSI comprehension algorithms. We used the following three datasets: CAMELYON16+17, TCGA-Lung, and TCGA-Kidney. We found that attention-based MIL algorithms performed better than standard MIL algorithms for classifying WSI images, achieving a higher mean accuracy and AUC. However, none of the attention-based algorithms performed significantly better than the others, reporting accuracy scores that varied widely. Presumably, it is due to the limited availability of training samples in the data corpus. Since it is not easy to increase the samples from human subjects, some machine learning techniques like transfer learning could help mitigate this issue.

Original languageEnglish
Title of host publicationMedical Imaging 2023
Subtitle of host publicationDigital and Computational Pathology
EditorsJohn E. Tomaszewski, Aaron D. Ward
PublisherSPIE
ISBN (Electronic)9781510660472
DOIs
StatePublished - 2023
EventMedical Imaging 2023: Digital and Computational Pathology - San Diego, United States
Duration: Feb 19 2023Feb 23 2023

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume12471
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2023: Digital and Computational Pathology
Country/TerritoryUnited States
CitySan Diego
Period02/19/2302/23/23

Funding

This work was supported in part by the U.S. Department of Energy, Office of Science, Office of Workforce Development for Teachers and Scientists (WDTS) under the Science Undergraduate Laboratory Internships program. This research used resources of the Oak Ridge Leadership Computing Facility at the Oak Ridge National Laboratory, which is supported by the Office of Science of the U.S. Department of Energy under Contract No. DE-AC05-00OR22725.

FundersFunder number
Office of Workforce Development for Teachers
U.S. Department of Energy
Office of ScienceDE-AC05-00OR22725

    Keywords

    • Transformers
    • deep learning
    • histopathology imaging
    • multiple instance learning
    • whole slide imaging

    Fingerprint

    Dive into the research topics of 'A comparison of histopathology imaging comprehension algorithms based on multiple instance learning'. Together they form a unique fingerprint.

    Cite this