Computer-aided detection using non-convolutional neural network Gaussian processes

Devanshu Agrawal, Hong Jun Yoon, Georgia Tourassi, Jacob D. Hinkle

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

1 Scopus citations

Abstract

Deep convolutional neural networks (CNNs) have in recent years achieved record-breaking performance on many image classification tasks and are therefore well-suited for computer aided detection (CAD). The need for uncertainty quantification for CAD motivates the need for a probabilistic framework for deep learning. The most well-known probabilistic neural network model is the Bayesian neural network (BNN), but BNNs are notoriously difficult to sample for large complex network architectures, and as such their use is restricted to small problems. It is known that the limit of BNNs as their widths increase toward infinity is a Gaussian process (GP), and there has been considerable research interest in these infinitely wide BNNs. Recently, this classic result has been extended to deep architectures in what is termed the neural network Gaussian process (NNGP) model. In this work, we implement an NNGP model and apply it to the ChestXRay14 dataset at the full resolution of 1024x1024 pixels. Even without any convolutional aspects to the network architecture and without any data augmentation, our five layer deep NNGP model outperforms other non-convolutional models and therefore helps to narrow the performance gap between non-convolutional and convolutional models. Our NNGP model is fully Bayesian and therefore offers uncertainty information through its predictive variance that can be used to formulate a predictive confidence measure. We show that the performance of the NNGP model is significantly boosted after low-confidence predictions are rejected, suggesting that convolution is most beneficial only for these low-confidence examples. Finally, our results indicate that an extremely large fully-connected neural network with appropriate regularization could perform as well as the NNGP if not for the computational bottleneck resulting from the large number of model parameters.

Original languageEnglish
Title of host publicationMedical Imaging 2019
Subtitle of host publicationComputer-Aided Diagnosis
EditorsKensaku Mori, Horst K. Hahn
PublisherSPIE
ISBN (Electronic)9781510625471
DOIs
StatePublished - 2019
EventMedical Imaging 2019: Computer-Aided Diagnosis - San Diego, United States
Duration: Feb 17 2019Feb 20 2019

Publication series

NameProgress in Biomedical Optics and Imaging - Proceedings of SPIE
Volume10950
ISSN (Print)1605-7422

Conference

ConferenceMedical Imaging 2019: Computer-Aided Diagnosis
Country/TerritoryUnited States
CitySan Diego
Period02/17/1902/20/19

Funding

This manuscript has been authored by UT-Battelle, LLC under Contract No. DE-AC05-00OR22725 with the U.S. Department of Energy. The United States Government retains and the publisher, by accepting the article for publication, acknowledges that the United States Government retains a non-exclusive, paid-up, irrevocable, world-wide license to publish or reproduce the published form of this manuscript, or allow others to do so, for United States Government purposes. The Department of Energy will provide public access to these results of federally sponsored research in accordance with the DOE Public Access Plan(http://energy.gov/downloads/doe-public-access-plan). The study was supported by the Laboratory Directed Research and Development (LDRD) program of Oak Ridge National Laboratory, under LDRD projects No. 9325 and No. 9613.

FundersFunder number
Laboratory Directed Research and Development9613, 9325

    Keywords

    • Computer-aided detection
    • Deep learning
    • Gaussian processes
    • Medical imaging

    Fingerprint

    Dive into the research topics of 'Computer-aided detection using non-convolutional neural network Gaussian processes'. Together they form a unique fingerprint.

    Cite this