TY - JOUR
T1 - Investigating the link between radiologists' gaze, diagnostic decision, and image content
AU - Tourassi, Georgia D.
AU - Voisin, Sophie
AU - Paquit, Vincent C.
AU - Krupinski, Elizabeth A.
N1 - DBLP License: DBLP's bibliographic metadata records provided through http://dblp.org/ are distributed under a Creative Commons CC0 1.0 Universal Public Domain Dedication. Although the bibliographic metadata records are provided consistent with CC0 1.0 Dedication, the content described by the metadata records is not. Content may be subject to copyright, rights of privacy, rights of publicity and other restrictions.
PY - 2013
Y1 - 2013
N2 - OBJECTIVE: To investigate machine learning for linking image content, human perception, cognition, and error in the diagnostic interpretation of mammograms.METHODS: Gaze data and diagnostic decisions were collected from three breast imaging radiologists and three radiology residents who reviewed 20 screening mammograms while wearing a head-mounted eye-tracker. Image analysis was performed in mammographic regions that attracted radiologists' attention and in all abnormal regions. Machine learning algorithms were investigated to develop predictive models that link: (i) image content with gaze, (ii) image content and gaze with cognition, and (iii) image content, gaze, and cognition with diagnostic error. Both group-based and individualized models were explored.RESULTS: By pooling the data from all readers, machine learning produced highly accurate predictive models linking image content, gaze, and cognition. Potential linking of those with diagnostic error was also supported to some extent. Merging readers' gaze metrics and cognitive opinions with computer-extracted image features identified 59% of the readers' diagnostic errors while confirming 97.3% of their correct diagnoses. The readers' individual perceptual and cognitive behaviors could be adequately predicted by modeling the behavior of others. However, personalized tuning was in many cases beneficial for capturing more accurately individual behavior.CONCLUSIONS: There is clearly an interaction between radiologists' gaze, diagnostic decision, and image content which can be modeled with machine learning algorithms.
AB - OBJECTIVE: To investigate machine learning for linking image content, human perception, cognition, and error in the diagnostic interpretation of mammograms.METHODS: Gaze data and diagnostic decisions were collected from three breast imaging radiologists and three radiology residents who reviewed 20 screening mammograms while wearing a head-mounted eye-tracker. Image analysis was performed in mammographic regions that attracted radiologists' attention and in all abnormal regions. Machine learning algorithms were investigated to develop predictive models that link: (i) image content with gaze, (ii) image content and gaze with cognition, and (iii) image content, gaze, and cognition with diagnostic error. Both group-based and individualized models were explored.RESULTS: By pooling the data from all readers, machine learning produced highly accurate predictive models linking image content, gaze, and cognition. Potential linking of those with diagnostic error was also supported to some extent. Merging readers' gaze metrics and cognitive opinions with computer-extracted image features identified 59% of the readers' diagnostic errors while confirming 97.3% of their correct diagnoses. The readers' individual perceptual and cognitive behaviors could be adequately predicted by modeling the behavior of others. However, personalized tuning was in many cases beneficial for capturing more accurately individual behavior.CONCLUSIONS: There is clearly an interaction between radiologists' gaze, diagnostic decision, and image content which can be modeled with machine learning algorithms.
KW - Artificial Intelligence
KW - Breast Neoplasms/diagnostic imaging
KW - Cognition
KW - Diagnostic Errors
KW - Eye Movements
KW - Humans
KW - Image Processing, Computer-Assisted
KW - Mammography
KW - Pilot Projects
KW - Radiology
KW - Visual Perception
U2 - 10.1136/amiajnl-2012-001503
DO - 10.1136/amiajnl-2012-001503
M3 - Article
C2 - 23788627
VL - 20
SP - 1067
EP - 1075
JO - J. Am. Medical Informatics Assoc.
JF - J. Am. Medical Informatics Assoc.
IS - 6
M1 - 6
ER -