Towards real-time STEM simulations through targeted subsampling strategies

Alex W. Robinson, Jack Wells, Daniel Nicholls, Amirafshar Moshtaghpour, Miaofang Chi, Angus I. Kirkland, Nigel D. Browning

Research output: Contribution to journalArticlepeer-review

4 Scopus citations

Abstract

Scanning transmission electron microscopy images can be complex to interpret on the atomic scale as the contrast is sensitive to multiple factors such as sample thickness, composition, defects and aberrations. Simulations are commonly used to validate or interpret real experimental images, but they come at a cost of either long computation times or specialist hardware such as graphics processing units. Recent works in compressive sensing for experimental STEM images have shown that it is possible to significantly reduce the amount of acquired signal and still recover the full image without significant loss of image quality, and therefore it is proposed here that similar methods can be applied to STEM simulations. In this paper, we demonstrate a method that can significantly increase the efficiency of STEM simulations through a targeted sampling strategy, along with a new approach to independently subsample each frozen phonon layer. We show the effectiveness of this method by simulating a SrTiO3 grain boundary and monolayer 2H-MoS2 containing a sulphur vacancy using the abTEM software. We also show how this method is not limited to only traditional multislice methods, but also increases the speed of the PRISM simulation method. Furthermore, we discuss the possibility for STEM simulations to seed the acquisition of real data, to potentially lead the way to self-driving (correcting) STEM.

Original languageEnglish
Pages (from-to)53-66
Number of pages14
JournalJournal of Microscopy
Volume290
Issue number1
DOIs
StatePublished - Apr 2023

Funding

This work was performed in the Albert Crewe Centre (ACC) for Electron Microscopy, a shared research facility (SRF) fully supported by the University of Liverpool. This work was also funded by the EPSRC Centre for Doctoral Training in Distributed Algorithms (EP/S023445/1), Sivananthan Labs, and Rosalind Franklin Institute. M.C. would like to acknowledge the support by the US DOE Office of Science Early Career project FWP# ERKCZ55 and the Center for Nanophase Materials Sciences (CNMS), a US DOE Office of Science User Facility. The authors would also like to recognise the efforts of Jacob Madsen and Toma Susi for their development of abTEM, as well as Colin Ophus and Alan Pryor Jr for their development of the PRISM algorithm.

FundersFunder number
Albert Crewe Centre
Center for Nanophase Materials Sciences
EPSRC Centre for Doctoral Training in Distributed AlgorithmsEP/S023445/1
Rosalind Franklin Institute
Sivananthan Labs
Office of ScienceERKCZ55
University of Liverpool

    Keywords

    • artificial intelligence
    • beam damage
    • compressive sensing
    • inpainting
    • stem simulation
    • subsampling

    Fingerprint

    Dive into the research topics of 'Towards real-time STEM simulations through targeted subsampling strategies'. Together they form a unique fingerprint.

    Cite this