Towards Rapid Autonomous Electron Microscopy with Active Meta-Learning

Gayathri Saranathan, Martin Foltin, Aalap Tripathy, Maxim Ziatdinov, Ann Mary Justine Koomthanam, Suparna Bhattacharya, Ayana Ghosh, Kevin Roccapriore, Sreenivas Rangan Sukumar, Paolo Faraboschi

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

We introduce a novel approach, Active Meta-learning, to improve computational control across various scientific experiments. It's particularly valuable for spectral reconstruction in STEM EELS nanoparticle plasmonic images. Traditionally, separate AI models were trained for each experiment via active learning, but this approach could face scalability issues with high-resolution data and the need for complex AI models due to intricate structure-property relationships. In this work we demonstrate the feasibility of learning AI structural representations across multiple experiments. We train a meta model from 10 prior experiments carried out such that the model can adapt to new unseen conditions in considerably less time than when trained from scratch. We utilize the Reptile algorithm, a first-order, model-agnostic meta-learning approach. To enhance and expand the meta-training dataset, conventional computer vision methods are applied to augment images from previous experiments. We observe up to ~30-40% reduction in the number of training epochs for active learning exploration. The approach will be extended to distributed meta-learning workflows; meta-model trained in HPC datacenter using data from different microscopy sites and pushed to individual sites for active learning.

Original languageEnglish
Title of host publicationProceedings of 2023 SC Workshops of the International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023
PublisherAssociation for Computing Machinery
Pages81-87
Number of pages7
ISBN (Electronic)9798400707858
DOIs
StatePublished - Nov 12 2023
Event2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023 - Denver, United States
Duration: Nov 12 2023Nov 17 2023

Publication series

NameACM International Conference Proceeding Series

Conference

Conference2023 International Conference on High Performance Computing, Network, Storage, and Analysis, SC Workshops 2023
Country/TerritoryUnited States
CityDenver
Period11/12/2311/17/23

Keywords

  • Active Learning
  • BO
  • DKL
  • DKLGPR
  • EELS
  • MAML
  • Meta-learning
  • Reptile
  • STEM

Fingerprint

Dive into the research topics of 'Towards Rapid Autonomous Electron Microscopy with Active Meta-Learning'. Together they form a unique fingerprint.

Cite this