Multichannel meta-imagers for accelerating machine vision

Hanyu Zheng, Quan Liu, Ivan I. Kravchenko, Xiaomeng Zhang, Yuankai Huo, Jason G. Valentine

Research output: Contribution to journalArticlepeer-review

21 Scopus citations

Abstract

Rapid developments in machine vision technology have impacted a variety of applications, such as medical devices and autonomous driving systems. These achievements, however, typically necessitate digital neural networks with the downside of heavy computational requirements and consequent high energy consumption. As a result, real-time decision-making is hindered when computational resources are not readily accessible. Here we report a meta-imager designed to work together with a digital back end to offload computationally expensive convolution operations into high-speed, low-power optics. In this architecture, metasurfaces enable both angle and polarization multiplexing to create multiple information channels that perform positively and negatively valued convolution operations in a single shot. We use our meta-imager for object classification, achieving 98.6% accuracy in handwritten digits and 88.8% accuracy in fashion images. Owing to its compactness, high speed and low power consumption, our approach could find a wide range of applications in artificial intelligence and machine vision applications.

Original languageEnglish
Pages (from-to)471-478
Number of pages8
JournalNature Nanotechnology
Volume19
Issue number4
DOIs
StatePublished - Apr 2024

Funding

H.Z. and J.G.V. acknowledge support from DARPA under contract HR001118C0015 and NAVAIR under contract N6893622C0030. X.Z. acknowledges support from ONR under contract N000142112468. Y.H. and Q.L. acknowledge support from NIH under contract R01DK135597. Meta-optic devices were manufactured as part of a user project at the Center for Nanophase Materials Sciences (CNMS), which is a US Department of Energy, Office of Science User Facility, Oak Ridge National Laboratory.

FundersFunder number
Oak Ridge National Laboratory
U.S. Department of Energy
Office of Science
Defense Advanced Research Projects AgencyHR001118C0015
Naval Air Systems CommandN6893622C0030
Office of Naval ResearchN000142112468
National Institutes of HealthR01DK135597

    Fingerprint

    Dive into the research topics of 'Multichannel meta-imagers for accelerating machine vision'. Together they form a unique fingerprint.

    Cite this