Abstract
Rapid developments in machine vision technology have impacted a variety of applications, such as medical devices and autonomous driving systems. These achievements, however, typically necessitate digital neural networks with the downside of heavy computational requirements and consequent high energy consumption. As a result, real-time decision-making is hindered when computational resources are not readily accessible. Here we report a meta-imager designed to work together with a digital back end to offload computationally expensive convolution operations into high-speed, low-power optics. In this architecture, metasurfaces enable both angle and polarization multiplexing to create multiple information channels that perform positively and negatively valued convolution operations in a single shot. We use our meta-imager for object classification, achieving 98.6% accuracy in handwritten digits and 88.8% accuracy in fashion images. Owing to its compactness, high speed and low power consumption, our approach could find a wide range of applications in artificial intelligence and machine vision applications.
Original language | English |
---|---|
Pages (from-to) | 471-478 |
Number of pages | 8 |
Journal | Nature Nanotechnology |
Volume | 19 |
Issue number | 4 |
DOIs | |
State | Published - Apr 2024 |
Funding
H.Z. and J.G.V. acknowledge support from DARPA under contract HR001118C0015 and NAVAIR under contract N6893622C0030. X.Z. acknowledges support from ONR under contract N000142112468. Y.H. and Q.L. acknowledge support from NIH under contract R01DK135597. Meta-optic devices were manufactured as part of a user project at the Center for Nanophase Materials Sciences (CNMS), which is a US Department of Energy, Office of Science User Facility, Oak Ridge National Laboratory.
Funders | Funder number |
---|---|
Oak Ridge National Laboratory | |
U.S. Department of Energy | |
Office of Science | |
Defense Advanced Research Projects Agency | HR001118C0015 |
Naval Air Systems Command | N6893622C0030 |
Office of Naval Research | N000142112468 |
National Institutes of Health | R01DK135597 |