End-to-end metasurface inverse design for single-shot multi-channel imaging Lin, Zin Pestourie, Raphaël Roques-Carmes, Charles Li, Zhaoyi Capasso, Federico Soljačić, Marin Johnson, Steven G. ddc:530 We introduce end-to-end inverse design for multi-channel imaging, in which a nanophotonic frontend is optimized in conjunction with an image-processing backend to extract depth, spectral and polarization channels from a single monochrome image. Unlike diffractive optics, we show that subwavelength-scale “metasurface” designs can easily distinguish similar wavelength and polarization inputs. The proposed technique integrates a single-layer metasurface frontend with an efficient Tikhonov reconstruction backend, without any additional optics except a grayscale sensor. Our method yields multi-channel imaging by spontaneous demultiplexing: the metaoptics front-end separates different channels into distinct spatial domains whose locations on the sensor are optimally discovered by the inverse-design algorithm. We present large-area metasurface designs, compatible with standard lithography, for multi-spectral imaging, depth-spectral imaging, and “all-in-one” spectro-polarimetric-depth imaging with robust reconstruction performance (≲ 10% error with 1% detector noise). In contrast to neural networks, our framework is physically interpretable and does not require large training sets. It can be used to reconstruct arbitrary three-dimensional scenes with full multi-wavelength spectra and polarization textures. Optica Publishing Group 2022 info:eu-repo/semantics/article doc-type:article text http://purl.org/coar/resource_type/c_2df8fbb1 https://research-explorer.ista.ac.at/record/21638 Lin Z, Pestourie R, Roques-Carmes C, et al. End-to-end metasurface inverse design for single-shot multi-channel imaging. <i>Optics Express</i>. 2022;30(16):28358-28370. doi:<a href="https://doi.org/10.1364/oe.449985">10.1364/oe.449985</a> eng info:eu-repo/semantics/altIdentifier/doi/10.1364/oe.449985 info:eu-repo/semantics/altIdentifier/e-issn/1094-4087 info:eu-repo/semantics/altIdentifier/arxiv/2111.01071 info:eu-repo/semantics/altIdentifier/pmid/ 36299033 info:eu-repo/semantics/openAccess