Phaseless computational imaging with a radiating metasurface.

Imaging systems using aspheric imaging lenses with complementary computation can deliver performance unobtainable in conventional imaging systems. These new imaging systems, termed Wavefront coded imaging systems, use specialized optics to capture a coded image of the scene. Decoding the intermediate image provides the "human-usable" image expected of an imaging system. Computation for the decoding step can be made completely transparent to the user with today's technology. Real-time Wavefront coded systems are feasible and cost-effective. This "computational imaging" technology can be adapted to solve a wide range of imaging problems. Solutions include the ability to provide focus-free imaging, to increase the field of view, to increase the depth of read, to correct for aberrations (even in single lens systems), and to account for assembly and temperature induced misalignment. Wavefront coded imaging has been demonstrated across a wide range of applications, including microscopy, miniature cameras, machine vision systems, infrared imaging systems and telescopes.

3D ultrasound imaging is becoming increasingly prevalent in the medical field. Compared to conventional 2D imaging systems, 3D imaging can provide a detailed view of tissue structures that makes diagnosis easier for the physicians. In addition, 2D image slices can be formed at various orientations to the transducer, making the examination less dependent on the skill of the sonographer. However, various challenges exist in developing a 3D imaging system, such as integration of a large number of elements, as well as post-processing of datasets received from a large number of channels. 2D transducer arrays are typically integrated with custom ICs in the probe handle to perform some intermediate beamforming and to reduce the number of cable connections to the imaging system. Capacitive micromachined ultrasonic transducers (CMUTs) have emerged as an alternative to piezoelectric transducers. Being a MEMS device, they greatly benefit from flexibility and ease of fabrication, and can be seamlessly integrated with electronics. Previous work demonstrates 3D stacking of CMUTs and dummy ICs with an intermediate interposer layer. However, that represents more of a mechanical demonstration of 3D integration. In this paper, we present a fully functional 3D ultrasound imaging system comprising a 32×32 2D CMUT array, 3D-stacked with front-end ICs using flip-chip bonding technology. The imaging system is capable of capturing real-time volumetric ultrasound data, and displaying 2D and 3D ultrasound images.

Conventional multichannel imaging systems comprise of many optical channels having similar imaging properties, namely field-of-view (FOV) and angular resolution/magnification. We demonstrated that the different optical channels can be designed such that each optical channel captures a different FOV and angular resolution compared to its neighboring channels. We designed and experimentally demonstrated a three-channel multiresolution imaging system where the first optical channel has the narrowest FOV (7°) and highest angular resolution (0.0096°) and the third optical channel has the widest FOV (80°) and lowest angular resolution (0.078°)1. The second optical channel has intermediate properties. The performance of the demonstrated three-channel imaging system however was affected by chromatic aberrations as it was designed for a single wavelength of 587.6 nm. The first optical channel was largely influenced by longitudinal chromatic aberration while the third channel by lateral chromatic aberration. Therefore, we have replaced the aspherical refractive lenses by hybrid lenses, which contain diffractive structures on top of their refractive surfaces, in the three-channel multiresolution imaging system to reduce its chromatic aberrations. The performance of the three channels with hybrid lenses is compared with those of the corresponding channels without hybrid lenses. The longitudinal color aberration of the first optical channel has been reduced from 1.7 mm to 0.2 mm; whereas the lateral color aberration of the third optical channel has been reduced from 250 μm to 14 μm. In conclusion, the hybrid lenses have reduced the chromatic aberrations of the three channels and extended the operating spectral range of the imaging system in the visible wavelength range.

We have designed and fabricated four LDA optical setups consisting of aberration compensated four different compact two hololens imaging systems. We have experimentally investigated and realized a hololens recording geometry which is interferogram of converging spherical wavefront with mutually coherent planar wavefront. Proposed real time monitoring and actual fringe field analysis techniques allow complete characterizations of fringes formed at measurement volume and permit to evaluate beam quality, alignment and fringe uniformity with greater precision. After experimentally analyzing the fringes formed at measurement volume by all four imaging systems, it is found that fringes obtained using compact two hololens imaging systems get improved both qualitatively and quantitatively compared to that obtained using conventional imaging system. Results indicate qualitative improvement of non-uniformity in fringe thickness and micro intensity variations perpendicular to the fringes, and quantitative improvement of 39.25% in overall average normalized standard deviations of fringe width formed by compact two hololens imaging systems compare to that of conventional imaging system.

Metasurface has drawn extensive attention due to its capability of modulating light with a high degree of freedom through ultrathin and sub-wavelength optical elements, and metalens, as one of its important applications, promises to replace the bulky refractive optics, facilitating the imaging system light-weight and compact characteristics. Besides, computer-generated holography (CGH) is of substantial interest for three-dimensional (3D) imaging technology by virtue of its ability of restoring the whole optical wave field and re-constructing the true 3D scene. Consequently, the combination of metalens and CGH holds transformative potential in enabling the miniaturization of 3D imaging systems. However, its imaging performance is subject to the aberrations and speckle noises originating from the metalens and CGH. Inspired by recent progress that computational imaging can be applied to close the gap, a novel full-color imaging system, adopting end-to-end joint optimization of metalens and CGH for high imaging quality, is proposed in this paper. The U-net based network as the pre-processing adjusts weights to make the holographic reconstruction offset imaging defects, incorporating the imaging processing into the step of generating hologram. Optimized by deep learning, the proposed imaging system is capable of full-color imaging with high fidelity in a compact form factor, envisioned to take an essential step towards the high-performance miniaturized imaging system.

Photoacoustic (PA) imaging systems are spreading in the biomedical community, and the development of new PA contrast agents is an active area of research. However, PA contrast agents are usually characterized with spectrophotometry or uncalibrated PA imaging systems, leading to partial assessment of their PA efficiency. To enable quantitative PA spectroscopy of contrast agents in vitro with conventional PA imaging systems, we have developed an adapted calibration method. Contrast agents in solution are injected in a dedicated non-scattering tube phantom imaged at different optical wavelengths. The calibration method uses a reference solution of cupric sulfate to simultaneously correct for the spectral energy distribution of excitation light at the tube location and perform a conversion of the tube amplitude in the image from arbitrary to spectroscopic units. The method does not require any precise alignment and provides quantitative PA spectra, even with non-uniform illumination and ultrasound sensitivity. It was implemented on a conventional imaging setup based on a tunable laser operating between 680 nm and 980 nm and a 5 MHz clinical ultrasound array. We demonstrated robust calibrated PA spectroscopy with sample volumes as low as 15 μL of known chromophores and commonly used contrast agents. The validated method will be an essential and accessible tool for the development of new and efficient PA contrast agents by improving their quantitative characterization.

Much research effort has been spent in the 21st century on superresolution imaging techniques, methods which can beat the diffraction limit. Subwavelength composite structures called ``metamaterials" had initially shown great promise in superresolution imaging applications in the early 2000s, owing to their potential for nearly arbitrary capabilities in controlling light. However, for optical frequencies they are often plagued by absorption and scattering losses which can decay or destroy their interesting properties. Similar issues limit the application of other superresolution devices operating as effective media, or metal films that can transfer waves with large momentum by supporting surface plasmon polaritons. In this dissertation, new methods of mitigating the loss of object information in lossy and noisy optical imaging systems are presented. The result is an improvement in the upper bound on lateral spatial resolution. A concentration is placed on metamaterial and plasmonic imaging systems, and the same methods are subsequently adapted to more conventional far-field imaging systems. First, through numerical simulation it is shown that a lossy metamaterial lens has degraded imaging performance which can be partially compensated by deconvolution post-processing of the resultant image. This post-processing procedure is then shown to emulate a physical process called plasmon injection, which has been previously implemented to effectively remove the losses in a plasmonic metamaterial. Next, a more realistic scenario is considered; a thin film of silver acting as a near-field plasmonic ``superlens." In this case, methods are implemented to model incoherent light propagation so that the image can be reconstructed using only intensity data, removing the need for phase measurement. The same procedure from above is followed, and the resolution is enhanced. To push the resolution further, a spatial filtering method called active convolved illumination is developed to overcome the resolution limit set by the noise floor of the system. Finally, the spatial filtering methods are applied to more a more conventional far-field imaging system. Supported by experiment, the lateral resolution of a low numerical aperture imaging system is improved by blocking photons at the Fourier plane. For coherent light, a diffractive superlens is designed which uses the same principles from the above theory, except it encodes the high spatial frequency waves into propagating waves via a diffraction grating. The result is lateral resolution performance that surpasses similar previously published devices by 10 nm at a wavelength more than 80 nm longer.

Sparse synthetic transmit aperture (STA) imaging systems are a good alternative to the conventional phased array systems. Unfortunately, the sparse STA imaging systems suffer from some limitations, which can be overcome with a proper design. In order to do so, a simulated annealing algorithm, combined with an effective approach can used for optimization of a sparse STA ultrasound imaging system. In this paper, three two-stage algorithms for optimization of both the positions of the transmit sub-apertures and the weights of the receive elements are considered and studied. The first stage of the optimization employs a simulated annealing algorithm that optimizes the locations of the transmit sub-aperture centers for a set of weighting functions. Three optimization criteria used at this stage of optimization are studied and compared. The first two criteria are conventional. The third criterion, proposed in this paper, combines the first two criteria. At the second stage of optimization, an appropriate weighting function for the receive elements is selected. The sparse STA system under study employs a 64-element array, where all elements are used in receive and six sub-apertures are used in transmit. Compared to a conventional phased array imaging system, this system acquires images of better quality 21 times faster than an equivalent phased array system.

Spectral sensing has been widely utilized for detecting foodborne contaminants. The objective of this research was to develop a handheld multispectral instrument for food safety inspection for poultry and other foodstuffs. The prototype system developed in this research consisted of a compact two-band spectral imaging system, LED light, and handheld computer. The two-band spectral imaging system was a two-port imaging system that consisted of two identical digital monochrome cameras, optical system, and two narrow bandpass filters. By incorporating an interchangeable filter design, the imaging system can measure any two spectral bands in the 400 to 1000 nm portion of the spectrum without any complicated manufacturing process. That is a great advantage in terms of the selection of the spectral bands, as compared to conventional multispectral imaging systems that integrate filters and sensors in one unit. Lens distortions and geometric misalignment of the two cameras were mathematically corrected, resulting in co-registered two-band images. The prototype system was tested with poultry carcasses, and the preliminary results showed that the handheld two-band spectral imaging system could effectively detect feces and ingesta on the surface of poultry carcass.

Breakthroughs brought about by two‐dimensional (2D) materials in the field of photodetection have opened up new possibilities in infrared imaging. However, challenges still exist in fabricating high‐density detector arrays using such materials, which are essential for traditional imaging systems. In this study, we present a state‐of‐the‐art computing imaging system that utilizes a MoTe2/Si self‐powered photodetector coupled with flexible Hadamard modulation algorithms. This system demonstrates remarkable capability to produce high‐quality images in the shortwave infrared (SWIR) band, surpassing the capabilities of devices based on alternative material systems. The exceptional infrared imaging capability primarily stems from the MoTe2/Si photodetector's inherent features, including an ultra‐wide spectral range (265–1550 nm) and extremely high sensitivity (linear dynamic range (LDR) up to 123 dB, responsivity (R) up to 0.33 A W–1, external quantum efficiency (EQE) up to 43% and a specific detectivity (D*) exceeding 2.9 × 1011 Jones). Moreover, the imaging system demonstrates the ability to achieve high‐quality edge imaging of objects in the SWIR band (1550 nm), even in strong scattering environments and under low sampling rate conditions (sampling rate of 25%). We believe that this work will effectively advance the application scope of 2D materials in the field of computational imaging in SWIR bands.image

Laser three-dimensional (3D) image is a novel non-cooperative target 3D image acquisition technology, and the improvements in detection capability and imaging accuracy of the system are critically dependent on efficient echo-signal processing technique and 3D reconstruction method. The registration process is an essential step in array 3D imaging laser point cloud data processing. Registration of point clouds is an effective method that solves the problem caused by the target self-occlusion in the laser 3D imaging system. The accurate registration result will help provide better support for subsequent applications, such as object reconstruction and target recognition. In this study, a set of thresholds in the iterative closest point (ICP) algorithm is analysed on the basis of the characteristics of the laser array 3D imaging system and is combined with the range error and visual lateral resolution of the system, which are both important parameters in the imaging system. To improve the accuracy and speed of registration, the stop threshold of the iterative algorithm and the corresponding point-distance threshold in the algorithm are established in a novel way based on the range error and visual lateral resolution of the system. This forms the foundation, based on which an adaptive threshold ICP algorithm is proposed. The principal idea of the algorithm is to improve the threshold set that has a considerable effect on the accuracy and speed of registration. At first, the characteristics of the imaging point clouds of the laser array 3D imaging system are analysed in the algorithm. Based on this analysis, the distance between the two point clouds and corresponding points with ideal registrations are estimated theoretically, according to the range error and visual lateral resolution of the system. The simulation results show that the theoretically estimated results and actual results have the same variation tendency, thus providing a theoretical basis for subsequent improvements. Next, the estimated results are added according to the iterative closest point algorithm. This implies that the registration thresholds are capable of changing and adapting under different iterations and imaging systems, thus improving the speed and accuracy of registrations. This phenomenon is not seen in other algorithms. Experiments involving laser array imaging of a point cloud and laser scanning of depth imaging data show that the algorithm is practical and effective for both imaging types of point clouds and can improve the speed and accuracy of registration notably. The effectiveness and feasibility of the proposed algorithm are thus verified. In addition, for its full consideration of the imaging system, the basic idea of the proposed algorithm can be used for designing future applications as required.

There is an increasing amount of interest in functionalized microstructural, microphotonic and microelectromechanical systems (MEMS) for use in biological applications. By scanning a tightly focused ultra-short pulsed laser beam inside a wide variety of commercially available polymer systems, the flexibility of the multiphoton microscope can be extended to include routine manufacturing of micro-devices with feature sizes well below the diffraction limit. Compared with lithography, two-photon polymerization has the unique ability to additively realize designs with high resolution in three dimensions; this permits the construction of cross-linked components and structures with hollow cavities. In light of the increasing availability of multiphoton imaging systems at research facilities, femtosecond laser manufacturing becomes particularly attractive in that the modality provides a readily accessible, rapid and high-accuracy 3-D processing capability to biological investigators interested in culture scaffolds and biomimetic tissue engineering, bio-MEMS, biomicrophotonics and microfluidics applications. This manuscript overviews recent efforts towards to enabling user accessible 3-D micro-manufacturing capabilities on a conventional proprietary-based imaging system. Software which permits the off-line design of microstructures and leverages the extensibility of proprietary LCSM image acquisition software to realize designs is introduced. The requirements for multiphoton photo-disruption (ablation) are in some ways analogous to those for multiphoton polymerization. Hence, “beam-steering” also facilitates precision photo-disruption of biological tissues with 3-D resolution, and applications involving tissue microdissection and intracellular microsurgery or three-dimensionally resolved fluorescence recovery after photobleaching (FRAP) studies can benefit from this work as well.

A novel anti-cat-eye effect imaging technique based on wavefront coding is proposed as a solution to the problem of previous anti-cat-eye effect imaging techniques where imaging quality was sacrificed to reduce the retroreflection from the photoelectric imaging equipment. With the application of the Fresnel–Kirchhoff diffraction theory, and the definition of generalized pupil function combining both phase modulation and defocus factors, the cat-eye echo formation of the wavefront coded imaging system is theoretically modeled. Based on the physical model, the diffracted spot profile distribution and the light intensity distribution on the observation plane are further simulated with the changes in the defocus parameter and the phase modulation coefficient. A verification test on the cat-eye laser echo power of the wavefront coded imaging system and that of the conventional imaging system at a 20 m distance are conducted, respectively. Simulations and experiment results show that compared with conventional imaging systems, the wavefront coding imaging system can reduce the retroreflection echo by two orders of magnitude while maintaining better imaging quality through defocusing.

In this paper we present a normalized method of deriving a phase pupil function to extend the focal depth of imaging systems specially used for small object tracking. The method is based on the concept that the intensity distribution in the vicinity of the focal plane can be controlled and redistributed by means of a phase pupil function. This phase pupil function allows the peak intensity of a point-spread function (PSF) of the imaging system to remain relatively uniform, and the profile of the PSF to be approximately fitted to a Gaussian function in an extended range of the focal depth. A rotational symmetric aspheric phase plate has been designed and fabricated. The imaging system incorporating this pupil plate has extended the focal depth more than twofold compared with a conventional imaging system. Theoretical analyses and experimental results are also presented in support of this method.

To date, imaging systems have generally been designed to provide an even spatiotemporal resolution across the field of view (FOV). However, this becomes a fundamental limitation when we aim to simultaneously observe varying dynamics at different parts of the FOV. In conventional imaging systems, to capture fast dynamics occurring at only a small portion of the FOV, the entire imaging system’s sampling rate must be increased. This is a major problem if different parts of the FOV must rather be imaged at high spatial resolutions beyond the diffraction limit and require a sacrifice in temporal resolution. To answer this unmet challenge, we propose tunable SIM, which enables adaptive modulation of spatiotemporally varying structured illumination across different parts of the FOV. Using tunable SIM, we exploit the varying and designable spatiotemporal resolution to demonstrate simultaneous measurements of subdiffraction-limited changes in the actin fine structure of U87MG-EGFP-CD9 cells and the fast viscous flow inducing these structural changes.