Applications of wavefront coded imaging

Conventional multichannel imaging systems comprise of many optical channels having similar imaging properties, namely field-of-view (FOV) and angular resolution/magnification. We demonstrated that the different optical channels can be designed such that each optical channel captures a different FOV and angular resolution compared to its neighboring channels. We designed and experimentally demonstrated a three-channel multiresolution imaging system where the first optical channel has the narrowest FOV (7°) and highest angular resolution (0.0096°) and the third optical channel has the widest FOV (80°) and lowest angular resolution (0.078°)1. The second optical channel has intermediate properties. The performance of the demonstrated three-channel imaging system however was affected by chromatic aberrations as it was designed for a single wavelength of 587.6 nm. The first optical channel was largely influenced by longitudinal chromatic aberration while the third channel by lateral chromatic aberration. Therefore, we have replaced the aspherical refractive lenses by hybrid lenses, which contain diffractive structures on top of their refractive surfaces, in the three-channel multiresolution imaging system to reduce its chromatic aberrations. The performance of the three channels with hybrid lenses is compared with those of the corresponding channels without hybrid lenses. The longitudinal color aberration of the first optical channel has been reduced from 1.7 mm to 0.2 mm; whereas the lateral color aberration of the third optical channel has been reduced from 250 μm to 14 μm. In conclusion, the hybrid lenses have reduced the chromatic aberrations of the three channels and extended the operating spectral range of the imaging system in the visible wavelength range.

Computational imaging modalities support a simplification of the active architectures required in an imaging system and these approaches have been validated across the electromagnetic spectrum. Recent implementations have utilized pseudo-orthogonal radiation patterns to illuminate an object of interest-notably, frequency-diverse metasurfaces have been exploited as fast and low-cost alternative to conventional coherent imaging systems. However, accurately measuring the complex-valued signals in the frequency domain can be burdensome, particularly for sub-centimeter wavelengths. Here, computational imaging is studied under the relaxed constraint of intensity-only measurements. A novel 3D imaging system is conceived based on 'phaseless' and compressed measurements, with benefits from recent advances in the field of phase retrieval. In this paper, the methodology associated with this novel principle is described, studied, and experimentally demonstrated in the microwave range. A comparison of the estimated images from both complex valued and phaseless measurements are presented, verifying the fidelity of phaseless computational imaging.

A novel anti-cat-eye effect imaging technique based on wavefront coding is proposed as a solution to the problem of previous anti-cat-eye effect imaging techniques where imaging quality was sacrificed to reduce the retroreflection from the photoelectric imaging equipment. With the application of the Fresnel–Kirchhoff diffraction theory, and the definition of generalized pupil function combining both phase modulation and defocus factors, the cat-eye echo formation of the wavefront coded imaging system is theoretically modeled. Based on the physical model, the diffracted spot profile distribution and the light intensity distribution on the observation plane are further simulated with the changes in the defocus parameter and the phase modulation coefficient. A verification test on the cat-eye laser echo power of the wavefront coded imaging system and that of the conventional imaging system at a 20 m distance are conducted, respectively. Simulations and experiment results show that compared with conventional imaging systems, the wavefront coding imaging system can reduce the retroreflection echo by two orders of magnitude while maintaining better imaging quality through defocusing.

We have designed and fabricated four LDA optical setups consisting of aberration compensated four different compact two hololens imaging systems. We have experimentally investigated and realized a hololens recording geometry which is interferogram of converging spherical wavefront with mutually coherent planar wavefront. Proposed real time monitoring and actual fringe field analysis techniques allow complete characterizations of fringes formed at measurement volume and permit to evaluate beam quality, alignment and fringe uniformity with greater precision. After experimentally analyzing the fringes formed at measurement volume by all four imaging systems, it is found that fringes obtained using compact two hololens imaging systems get improved both qualitatively and quantitatively compared to that obtained using conventional imaging system. Results indicate qualitative improvement of non-uniformity in fringe thickness and micro intensity variations perpendicular to the fringes, and quantitative improvement of 39.25% in overall average normalized standard deviations of fringe width formed by compact two hololens imaging systems compare to that of conventional imaging system.

Under the DARPA COMP-I (Compressive Optical MONTAGE Photography Initiative) program, the goal of this project is to significantly reduce the volume and form factor of infrared imaging systems without loss of resolution. The approach taken is to use an array of small lenses with extremely short focal lengths rather than the conventional approach of a single aperture lens system with large diameter and focal length. The array of lenses creates multiple copies of the scene on a single focal plane detector array, which are then used to reconstruct an image with resolution comparable to or higher than that of the conventional imaging system. This is achieved by a computational method known as super-resolution reconstruction. Work at the University of Delaware towards this end includes participation in the design and optimization of the optical system along with fabrication of some of the optical elements. Grayscale lithography using a high-energy beam sensitive (HEBS) glass photomask and proportional dry etch pattern transfer are the key techniques enabling the fabrication process. In this paper we will discuss the design of the imaging system while focusing on the fabrication aspects of the project.

3D ultrasound imaging is becoming increasingly prevalent in the medical field. Compared to conventional 2D imaging systems, 3D imaging can provide a detailed view of tissue structures that makes diagnosis easier for the physicians. In addition, 2D image slices can be formed at various orientations to the transducer, making the examination less dependent on the skill of the sonographer. However, various challenges exist in developing a 3D imaging system, such as integration of a large number of elements, as well as post-processing of datasets received from a large number of channels. 2D transducer arrays are typically integrated with custom ICs in the probe handle to perform some intermediate beamforming and to reduce the number of cable connections to the imaging system. Capacitive micromachined ultrasonic transducers (CMUTs) have emerged as an alternative to piezoelectric transducers. Being a MEMS device, they greatly benefit from flexibility and ease of fabrication, and can be seamlessly integrated with electronics. Previous work demonstrates 3D stacking of CMUTs and dummy ICs with an intermediate interposer layer. However, that represents more of a mechanical demonstration of 3D integration. In this paper, we present a fully functional 3D ultrasound imaging system comprising a 32×32 2D CMUT array, 3D-stacked with front-end ICs using flip-chip bonding technology. The imaging system is capable of capturing real-time volumetric ultrasound data, and displaying 2D and 3D ultrasound images.

Metasurface has drawn extensive attention due to its capability of modulating light with a high degree of freedom through ultrathin and sub-wavelength optical elements, and metalens, as one of its important applications, promises to replace the bulky refractive optics, facilitating the imaging system light-weight and compact characteristics. Besides, computer-generated holography (CGH) is of substantial interest for three-dimensional (3D) imaging technology by virtue of its ability of restoring the whole optical wave field and re-constructing the true 3D scene. Consequently, the combination of metalens and CGH holds transformative potential in enabling the miniaturization of 3D imaging systems. However, its imaging performance is subject to the aberrations and speckle noises originating from the metalens and CGH. Inspired by recent progress that computational imaging can be applied to close the gap, a novel full-color imaging system, adopting end-to-end joint optimization of metalens and CGH for high imaging quality, is proposed in this paper. The U-net based network as the pre-processing adjusts weights to make the holographic reconstruction offset imaging defects, incorporating the imaging processing into the step of generating hologram. Optimized by deep learning, the proposed imaging system is capable of full-color imaging with high fidelity in a compact form factor, envisioned to take an essential step towards the high-performance miniaturized imaging system.

Sparse synthetic transmit aperture (STA) imaging systems are a good alternative to the conventional phased array systems. Unfortunately, the sparse STA imaging systems suffer from some limitations, which can be overcome with a proper design. In order to do so, a simulated annealing algorithm, combined with an effective approach can used for optimization of a sparse STA ultrasound imaging system. In this paper, three two-stage algorithms for optimization of both the positions of the transmit sub-apertures and the weights of the receive elements are considered and studied. The first stage of the optimization employs a simulated annealing algorithm that optimizes the locations of the transmit sub-aperture centers for a set of weighting functions. Three optimization criteria used at this stage of optimization are studied and compared. The first two criteria are conventional. The third criterion, proposed in this paper, combines the first two criteria. At the second stage of optimization, an appropriate weighting function for the receive elements is selected. The sparse STA system under study employs a 64-element array, where all elements are used in receive and six sub-apertures are used in transmit. Compared to a conventional phased array imaging system, this system acquires images of better quality 21 times faster than an equivalent phased array system.

Spectral sensing has been widely utilized for detecting foodborne contaminants. The objective of this research was to develop a handheld multispectral instrument for food safety inspection for poultry and other foodstuffs. The prototype system developed in this research consisted of a compact two-band spectral imaging system, LED light, and handheld computer. The two-band spectral imaging system was a two-port imaging system that consisted of two identical digital monochrome cameras, optical system, and two narrow bandpass filters. By incorporating an interchangeable filter design, the imaging system can measure any two spectral bands in the 400 to 1000 nm portion of the spectrum without any complicated manufacturing process. That is a great advantage in terms of the selection of the spectral bands, as compared to conventional multispectral imaging systems that integrate filters and sensors in one unit. Lens distortions and geometric misalignment of the two cameras were mathematically corrected, resulting in co-registered two-band images. The prototype system was tested with poultry carcasses, and the preliminary results showed that the handheld two-band spectral imaging system could effectively detect feces and ingesta on the surface of poultry carcass.

Much research effort has been spent in the 21st century on superresolution imaging techniques, methods which can beat the diffraction limit. Subwavelength composite structures called ``metamaterials" had initially shown great promise in superresolution imaging applications in the early 2000s, owing to their potential for nearly arbitrary capabilities in controlling light. However, for optical frequencies they are often plagued by absorption and scattering losses which can decay or destroy their interesting properties. Similar issues limit the application of other superresolution devices operating as effective media, or metal films that can transfer waves with large momentum by supporting surface plasmon polaritons. In this dissertation, new methods of mitigating the loss of object information in lossy and noisy optical imaging systems are presented. The result is an improvement in the upper bound on lateral spatial resolution. A concentration is placed on metamaterial and plasmonic imaging systems, and the same methods are subsequently adapted to more conventional far-field imaging systems. First, through numerical simulation it is shown that a lossy metamaterial lens has degraded imaging performance which can be partially compensated by deconvolution post-processing of the resultant image. This post-processing procedure is then shown to emulate a physical process called plasmon injection, which has been previously implemented to effectively remove the losses in a plasmonic metamaterial. Next, a more realistic scenario is considered; a thin film of silver acting as a near-field plasmonic ``superlens." In this case, methods are implemented to model incoherent light propagation so that the image can be reconstructed using only intensity data, removing the need for phase measurement. The same procedure from above is followed, and the resolution is enhanced. To push the resolution further, a spatial filtering method called active convolved illumination is developed to overcome the resolution limit set by the noise floor of the system. Finally, the spatial filtering methods are applied to more a more conventional far-field imaging system. Supported by experiment, the lateral resolution of a low numerical aperture imaging system is improved by blocking photons at the Fourier plane. For coherent light, a diffractive superlens is designed which uses the same principles from the above theory, except it encodes the high spatial frequency waves into propagating waves via a diffraction grating. The result is lateral resolution performance that surpasses similar previously published devices by 10 nm at a wavelength more than 80 nm longer.

The line spread function (LSF) is a classical figure of merit used to derive the modulation transfer function (MTF) of an imaging system. However this test cannot be directly applied to cameras based on an infrared focal plane array (IRFPA), as these sampled systems exhibit aliasing effects. ONERA has proposed a new technique called generalized line spread function allowing MTF assessment for sampled imaging systems. A testing of spatial frequency filtering becomes possible until at least twice the Nyquist frequency. The purpose of this paper is to show that this method is well-adapted to IRFPA cameras. In particular, the effects of bad a priori estimation of the characteristics of the camera are discussed. Secondly, we have carried on a laboratory experiment with a widespread infrared imaging system. The purpose is to demonstrate experimentally the advantages of this new method, not only in terms of performances but also in terms of simplicity of implementation and robustness. The infrared imaging system tested is a 512 by 512 Si:Pt IR5120C Mitsubishi camera equipped with a F/1.2 Angenieux lens.

In this paper we present a normalized method of deriving a phase pupil function to extend the focal depth of imaging systems specially used for small object tracking. The method is based on the concept that the intensity distribution in the vicinity of the focal plane can be controlled and redistributed by means of a phase pupil function. This phase pupil function allows the peak intensity of a point-spread function (PSF) of the imaging system to remain relatively uniform, and the profile of the PSF to be approximately fitted to a Gaussian function in an extended range of the focal depth. A rotational symmetric aspheric phase plate has been designed and fabricated. The imaging system incorporating this pupil plate has extended the focal depth more than twofold compared with a conventional imaging system. Theoretical analyses and experimental results are also presented in support of this method.

To date, imaging systems have generally been designed to provide an even spatiotemporal resolution across the field of view (FOV). However, this becomes a fundamental limitation when we aim to simultaneously observe varying dynamics at different parts of the FOV. In conventional imaging systems, to capture fast dynamics occurring at only a small portion of the FOV, the entire imaging system’s sampling rate must be increased. This is a major problem if different parts of the FOV must rather be imaged at high spatial resolutions beyond the diffraction limit and require a sacrifice in temporal resolution. To answer this unmet challenge, we propose tunable SIM, which enables adaptive modulation of spatiotemporally varying structured illumination across different parts of the FOV. Using tunable SIM, we exploit the varying and designable spatiotemporal resolution to demonstrate simultaneous measurements of subdiffraction-limited changes in the actin fine structure of U87MG-EGFP-CD9 cells and the fast viscous flow inducing these structural changes.

Wavefront coding involves the insertion of an asymmetric refractive mask close to the pupil plane of an imaging system so as to encode the image with a specific point spread function that, when combined with decoding of the recorded image, can enable greatly reduced sensitivity to imaging aberrations. The application of wavefront coding has potential in the fields of microscopy, where increased instantaneous depth of field is advantageous and in thermal imaging where it can enable the use of simple, low-cost, light-weight lens systems. It has been previously shown that wavefront coding can alleviate optical aberrations and extend the depth of field of incoherent imaging systems whilst maintaining diffraction-limited resolution. It is particularly useful in controlling thermally induced defocus aberrations in infrared imaging systems. These improvements in performance are subject to a range of constraints including the difficulty in manufacturing an asymmetrical phase mask and significant noise amplification in the digitally restored image. We describe the relation between the optical path difference (OPD) introduced by the phase mask and the magnitude of noise amplification in the restored image. In particular there is a trade between the increased tolerance to optical aberrations and reduced signal-to-noise ratio in the recovered image. We present numerical and experimental studies based of noise amplification with the specific consideration of a simple refractive infrared imaging system operated in an ambient temperature varying from 0°C to +50 C. These results are used to delineate the design and application envelope for which infrared imaging can benefit from wavefront coding.

The burgeoning field of astrophotonics, the interface between astronomy and photonics, is redefining astronomical instrumentation to replace traditional bulk optical systems with integrated optics. This drives the development of a new promising photonics-integrated interferometric imaging technique, called the segmented planar imaging detector for electro-optical reconnaissance (SPIDER). Compared to conventional imaging systems, SPIDER can reduce the size, weight, and power (SWaP) by one to two orders of magnitude for an equivalent imaging resolution in virtue of photonics-integrated technology. However, SPIDER has a dense lens distribution and tens of separated narrow wavebands demultiplexed by array waveguide gratings. In this paper, we developed a new simplified sparse-aperture photonics-integrated interferometer (SPIN) imaging system. The SPIN imaging system was no more a Michelson configuration interferometer as SPIDER and was designed as a Fizeau configuration interferometer imaging system. This transfer of configuration type affords a more concise structure; the SPIN was designed with much less apertures and fewer wavebands than those of SPIDER. Further, the SPIN yields enhanced modulation transfer function and imaging quality with equivalent aperture diameter, compared with SPIDER. The main barrier of this transfer is the elimination of coupling restriction at the tip of a waveguide, namely the apodization effect. This effect, which is caused by the coupling effect between Fourier lens and waveguide, hinders SPIN imaging systems from getting finer resolution. However, a microscope could be used to eliminate this effect. Moreover, a waveguide array is used to receive these finer details and enlarges the field of view in SPIN. The coupling efficiency of the waveguides and crosstalk errors between waveguides of array were analyzed, which are important for proper parameters setting in SPIN imaging system. Based on these analyses, the imaging principle was derived and a hyper-Laplacian-based imaging reconstruction algorithm was developed. A simulation of the SPIN imaging system with seven apertures and one imaging waveband demonstrated the high imaging quality.