Revolutionary Optical Imaging Enabled by Vectorial and Flat Optics

To date, imaging systems have generally been designed to provide an even spatiotemporal resolution across the field of view (FOV). However, this becomes a fundamental limitation when we aim to simultaneously observe varying dynamics at different parts of the FOV. In conventional imaging systems, to capture fast dynamics occurring at only a small portion of the FOV, the entire imaging system’s sampling rate must be increased. This is a major problem if different parts of the FOV must rather be imaged at high spatial resolutions beyond the diffraction limit and require a sacrifice in temporal resolution. To answer this unmet challenge, we propose tunable SIM, which enables adaptive modulation of spatiotemporally varying structured illumination across different parts of the FOV. Using tunable SIM, we exploit the varying and designable spatiotemporal resolution to demonstrate simultaneous measurements of subdiffraction-limited changes in the actin fine structure of U87MG-EGFP-CD9 cells and the fast viscous flow inducing these structural changes.

Conventional multichannel imaging systems comprise of many optical channels having similar imaging properties, namely field-of-view (FOV) and angular resolution/magnification. We demonstrated that the different optical channels can be designed such that each optical channel captures a different FOV and angular resolution compared to its neighboring channels. We designed and experimentally demonstrated a three-channel multiresolution imaging system where the first optical channel has the narrowest FOV (7°) and highest angular resolution (0.0096°) and the third optical channel has the widest FOV (80°) and lowest angular resolution (0.078°)1. The second optical channel has intermediate properties. The performance of the demonstrated three-channel imaging system however was affected by chromatic aberrations as it was designed for a single wavelength of 587.6 nm. The first optical channel was largely influenced by longitudinal chromatic aberration while the third channel by lateral chromatic aberration. Therefore, we have replaced the aspherical refractive lenses by hybrid lenses, which contain diffractive structures on top of their refractive surfaces, in the three-channel multiresolution imaging system to reduce its chromatic aberrations. The performance of the three channels with hybrid lenses is compared with those of the corresponding channels without hybrid lenses. The longitudinal color aberration of the first optical channel has been reduced from 1.7 mm to 0.2 mm; whereas the lateral color aberration of the third optical channel has been reduced from 250 μm to 14 μm. In conclusion, the hybrid lenses have reduced the chromatic aberrations of the three channels and extended the operating spectral range of the imaging system in the visible wavelength range.

Shaping the structure of light with flat optical devices has driven significant advancements in our fundamental understanding of light and light-matter interactions, and enabled a broad range of applications, from image processing and microscopy to optical communication, quantum information processing, and the manipulation of microparticles. Yet, pushing the boundaries of structured light beyond the linear optical regime remains an open challenge. Nonlinear optical interactions, such as wave mixing in nonlinear flat optics, offer a powerful platform to unlock new degrees of freedom and functionalities for generating and detecting structured light. In this study, we experimentally demonstrate the non-trivial structuring of third-harmonic light enabled by the addition of total angular momentum projection in a nonlinear, isotropic flat optics element-a single thin film of amorphous silicon. We identify the total angular momentum projection and helicity as the most critical properties for analyzing the experimental results. The theoretical approach we propose, supported by numerical simulations, offers quantitative predictions for light structuring through nonlinear wave mixing under various pumping conditions, including vectorial and non-paraxial pump light. Notably, we reveal that the shape of third-harmonic light is highly sensitive to the polarization state of the pump. Our findings demonstrate that harnessing the addition of total angular momentum projection in nonlinear wave mixing can be a powerful strategy for generating and detecting precisely controlled structured light.

The principle of equivalence between the imaging properties of scanning and conventional imaging systems has been proven in the past by assuming scalar sources of radiation and isotropic media. We prove here its general validity for optical systems with vector, electromagnetic sources of radiation and any optically nonactive media.

AN AFFORDABLE AND EASY TO IMPLEMENT STRATEGY FOR PRECLINICAL MOLECULAR IMAGING IN THERANOSTICS DEVELOPMENT

Performance improvement of gamma-imaging system by selective fusion of deep-learning-based collimator-less and Compton images with FlowNet model: A Monte-Carlo simulation

There is an increasing amount of interest in functionalized microstructural, microphotonic and microelectromechanical systems (MEMS) for use in biological applications. By scanning a tightly focused ultra-short pulsed laser beam inside a wide variety of commercially available polymer systems, the flexibility of the multiphoton microscope can be extended to include routine manufacturing of micro-devices with feature sizes well below the diffraction limit. Compared with lithography, two-photon polymerization has the unique ability to additively realize designs with high resolution in three dimensions; this permits the construction of cross-linked components and structures with hollow cavities. In light of the increasing availability of multiphoton imaging systems at research facilities, femtosecond laser manufacturing becomes particularly attractive in that the modality provides a readily accessible, rapid and high-accuracy 3-D processing capability to biological investigators interested in culture scaffolds and biomimetic tissue engineering, bio-MEMS, biomicrophotonics and microfluidics applications. This manuscript overviews recent efforts towards to enabling user accessible 3-D micro-manufacturing capabilities on a conventional proprietary-based imaging system. Software which permits the off-line design of microstructures and leverages the extensibility of proprietary LCSM image acquisition software to realize designs is introduced. The requirements for multiphoton photo-disruption (ablation) are in some ways analogous to those for multiphoton polymerization. Hence, “beam-steering” also facilitates precision photo-disruption of biological tissues with 3-D resolution, and applications involving tissue microdissection and intracellular microsurgery or three-dimensionally resolved fluorescence recovery after photobleaching (FRAP) studies can benefit from this work as well.

Imaging systems using aspheric imaging lenses with complementary computation can deliver performance unobtainable in conventional imaging systems. These new imaging systems, termed Wavefront coded imaging systems, use specialized optics to capture a coded image of the scene. Decoding the intermediate image provides the "human-usable" image expected of an imaging system. Computation for the decoding step can be made completely transparent to the user with today's technology. Real-time Wavefront coded systems are feasible and cost-effective. This "computational imaging" technology can be adapted to solve a wide range of imaging problems. Solutions include the ability to provide focus-free imaging, to increase the field of view, to increase the depth of read, to correct for aberrations (even in single lens systems), and to account for assembly and temperature induced misalignment. Wavefront coded imaging has been demonstrated across a wide range of applications, including microscopy, miniature cameras, machine vision systems, infrared imaging systems and telescopes.

In the modern tactical imaging environment, new computational imaging (CI) systems and algorithms are being used to improve speed and accuracy for detection tasks. Therefore, a measurement technique is needed to predict the performance of complex non-shift invariant EO/IR imaging systems, including CI systems. Detection performance of traditional imaging systems can be modeled using current system metrics and measurements such as Modulation Transfer Function (MTF), Signal to Noise (SNR), and instantaneous Field of View (iFOV). In this correspondence, we propose a technique to experimentally measure a detection sensitivity metric for non-traditional CI systems. The detection sensitivity metric predicts the upper bound of linear algorithm performance though evaluation of a matched filter. The experimental results are compared with theoretical expected values though the Night Vision Integrated Performance Model (NV-IPM). Additionally, we demonstrate the experimental results for a variety of imaging systems (IR, visible, and color), target sizes and orientations, as well as SNR values. Our results demonstrate how this detection sensitivity metric can be measured to provide additional insight into the final system performance.

Much research effort has been spent in the 21st century on superresolution imaging techniques, methods which can beat the diffraction limit. Subwavelength composite structures called ``metamaterials" had initially shown great promise in superresolution imaging applications in the early 2000s, owing to their potential for nearly arbitrary capabilities in controlling light. However, for optical frequencies they are often plagued by absorption and scattering losses which can decay or destroy their interesting properties. Similar issues limit the application of other superresolution devices operating as effective media, or metal films that can transfer waves with large momentum by supporting surface plasmon polaritons. In this dissertation, new methods of mitigating the loss of object information in lossy and noisy optical imaging systems are presented. The result is an improvement in the upper bound on lateral spatial resolution. A concentration is placed on metamaterial and plasmonic imaging systems, and the same methods are subsequently adapted to more conventional far-field imaging systems. First, through numerical simulation it is shown that a lossy metamaterial lens has degraded imaging performance which can be partially compensated by deconvolution post-processing of the resultant image. This post-processing procedure is then shown to emulate a physical process called plasmon injection, which has been previously implemented to effectively remove the losses in a plasmonic metamaterial. Next, a more realistic scenario is considered; a thin film of silver acting as a near-field plasmonic ``superlens." In this case, methods are implemented to model incoherent light propagation so that the image can be reconstructed using only intensity data, removing the need for phase measurement. The same procedure from above is followed, and the resolution is enhanced. To push the resolution further, a spatial filtering method called active convolved illumination is developed to overcome the resolution limit set by the noise floor of the system. Finally, the spatial filtering methods are applied to more a more conventional far-field imaging system. Supported by experiment, the lateral resolution of a low numerical aperture imaging system is improved by blocking photons at the Fourier plane. For coherent light, a diffractive superlens is designed which uses the same principles from the above theory, except it encodes the high spatial frequency waves into propagating waves via a diffraction grating. The result is lateral resolution performance that surpasses similar previously published devices by 10 nm at a wavelength more than 80 nm longer.

Conventional multispectral imaging systems based on bandpass filters struggle to record multispectral videos with high spatial resolutions because of their limited light efficiencies. This paper proposes a multi-aperture multispectral imaging system based on notch filters that overcomes this limitation by allowing light from most of the spectrum to pass through. Based on this imaging principle, a prototype multi-aperture multispectral imaging system comprising notch filters was built and demonstrated. Further, a dictionary learning- and total variation-based spectral super-resolution algorithm was developed to reconstruct spectral images. The simulation results obtained using public multispectral datasets showed that, compared to the dictionary learning-based spectral super-resolution algorithm, the proposed algorithm reconstructed the spectral information with a higher accuracy and removed noise, and the verification experiments confirmed the performance efficiency of the prototype system. The experimental results showed that the proposed imaging system can capture images with high spatial and spectral resolutions under low illumination conditions. The proposed algorithm improved the spectral resolution of the acquired data from 9 to 31 bands, and the average peak signal-to-noise ratio remained above 43 dB, which is 13 dB higher than those of the state-of-the-art coded aperture snapshot spectral imaging methods. Simultaneously, the frame rate of the imaging system was up to 5000 frames/s under natural daylight.

This study investigated a novel gamma camera for molecular breast tomosynthesis (MBT), which is a nuclear breast imaging method that uses limited angle tomography. The camera is equipped with a variable angle, slant-hole (VASH) collimator that allows the camera to remain close to the breast throughout the acquisition. The goal of this study was to evaluate the spatial resolution and count sensitivity of this camera and to compare contrast and contrast-to-noise ratio (CNR) with conventional planar imaging using an experimental breast phantom. The VASH collimator mounts to a commercial gamma camera for breast imaging that uses a pixelated (3.2 mm), 15 × 20 cm NaI crystal. Spatial resolution was measured in planar images over a range of distances from the collimator (30-100 mm) and a range of slant angles (-25° to 25°) using 99m Tc line sources. Spatial resolution was also measured in reconstructed MBT images including in the depth dimension. The images were reconstructed from data acquired over the -25° to 25° angular range using an iterative algorithm adapted to the slant-hole geometry. Sensitivity was measured over the range of slant angles using a disk source. Measured spatial resolution and sensitivity were compared to theoretical values. Contrast and CNR were measured using a breast phantom containing spherical lesions (6.2 mm and 7.8 mm diameter) and positioned over a range of depths in the phantom. The MBT and planar methods had equal scan time, and the count density in the breast phantom data was similar to that in clinical nuclear breast imaging. The MBT method used an iterative reconstruction algorithm combined with a postreconstruction Metz filter. The measured spatial resolution in planar images agreed well with theoretical calculations over the range of distances and slant angles. The measured FWHM was 9.7 mm at 50 mm distance. In reconstructed MBT images, the spatial resolution in the depth dimension was approximately 2.2 mm greater than the other two dimensions due to the limited angle data. The measured count sensitivity agreed closely with theory over all slant angles when using a wide energy window. At 0° slant angle, measured sensitivity was 19.7 counts sec-1 μCi-1 with the open energy window and 11.2 counts sec-1 μCi-1 with a 20% wide photopeak window (126 to 154 keV). The measured CNR in the MBT images was significantly greater than in the planar images for all but the lowest CNR cases where the lesion detectability was extremely low for both MBT and planar. The 7.8 mm lesion at 37 mm depth was marginally detectable in the planar image but easily visible in the MBT image. The improved CNR with MBT was due to a large improvement in contrast, which out-weighed the increase in image noise. The spatial resolution and count sensitivity measurements with the prototype MBT system matched theoretical calculations, and the measured CNR in breast phantom images was generally greater with the MBT system compared to conventional planar imaging. These results demonstrate the potential of the proposed MBT system to improve lesion detection in nuclear breast imaging.

We have designed and fabricated four LDA optical setups consisting of aberration compensated four different compact two hololens imaging systems. We have experimentally investigated and realized a hololens recording geometry which is interferogram of converging spherical wavefront with mutually coherent planar wavefront. Proposed real time monitoring and actual fringe field analysis techniques allow complete characterizations of fringes formed at measurement volume and permit to evaluate beam quality, alignment and fringe uniformity with greater precision. After experimentally analyzing the fringes formed at measurement volume by all four imaging systems, it is found that fringes obtained using compact two hololens imaging systems get improved both qualitatively and quantitatively compared to that obtained using conventional imaging system. Results indicate qualitative improvement of non-uniformity in fringe thickness and micro intensity variations perpendicular to the fringes, and quantitative improvement of 39.25% in overall average normalized standard deviations of fringe width formed by compact two hololens imaging systems compare to that of conventional imaging system.

During the last decade, technical developments in myocardial perfusion single photon emission tomography (SPET) imaging systems have significantly improved the accuracy of diagnosing coronary artery disease. Nevertheless, the patient's position and/or the acquisition protocol can affect the studies' quality, possibly leading to misdiagnoses. In HJNM and in other journals the importance of proper positioning of the heart of the patient to be examined by myocardial perfusion SPET stress/rest testing, has been emphasized. According to our knowledge, only three cases of truncation artifact during SPET myocardial perfusion imaging acquired with original SPET cameras, related to improper positioning in very thin patients, have been reported. In all cases, patients were examined according to a single day stress/rest technetium-99m-sestamibi protocol, using a dual 90 degree detector system, equipped with high resolution, parallel-hole collimators. However, several published manuscripts have underlined the significance of appropriate patients' positioning in myocardial perfusion scintigraphy using dedicated, cadmium-zinc-telluride (CZT) or small field-of-view cardiac SPET systems. A typical case is that of a 47 years old man (height 187cm, weight 67kg), heavy smoker, with atypical chest pain. He exercised very well according to the Bruce protocol, achieving 95% of maximal age-predicted heart-rate and a technetium-99m-tetrofosmin ((99m)Tc-TF) myocardial perfusion imaging with 370MBq of (99m)Tc-TF followed with a dual head camera (Infinia GE, USA), equipped with low-energy, high-resolution, parallel-hole collimators at 90° (L-mode configuration). Projection images were obtained from 45° RAO to 45° LPO position, in step and shoot mode (60 projections, 30sec per projection; matrix 64×64 and zoom 1.3). Auto body contour was not used. Unprocessed raw data, showed neither patient motion nor significant extracardiac activity that could result in false positive defects on myocardial perfusion stress images. However, truncation at the apex of the heart was observed. In detail, truncation of activity of apical portion of the heart from frame 45-60 (detector 1) and frames 1-5 (detector 2) was noticed. Processed stress images demonstrated a severe defect in the apex and the apical part of the anteroseptal wall. Moreover, less intense defects were observed in the inferior and septal walls. All acquisition parameters were double checked and a possible error regarding the "zoom" was ruled out. Hence, it became evident that the aforementioned artifact has originated from an eccentric patient's position and thus some heart projections were missed. A second stress acquisition was performed after repositioning the patient with emphasis on positioning the heart at the center of the field of view. As a result, improvement of the above mentioned defects, mainly in the apex and the apical anteroseptal wall. In the literature, a number of recent studies have mentioned the effect of the truncation artifact even with newly equipped gamma cameras, emphasizing the importance of the heart being in the field of view throughout the acquisition procedure. Few of them used parallel-hole collimation. In conclusion, it is suggested that in cases of very thin patients it is often necessary to avoid truncation artefacts by correctly positioning the patient's heart.

A novel anti-cat-eye effect imaging technique based on wavefront coding is proposed as a solution to the problem of previous anti-cat-eye effect imaging techniques where imaging quality was sacrificed to reduce the retroreflection from the photoelectric imaging equipment. With the application of the Fresnel–Kirchhoff diffraction theory, and the definition of generalized pupil function combining both phase modulation and defocus factors, the cat-eye echo formation of the wavefront coded imaging system is theoretically modeled. Based on the physical model, the diffracted spot profile distribution and the light intensity distribution on the observation plane are further simulated with the changes in the defocus parameter and the phase modulation coefficient. A verification test on the cat-eye laser echo power of the wavefront coded imaging system and that of the conventional imaging system at a 20 m distance are conducted, respectively. Simulations and experiment results show that compared with conventional imaging systems, the wavefront coding imaging system can reduce the retroreflection echo by two orders of magnitude while maintaining better imaging quality through defocusing.