Phase/fluorescence dual-mode microscopy imaging based on structured light illumination

Differential phase contrast (DPC) is a non-interferometric quantitative phase imaging method achieved by using an asymmetric imaging procedure. We report a pupil modulation differential phase contrast (PMDPC) imaging method by filtering a sample's Fourier domain with half-circle pupils. A phase gradient image is captured with each half-circle pupil, and a quantitative high resolution phase image is obtained after a deconvolution process with a minimum of two phase gradient images. Here, we introduce PMDPC quantitative phase image reconstruction algorithm and realize it experimentally in a 4f system with an SLM placed at the pupil plane. In our current experimental setup with the numerical aperture of 0.36, we obtain a quantitative phase image with a resolution of 1.73μm after computationally removing system aberrations and refocusing. We also extend the depth of field digitally by 20 times to ±50μm with a resolution of 1.76μm.

Dielectric metasurfaces have recently attracted much attention due to their ability to efficiently control light propagation, that is, its amplitude, phase and polarization, on micro- and macro- levels. Such metasurfaces also naturally allow for integration in compact optical setups due to their small sizes. An important issue of energy losses is also addressed by employing all-dielectric platform. Advancements in nanofabrication have enabled realization of metasurface-based high-resolution wavefront engineering devices, which have been employed in different imaging applications, for example, as metalenses, polarization filters, metaholograms, etc. Quantitative phase imaging is a powerful tool for the optical inspection of transparent samples in connection with biological and technical applications. By measuring thickness and/or refractive index profiles, phase imaging facilitates, for example, the observation of dynamic events in unstained cells. As such, it has become indispensable in biological imaging, wavefront correction and metrology. However, conventional cameras and photodetectors are inherently not sensitive to the phase of an incident lightwave. As a consequence, direct phase detection is challenging. Only by multiple intensity measurements or application of specialized interferometric schemes, the phase profile of an object can be in principle reconstructed. In this paper, we report on the ability of metasurfaces to contribute to quantitative phase imaging by independent control of the phase profiles in two orthogonal polarization states of an incident beam.

Digital holographic microscopy (DHM) is an important technique that may be used for quantitative phase imaging of unstained biological cell samples. Since the DHM technology is not commonly used in clinics or bioscience research labs, at present there is no well-accepted focusing criterion for unstained samples that users can follow while recording image plane digital holograms of cells. The usual sharpness metrics that are useful for auto-focusing of stained cells do not work well for unstained cells as there is no amplitude contrast. In this work, we report a practical method for estimating the best focus plane for unstained cells in the digital hologram domain. The method is based on an interesting observation that for the best focus plane the fringe pattern associated with individual unstained cells predominantly shows phase modulation effect in the form of bending of fringes and minimal amplitude modulation. This criterion when applied to unstained red blood cells shows that the central dip in the doughnut-like phase profile of cells is maximal in this plane. The proposed methodology is helpful for standardizing the usage of DHM technology across different users and application developmentefforts. LAY DESCRIPTION: Digital holographic microscopy (DHM) is slowly but steadily becoming an important microscopy modality and gaining acceptability for basic bio-science research as well as clinical usage. One of the important features of DHM is that it allows users to perform quantitative imaging of unstained transparent cells. Instead of using dyes or fluorescent labelling, DHM systems use quantitative phase as a contrast mechanism which depends on the natural refractive index variation within the cell samples. Since minimal wet lab processing is required in order to image cell samples with a DHM, cells can be imaged in their natural state. While DHM is gaining popularity among users, the imaging protocols across the labs or users need to be standardized in order to make sure that the same quantitative phase parameters are used for tasks such as quantitative phased based cellclassification. One of the important operational tasks for any microscopy work is to focus the sample under study. While focusing comes naturally to users of brightfield microscopes based on image contrast, the focusing is not straightforward when samples are unstained so that they do not offer any amplitude contrast. When performing quantitative phase imaging, defocus can actually change the phase profile of the cell due to near-zone (Fresnel) diffraction effects. So unless a standardized focusing methodology is used, it will be difficult for multiple DHM users (potentially at different sites) to agree on quantitative results out of their phase images. DHM literature has prior works which perform numerical focusing of recovered complex wave-field in the hologram plane to find the best focus plane. However such methods are not user friendly and do not allow user the same focusing experience as in a brightfield microscope. The numerical focusing is therefore a reasonably good method for an optics researcher but not necessarily so for a microscopy technician looking at cell samples with a DHM system in a clinicalsetting. The present work provides a simple focusing criterion for unstained samples that works directly in the hologram domain. The technique is based on an interesting observation that the when an unstained cell sample is in the best-focus plane, its corresponding hologram (or fringe pattern) predominantly shows phase modulation manifested by bending of fringes at the location of the cell. This criterion can be converted into a simple numerical method as we have used to find the best-focus plane using a stack of through focus holograms. We believe that the technique can be used manually by visually observing the holograms or can be converted to an auto-focus algorithm for a motorized DHMsystem.

Fluorescent images that are blurred by large focus displacements are corrected by phase compensation. This is possible when the defocusing distance is obtained from an external measurement. A multi-modal digital holography that enables both quantitative phase imaging and 2D fluorescent imaging provides complimentary information from the same measuring object, such as living cells with fluorescent labels. In this paper, we adapted Zernike polynomials to correct the defocused fluorescent images, and used coefficients that are linear to the defocusing distances. Experimental results from bead images are presented.

Multimodal optical microscopy combines different optical and physiological principles working together to obtain rich perspectives from a single biological event. In this paper, the recent advances in multimodal microscopy systems based on off-axis digital holography and transport-of-intensity equation are reviewed. Both methods used the common-path configuration, and realized simultaneous quantitative phase and fluorescence imaging in 3D space. Feasibility checks with fluorescent micro-beads and live plant cells are presented. The results show that both methods are capable of fast acquisition of the quantitative phase and fluorescence information with digital refocusing ability.

Quantitative phase measurements at multiple wavelengths has created an opportunity for exploring new avenues in phase microscopy such as enhancing imaging-depth (1), measuring hemoglobin concentrations in erythrocytes (2), and more recently in tomographic mapping of the refractive index of live cells (3). To this end, quantitative phase imaging has been demonstrated both at few selected spectral points as well as with high spectral resolution (4,5). However, most of these developed techniques compromise imaging speed, field of view, or the spectral resolution to perform interferometric measurements at multiple colors. In the specific application of quantitative phase in studying blood diseases and red blood cells, current techniques lack the required sensitivity to quantify biological properties of interest at individual cell level. Recently, we have set out to develop a stable quantitative interferometric microscope allowing for measurements of such properties for red cells without compromising field of view or speed of the measurements. The feasibility of the approach will be initially demonstrated in measuring dispersion curves of known solutions, followed by measuring biological properties of red cells in sickle cell anemia.

Inflammatory bowel diseases (IBD) are inflammatory disorders of the gastrointestinal tract characterized by a chronic relapsing disease course. As uncontrolled intestinal inflammation can result in severe disease complications, recent treatment targets of IBD evolved toward seeking the absence of mucosal and histological inflammation. However, this approach requires adequate histological evaluation of IBD disease activity. The diagnostic challenge of histological examination of intestinal inflammation is documented by the multitude of proposed histological scoring systems. In this context, we review quantitative phase imaging (QPI) techniques such as digital holographic microscopy (DHM) for characterizing intestinal inflammation. DHM determines optical path-length delays in a stain-free manner, thereby providing the tissue refractive index as a biophysical marker that directly correlates to tissue density. Recently, DHM has been successfully applied in cell biology, cancer cell research and infectious-induced cellular alterations. We summarized the capabilities of DHM and related QPI techniques to assess the severity of intestinal inflammation in experimental colitis as well as in colonic samples from human IBD patients. Moreover, we illustrate major advantages of DHM facilitated multimodal evaluation of epithelial wound healing processes as assessed by physical parameters like cell volume, density, thickness and dry mass in vitro. Furthermore, potential limitations of DHM and future utilities of QPI are discussed. In conclusion, DHM represents a promising, easy-to-use quantitative tool to provide accurate and objective assessment of intestinal inflammation and may pave the way towards automated label-free digital pathology and related in vitro cell culture analysis in future.

Digital holographic microscopy (DHM), which provides quantitative phase imaging (QPI), has been widely applied in material and biological applications. The performance of DHM technologies relies heavily on computational reconstruction methods to provide accurate phase measurements. For example, non-telecentric DHM systems should compensate for the spherical wavefront associated with a non-telecentric configuration. The size of the ±1 diffraction orders in the hologram spectrum depends inversely on the radius of the curvature of the spherical wavefront introduced by the non-telecentric DHM system. Therefore, one can estimate the radius of curvature of the spherical wavefront by analyzing the hologram spectrum. Here, we outline the steps for the automatic reconstruction of phase images without distortions and with minimum user input from a hologram recorded in a non-telecentric DHM system. The proposed reconstruction approach can be divided into six main steps. The first step automatically selects the +1 diffraction order in the hologram spectrum. Secondly, the spherical wavefront parameters and the interference angle are estimated by analyzing the size and position of the selected +1 order. The third and fourth steps are the spatial filtering of the +1 order and the compensation of the interference angle, respectively. The next step involves the estimation of the center of the spherical wavefront. Finally, there is a fine-tuning step to optimize the estimated parameters and provide a phase image with minimum phase distortions. We have identified the relevant metrics in each step, compared multiple approaches, and selected the one with the higher performance for all our experimental holograms.

We present dual-mode phase and fluorescence imaging in a confocal laser scanning microscopy (CLSM) system. For phase imaging, the depth of field of the CLSM system is extended by fast axial scanning with a tunable acoustic gradient index of refraction lens. Under transillumination, intensity images of the sample are recorded at a few different defocusing distances. The phase image is reconstructed from these intensity images by using the transport-of-intensity equation. The 3D fluorescence image is obtained by confocal scanning. The dual-mode images with pixel-to-pixel correspondence yield complementary quantitative structural and functional information. Combination of the two imaging modalities enables standalone determination of the refractive index of live cells.

Quantitative differential phase-contrast (DPC) imaging is one of the commonly used methods for phase retrieval. However, quantitative DPC imaging requires several pairwise intensity measurements, which makes it difficult to monitor living cells in real-time. In this study, we present a single-shot quantitative DPC imaging method based on the combination of deep learning (DL) and color-encoded illumination. Our goal is to train a model that can generate an isotropic quantitative phase image (i.e., target) directly from a single-shot intensity measurement (i.e., input). The target phase image was reconstructed using a linear-gradient pupil with two-axis measurements, and the model input was the measured color intensities obtained from a radially asymmetric color-encoded illumination pattern. The DL-based model was trained, validated, and tested using thirteen different cell lines. The total number of training, validation, and testing images was 264 (10 cells), 10 (1 cell), and 40 (2 cells), respectively. Our results show that the DL-based phase images are visually similar to the ground-truth phase images and have a high structural similarity index (>0.98). Moreover, the phase difference between the ground-truth and DL-based phase images was smaller than 13%. Our study shows the feasibility of using DL to generate quantitative phase imaging from a single-shot intensity measurement.

Microscopy combined with the transport of intensity equation is capable of retrieving both intensity and phase distributions of samples from both in-focus and defocus intensities. However, during measurements, the focal plane is often decided artificially and the improper choice may induce errors in quantitative intensity and phase retrieval. In order to obtain accurate in-focus information, quantitative intensity and phase imaging with the numerical focusing transport of intensity equation method combined with cellular duty ratio criterion and numerical wavefront propagation is introduced in this paper. Both numerical simulations and experimental measurements are provided proving this designed method can increase both retrieved in-focus intensity and phase accuracy and reduce dependence of focal plane determination in transport of intensity equation measurements. It is believed that the proposed method can be potentially applied in various fields as in-focus compensation for quantitative phase imaging and automatic focal plane determination, etc.

Various quantitative phase microscopy (QPM) techniques for noninvasive and quantitative analysis of samples proposed based on imaging interferometry techniques over the last decade [1-4]. A phase image can be obtained with a single set of interference data in some types of phase microscopes such as diffraction phase microscope [5, 6]. They are suitable for studying rapidly varying phenomena with reduced concern for systematic and sample variations that may occur during the acquisition of the raw data. Dispersion measurements of a sample carry more information than refractive index of measurements at a single wavelength [7]. Knowledge of the optical dispersion for phase objects such as optical fibers, biological cells and micro-particles can provide very useful information about their property. In this work, we report on a common-path and dual wavelength quantitative phase microscope that simultaneously acquires two phase images at different wavelengths. The simultaneous dual-wavelength measurement was performed with a diffraction phase microscope based on a transmission grating and a spatial filter that form a common-path imaging interferometer. With a combined laser source that generates two-color light continuously, a different diffraction order of the grating was utilized for each wavelength component so that the dual-wavelength interference pattern could be distinguished by the distinct fringe frequencies. The refractive index profiles of fiber in both wavelengths were measured adequately by our DW-DPM system.

This paper introduces an advanced dual-modality imaging platform by integrating a confocal laser scanning/imaging module with flat-fielding quantitative phase contrast microscopy (FF-QPCM). The platform enables phase/fluorescence dual-modality imaging of the same samples with high resolution and contrast. Using this platform, we observed that confocal fluorescence excitation causes minimal damage to cells, whereas wide-field fluorescence excitation (WFE) results in significant damage, particularly mitochondrial fragmentation and notable alterations in phase values. Additionally, insitu quantitative phase imaging was conducted on live COS7 cells with a specific region irradiated by a confocal laser. The results demonstrated that 5-min continuous confocal laser irradiation affects only COS7 cells with fluorescently labeled mitochondria, causing mitochondrial dysfunction throughout the cell. These findings suggest that integrating FF-QPCM with a confocal laser scanning/imaging module offers a highly efficient, sensitive, and information-rich tool for cell biology research, with broad application potential.

We applied quantitative phase imaging (QPI) for quantification of nanocapsule-induced morphology and migration changes in single cell layers. In time-lapse observations, cells were monitored with a Mach-Zehnder interferometerbased off-axis digital holographic microscopy (DHM) setup. For quantification of cell migration, single cells were tracked in the recorded series of quantitative DHM phase images. Moreover, QPI images were evaluated as novel stainfree assay to quantify the temporal course of global cellular morphology changes. The label-free acquired data shows that capsaicin-loaded and unloaded chitosan nanocapsules, and also free capsaicin, significantly influence the direction of cell migration and cellular motility.

Quantitative phase imaging (QPI) has advanced by accurately quantifying phase shifts caused by weakly absorbing biological and artificial structures. Despite extensive research, the diffraction limits of QPI have not been established and examined. Hence, it remains unclear whether diffraction-affected QPI provides reliable quantification or merely visualizes phase objects, similar to phase contrast methods. Here, we develop a general diffraction phase imaging theory and show that it is intrinsically connected with Rayleigh’s resolution theory. Our approach reveals the entanglement of phases under restoration, imposing diffraction bounds on spatial phase resolution and, unexpectedly, on phase accuracy. We prove that the phase accuracy depends on the size, shape, and absorption of objects forming the sample and significantly declines if the object size approaches the Rayleigh limit (a relative phase error of −16% for an Airy disk-sized object with low phase shift). We show that the phase accuracy limits can be enhanced at the cost of deteriorated phase resolution by attenuating the sample background light. The QPI diffraction limits are thoroughly examined in experiments with certified phase targets and biological cells. The study’s relevance is underscored by results showing that the phase accuracy of some structures is lost (a relative phase error of −40%) even though they are spatially resolved (a phase visibility of 0.5). A reliable procedure is used to estimate phase errors in given experimental conditions, opening the way to mitigate errors’ impact through data post-processing. Finally, the phase accuracy enhancement in super-resolution QPI is discovered, which has not been previously reported.