Super-resolved Mirau digital holography by structured illumination

In this work, we present a patented procedure that generates three dimensional (3D) image of a microscopic object with high definition, obtained by merging Scanning Electron Microscopy (SEM) and Digital Holography Microscopy (DHM) data. A high spatial resolution (up to r z =λ/20, r yx ≅100nm) 3D model of the object is generated starting from two digital images, acquired separately, following standard characterization procedures. Then, the two set of data are combined using an original mathematical algorithm, which has been implemented with a commercially available software. The developed methodology is of broad interest and has been applied to elements of biological interest, in order to prove its features.

Motility, or co-ordinated movement, of cells is fundamental for the development of many processes, such as formation of the embryo, the immune response, inflammation, wound healing, and metastasis of cancer cells 1. Cells often migrate in response to specific external signals, but they can also move spontaneously. Aberrant cell motility can be fatal in cancer diseases when cells start to metastasize 2. Metastasis is strictly associated with tissue invasion of the primary tumor cells, and occurs as a multistep progress 3. The first phase of cancer cell metastasis involves the physical translocation of the cell to a distant organ, whereas the second phase implicates the ability of the cancer cell to develop into a metastatic lesion at that distant site 4. For skin cancer melanoma, the main cause of death is widespread metastases 5. Melanoma cells may travel along external vessel lattices. After settling in the metastatic sites, melanoma cells develop mechanisms that protect them against the attack of the immune system. It is, therefore, of great interest and importance to investigate, monitor, and understand the principles of tumor cell invasion and migration. The development of novel therapeutic applications that have the ability to block migratory processes is crucial. For in vitro studies, the cell culture wound-closure, and the transwell migration and invasion assays can provide data for an understanding how well a particular cell type can migrate 6. The wound healing assay is also called a scratch assay because it is performed by making a scratch in the cell monolayer (Fig. 1A). The transwell migration assay is a commonly used test to study the migratory response of endothelial cells to angiogenic inducers or inhibitors (Fig. 1B). This assay is also known as the Boyden or modified Boyden chamber assay. These assays have been frequently used to study movement of cells. Weckmann et al. developed an interesting system to monitor and quantify neutrophils on single cell level, by utilizing commercially available tissue culture hardware, simple video microscopic equipment, and standardized tracking 7. However, the interest for novel standardized real-time analyses using quantitative phase imaging (QPI) for cell tracking is growing (Fig. 2). More than 10 years ago, the digital holographic (DH) microscopy methodology of QPI became known to a larger audience and the technique has since then successfully been applied for label-free monitoring of live cells undergoing cell division, cell proliferation, cell death, and cell migration over time 8-10. By QPI, studies associated with both cellular thickness and refractive index fluctuations have been performed. The possibilities for utilizing QPI for cancer diagnostics have increased 11. Cellular behavior and phenotypes are other parameters that can be measured 12. For two human osteosarcoma cell types, the motility pattern, but not the proliferative pattern, was different. Early migration studies using DH microscopy showed fibroblast migration 13 and HT-1080 fibrosarcoma cells embedded in a 3D collagen gel 14. Alm et al. and Persson et al. also presented data on movement of different cell types and cell sizes 15 as well as demonstrated the correlation of cell movement with cell morphology 16. In the recent article published in the November 2018 issue of Cytometry Part A by Zhang et al., (pages 1125–1131) commercially available DH cytometry platforms equipped with semi-automated image acquisition, segmentation, and analysis software packages for assessing cell behavior are used and discussed. The motility data was obtained with QPI/cytometry using "Track cells module" and "Wound healing module," respectively, and with transwell migration assays determining migration and invasion, respectively. The different techniques assessing motility were compared. The two melanoma cell lines, WM793 and 1205Lu, used in the study were reported to have different metastatic capacity, resulting in differences in proliferation and motility. The motility measured with the "Track cells module" and "Wound healing module," using DH cytometry equipment housed in an incubator, produced highly correlated relative motilities, even when compared to the standard transwell migration and invasion assays. Images acquired with DH are from the same position in a cell culture vessel, making it possible to study individual cells. This is a strong advantage, since most studies of effects of new drugs on proliferation and migration of cancer cells in culture are performed on a population level. In a recent study by Kamlund et al., cell images were captured every fifth minute for a total of up to 72 h 17. For cell movement studies, the semi-automated algorithm attempts to find each tracked cell in the next frame by selecting the closest cell based on the centroid position. The advantages of the Track cells and Wound healing modules over the transwell migration and invasion assays in the paper by Zhang et al., included the possibility to use the cells in the experiment for other purposes after completing the measurement. DH microscopy also benefits from the fact that morphology analysis can be performed of each cell. Indeed, this opens up for almost unlimited possibilities to perform cell morphology analysis using the QPI methodology, since each image is very rich in cellular information. As discussed in a review by El-Schich et al., automated analysis and machine learning is one approach to handle the large amount of morphological data that can now be generated when analyzing cells with QPI 8. Only the computer resources and the training speed will set the limitations.

A dual mode microscope is developed to study morphological evolution of mouse myoblast cells under simulated microgravity in real time. Microscope operates in Digital Holographic Microscopy (DHM) and widefield epifluorescence microscopy modes in a time sequential basis. DHM provides information on real time cellular morphology. EGFP transfected actin filaments in mouse myoblast cells function as the reporter for the fluorescence microscopy mode. Experimental setup is fixed in the RPM to observe microgravity induced dynamic changes in live cells. Initial results revealed two different modifications. Disorganized structures become visible in the formed lamellipodias, and proteins accumulate in the perinuclear region.

Digital holographic microscopy (DHM) is an important technique that may be used for quantitative phase imaging of unstained biological cell samples. Since the DHM technology is not commonly used in clinics or bioscience research labs, at present there is no well-accepted focusing criterion for unstained samples that users can follow while recording image plane digital holograms of cells. The usual sharpness metrics that are useful for auto-focusing of stained cells do not work well for unstained cells as there is no amplitude contrast. In this work, we report a practical method for estimating the best focus plane for unstained cells in the digital hologram domain. The method is based on an interesting observation that for the best focus plane the fringe pattern associated with individual unstained cells predominantly shows phase modulation effect in the form of bending of fringes and minimal amplitude modulation. This criterion when applied to unstained red blood cells shows that the central dip in the doughnut-like phase profile of cells is maximal in this plane. The proposed methodology is helpful for standardizing the usage of DHM technology across different users and application developmentefforts. LAY DESCRIPTION: Digital holographic microscopy (DHM) is slowly but steadily becoming an important microscopy modality and gaining acceptability for basic bio-science research as well as clinical usage. One of the important features of DHM is that it allows users to perform quantitative imaging of unstained transparent cells. Instead of using dyes or fluorescent labelling, DHM systems use quantitative phase as a contrast mechanism which depends on the natural refractive index variation within the cell samples. Since minimal wet lab processing is required in order to image cell samples with a DHM, cells can be imaged in their natural state. While DHM is gaining popularity among users, the imaging protocols across the labs or users need to be standardized in order to make sure that the same quantitative phase parameters are used for tasks such as quantitative phased based cellclassification. One of the important operational tasks for any microscopy work is to focus the sample under study. While focusing comes naturally to users of brightfield microscopes based on image contrast, the focusing is not straightforward when samples are unstained so that they do not offer any amplitude contrast. When performing quantitative phase imaging, defocus can actually change the phase profile of the cell due to near-zone (Fresnel) diffraction effects. So unless a standardized focusing methodology is used, it will be difficult for multiple DHM users (potentially at different sites) to agree on quantitative results out of their phase images. DHM literature has prior works which perform numerical focusing of recovered complex wave-field in the hologram plane to find the best focus plane. However such methods are not user friendly and do not allow user the same focusing experience as in a brightfield microscope. The numerical focusing is therefore a reasonably good method for an optics researcher but not necessarily so for a microscopy technician looking at cell samples with a DHM system in a clinicalsetting. The present work provides a simple focusing criterion for unstained samples that works directly in the hologram domain. The technique is based on an interesting observation that the when an unstained cell sample is in the best-focus plane, its corresponding hologram (or fringe pattern) predominantly shows phase modulation manifested by bending of fringes at the location of the cell. This criterion can be converted into a simple numerical method as we have used to find the best-focus plane using a stack of through focus holograms. We believe that the technique can be used manually by visually observing the holograms or can be converted to an auto-focus algorithm for a motorized DHMsystem.

Process engineering and failure analysis of MEMS and MOEMS require static and dynamical characterization of both their in-plane and out of plane response to an excitation. A remarkable characteristic of Digital Holography Microscopes (DHM) is the extremely short acquisition time required to grab the whole information necessary to provide 3D optical topography of the sample: a unique frame grab, without any vertical or lateral scan provides the information over the full field of view. First, it ensures DHM measurements to be insensitive to vibrations. Second, it opens the door to fast dynamical characterization of micro-systems. For periodic movement analysis, DHM can operate in stroboscopic mode with standard cameras. It enables precise characterization up to excitation frequencies of 100 kHz with recovery cycle of 10% simply by triggering properly the camera. Pulsed sources can be used for investigation of higher excitation frequencies. For non periodic movement analysis fast acquisition cameras and postponed treatment are used. DHM are therefore unique and very efficient tool for dynamical characterization of in- plane and out-of-plane response. In this paper we show the basics of the technology and illustrate process engineering and failure analysis using DHM with an example of in and out of plane characterization of movements of a variable capacitor using the stroboscopic mode of acquisition.

A microscope operating in Digital Holographic Microscopy (DHM) and classical widefield epi-fluorescence microscopy in a time sequential manner is developed to study morphological alterations of mouse myoblast cells under simulated microgravity in real time.

Quantitative three-dimensional (3-D) imaging of living cells provides important information about the cell morphology and its time variation. Off-axis, digital holographic interference microscopy is an ideal tool for 3-D imaging, parameter extraction, and classification of living cells. Two-beam digital holographic microscopes, which are usually employed, provide high-quality 3-D images of micro-objects, albeit with lower temporal stability. Common-path digital holographic geometries, in which the reference beam is derived from the object beam, provide higher temporal stability along with high-quality 3-D images. Self-referencing geometry is the simplest of the common-path techniques, in which a portion of the object beam itself acts as the reference, leading to compact setups using fewer optical elements. However, it has reduced field of view, and the reference may contain object information. Here, we describe the development of a common-path digital holographic microscope, employing a shearing plate and converting one of the beams into a separate reference by employing a pin-hole. The setup is as compact as self-referencing geometry, while providing field of view as wide as that of a two-beam microscope. The microscope is tested by imaging and quantifying the morphology and dynamics of human erythrocytes.

In this paper we present a newly developed digital transmission holographic microscope. The microscope enables using arbitrarily low coherent illumination (both spatially and temporally) in conjunction with the off-axis holography. The setup of the microscope, its function and the object wave reconstruction procedure are described. The optical sectioning effect, similar to a confocal microscope, resulting from the use of low spatially coherent light source is demonstrated. The microscope has been tailored for studies of living cell dynamics. Time-lapse phase reconstruction series of live cells activities were carried out. The different behavior related to changes in the cell cycle is demonstrated.

We demonstrate an active, holographic tomography system, working with limited angle of projections, realized by optical-only, diffraction-based beam steering. The system created for this purpose is a Mach–Zehnder interferometer modified to serve as a digital holographic microscope with a high numerical aperture illumination module and a spatial light modulator (SLM). Such a solution is fast and robust. Apart from providing an elegant solution to viewing angle shifting, it also adds new capabilities of the holographic microscope system. SLM, being an active optical element, allows wavefront correction in order to improve measurement accuracy. Integrated phase data captured with different illumination scenarios within a highly limited angular range are processed by a new tomographic reconstruction algorithm based on the compressed sensing technique: total variation minimization, which is applied here to reconstruct nonpiecewise constant samples. Finally, the accuracy of full measurement and the proposed processing path is tested for a calibrated three-dimensional micro-object as well as a biological object--C2C12 myoblast cell.

Inflammatory bowel diseases (IBD) are inflammatory disorders of the gastrointestinal tract characterized by a chronic relapsing disease course. As uncontrolled intestinal inflammation can result in severe disease complications, recent treatment targets of IBD evolved toward seeking the absence of mucosal and histological inflammation. However, this approach requires adequate histological evaluation of IBD disease activity. The diagnostic challenge of histological examination of intestinal inflammation is documented by the multitude of proposed histological scoring systems. In this context, we review quantitative phase imaging (QPI) techniques such as digital holographic microscopy (DHM) for characterizing intestinal inflammation. DHM determines optical path-length delays in a stain-free manner, thereby providing the tissue refractive index as a biophysical marker that directly correlates to tissue density. Recently, DHM has been successfully applied in cell biology, cancer cell research and infectious-induced cellular alterations. We summarized the capabilities of DHM and related QPI techniques to assess the severity of intestinal inflammation in experimental colitis as well as in colonic samples from human IBD patients. Moreover, we illustrate major advantages of DHM facilitated multimodal evaluation of epithelial wound healing processes as assessed by physical parameters like cell volume, density, thickness and dry mass in vitro. Furthermore, potential limitations of DHM and future utilities of QPI are discussed. In conclusion, DHM represents a promising, easy-to-use quantitative tool to provide accurate and objective assessment of intestinal inflammation and may pave the way towards automated label-free digital pathology and related in vitro cell culture analysis in future.

A method to improve the radial resolution using special structured light is proposed in the field of digital holographic microscopy (DHM). A specimen is illuminated with circular symmetrical structured light that makes the spectrum have radial movement, so that high frequency components of the specimen are moved into the passband of the receiver to overcome the diffraction limit. In the DHM imaging system, Computer Generated Hologram (CGH) technology is used to generate the required structured light grating. Then the grating is loaded into a spatial light modulator (SLM) to obtain specific structured illumination. After recording the hologram, digital reconstruction, for the microstructure of a binary optical element that needs to observe radial distribution, the radial resolution of the specimen is improved experimentally compare it with the result of one-dimensional sinusoidal structured light imaging. And a method of designing structured light is presented.

Digital holographic (DH) microscopy is a promising technique for quantitative phase contrast imaging. It provides complex amplitude of the object wavefront, which in turn yields the thickness distribution of the object. An added advantage of the technique is its ability for numerical focusing, which provides the thickness distribution of the object at different axial planes. In this invited paper, we present an overview of our reported work on two beam DH microscopyto acquire different cell parameters for cell imaging and automated cell identification. Applications to automated monitoring of stem cells without destroying the cells and automated identification of malaria infected red blood cells are discussed.

The liquid-based cytology Papanicolaou (Pap) test has gradually replaced the conventional Pap test, as it seems to be more efficient, in part because it uses computer assistance. However, Pap test diagnoses are still subjective and are cost-consuming or time-consuming. The authors describe a new digital holographic microscopy instrument and accompanying software. This technology provides an instantaneous, 3-dimensional image reconstruction of cells directly from the uterine cervical sample vial. Analyses were performed using the proprietary digital holographic microscopy (DHM) instrument, computer, and software. Residual materials from 3 randomly chosen laboratories were analyzed and subjected to DHM, and the sensitivity and specificity of DHM were calculated for the detection neoplasia. In 41 specimens that yielded normal Pap test results, 1333 cells were analyzed using DHM; and, in 30 specimens that yielded abnormal Pap test results, 494 cells were analyzed using DHM. Available histologic correlation was as follows: 4 histologic samples were diagnosed as grade 1 cervical intraepithelial neoplasia (corresponding to 2 cytologic diagnoses of low-grade squamous intraepithelial lesion and 2 cytologic diagnoses of atypical squamous cells of undetermined significance), 4 histologic samples were diagnosed as grade 3 cervical intraepithelial neoplasia (corresponding to 2 cytologic diagnoses of low-grade squamous intraepithelial lesion and 2 cytologic diagnosis of atypical squamous cells, cannot rule out high-grade squamous intraepithelial lesion), and 11 lesions were diagnosed as benign. Receiver operating characteristic curve analysis indicated that the best criteria were the nuclear-to-cytoplasmic ratio (area under the curve, 0.88; 95% confidence interval, 0.68-1.00) and the greatest nuclear dimension (area under the curve, 0.85; 95% confidence interval, 0.66-1.00). This preliminary study demonstrated for the first time that the DHM technique is suitable for the processing of gynecologic cervical samples. Nevertheless, DHM criteria and parameters could be better defined. Hopefully, holographic analysis will be performed automatically and will provide an instantaneous, cost-effective diagnosis from a closed vial with the preservation of all cellular material. Cancer Cytopathol 2016;124:573-80. © 2016 American Cancer Society.

.A stable multimodal system is developed by combining two common-path digital holographic microscopes (DHMs): coherent and incoherent, for simultaneous recording and retrieval of three-dimensional (3-D) phase and 3-D fluorescence imaging (FI), respectively, of a biological specimen. The 3-D FI is realized by a single-shot common-path off-axis fluorescent DHM developed recently by our group. In addition, we accomplish, the phase imaging by another single-shot, highly stable common-path off-axis DHM based on a beam splitter. In this DHM configuration, a beam splitter is used to divide the incoming object beam into two beams. One beam serves as the object beam carrying the useful information of the object under study, whereas another beam is spatially filtered at its Fourier plane by using a pinhole and it serves as a reference beam. This DHM setup, owing to a common-path geometry, is less vibration-sensitive and compact, having a similar field of view but with high temporal phase stability in comparison to a two-beam Mach–Zehnder-type DHM. The performance of the proposed common-path DHM and the multimodal system is verified by conducting various experiments on fluorescent microspheres and fluorescent protein-labeled living cells of the moss Physcomitrella patens. Moreover, the potential capability of the proposed multimodal system for 3-D live fluorescence and phase imaging of the fluorescent beads is also demonstrated. The obtained experimental results corroborate the feasibility of the proposed multimodal system and indicate its potential applications for the analysis of functional and structural behaviors of a biological specimen and enhancement of the understanding of physiological mechanisms and various biological diseases.

Digital holographic (DH) microscopy has grown into a powerful nondestructive technique for the real-time study of living cells including dynamic membrane changes and cell fluctuations in nanometer and sub-nanometer scales. The conventional DH microscopy configurations require a separately generated coherent reference wave that results in a low phase stability and a necessity to precisely adjust the intensity ratio between two overlapping beams. In this work, we present a compact, simple, and very stable common-path DH microscope, employing a self-referencing configuration. The microscope is implemented by a diode laser as the source and a Fresnel biprism for splitting and recombining the beams simultaneously. In the overlapping area, linear interference fringes with high contrast are produced. The frequency of the interference pattern could be easily adjusted by displacement of the biprism along the optical axis without a decrease in fringe contrast. To evaluate the validity of the method, the spatial noise and temporal stability of the setup are compared with the common off-axis DH microscope based on a Mach-Zehnder interferometer. It is shown that the proposed technique has low mechanical noise as well as superb temporal stability with sub-nanometer precision without any external vibration isolation. The higher temporal stability improves the capabilities of the microscope for studying micro-object fluctuations, particularly in the case of biological specimens. Experimental results are presented using red blood cells and silica microspheres to demonstrate the system performance.