Isotropic image in structured illumination microscopy patterned with a spatial light modulator

Spatial light modulators (SLM) update in a synchronous manner, whereas the data readout process in fast structured illumination systems is usually done using a rolling shutter camera with asynchronous readout. In structured illumination microscopy (SIM), this leads to synchronization problems causing a speed limit for fast acquisition. In this paper we present a configuration to overcome this limit by exploiting the extremely fast SLM display and dividing it into several segments along the direction of the rolling shutter of the sCMOS camera and displaying multiple SLM frames per camera acquisition. The sCMOS runs in continuous rolling shutter mode and the SLM keeps the readout-line always inside a dark region presenting different SIM patterns before and after the readout/start-exposure line.Using this approach, we reached a raw frame rate of 714 frames per second (fps) resulting in a two-beam SIM acquisition rate of 79 fps with a region of interest (ROI) of 16.5 × 16.5 μm2.

Structured illumination microscopy (SIM) is a fast and gentle super-resolution fluorescence imaging technique, featuring live-cell compatible excitation light levels and high imaging speeds. To achieve SIM, spatial modulation of the fluorescence excitation light is employed. This is typically achieved by interfering coherent laser beams in the sample plane, which are often created by spatial light modulators (SLMs). Digital micromirror devices (DMDs) are a form of SLMs with certain advantages, such as high speed, low cost and wide availability, which present certain hurdles in their implementation, mainly the blazed grating effect caused by the jagged surface structure of the tilted mirrors. Recent works have studied this effect through modelling, simulations and experiments, and laid out possible implementations of multi-color SIM imaging based on DMDs. Here, we present an implementation of a dual-color DMD based SIM microscope using temperature-controlled wavelength matching. By carefully controlling the output wavelength of a diode laser by temperature, we can tune two laser wavelengths in such a way that no opto-mechanical realignment of the SIM setup is necessary when switching between both wavelengths. This reduces system complexity and increases imaging speed. With measurements on nano-bead reference samples, as well as the actin skeleton and membrane of fixed U2OS cells, we demonstrate the capabilities of the setup.

Lateral resolution enhancement is demonstrated in a confocal imaging system with amplitude-modulated radially polarized (RP) light at the wavelength Annular pupil fields and optimized amplitude distribution functions can be realized with a spatial light modulator. By comparing images obtained with full and amplitude modulated apertures of RP illuminations using a high numerical aperture (NA = 0.9), spatial resolution of has been achieved experimentally. This result agrees very well with theoretical simulation results and will be helpful in improving performance of the non-fluorescent imaging systems.

Digital micromirror devices (DMDs) are spatial light modulators that employ the electro-mechanical movement of miniaturized mirrors to steer and thus modulate the light reflected off a mirror array. Their wide availability, low cost and high speed make them a popular choice both in consumer electronics such as video projectors, and scientific applications such as microscopy. High-end fluorescence microscopy systems typically employ laser light sources, which by their nature provide coherent excitation light. In super-resolution microscopy applications that use light modulation, most notably structured illumination microscopy (SIM), the coherent nature of the excitation light becomes a requirement to achieve optimal interference pattern contrast. The universal combination of DMDs and coherent light sources, especially when working with multiple different wavelengths, is unfortunately not straight forward. The substructure of the tilted micromirror array gives rise to a blazed grating, which has to be understood and which must be taken into account when designing a DMD-based illumination system. Here, we present a set of simulation frameworks that explore the use of DMDs in conjunction with coherent light sources, motivated by their application in SIM, but which are generalizable to other light patterning applications. This framework provides all the tools to explore and compute DMD-based diffraction effects and to simulate possible system alignment configurations computationally, which simplifies the system design process and provides guidance for setting up DMD-based microscopes.This article is part of the Theo Murphy meeting ‘Super-resolution structured illumination microscopy (part 1)’.

Optical resolution photoacoustic microscopy (ORPAM) is a high-resolution hybrid imaging modality having potential for microscale in vivo imaging. Optical diffraction limits the lateral resolution of ORPAM. A photonic nanojet (PNJ) was used to break this diffraction limit. A single round microsphere can generate a PNJ with subwavelength waist, but its short axial length limits its applications to surface imaging only. We investigate different sphere designs to achieve ultralong nanojets that will make the nanojet more viable in far-field applications, such as photoacoustic imaging. The PNJ properties, including effective length, waist size, working distance, and peak intensity, can be tuned and controlled by changing the sphere design and its refractive index. A truncated multilayer microsphere design could generate an ultraelongated PNJ with length larger than ∼172λ (∼138 μm) while retaining a large working distance ∼32λ (∼26 μm). Through simulation study, we observed ∼11-fold enhancement in lateral resolution with 5 μm round sphere (refractive index 2.2) when used in a conventional ORPAM setup with NA=0.1 and λ=800 nm.

The use of a much brighter source than the conventional blackbody allows an enhancement in lateral resolution in microanalysis using infrared spectroscopy, which thus, becomes limited only by the diffraction criteria. Numerous new applications have been performed in various research fields, which highlight the usefulness of such a new analytical technique.

Lateral resolution in confocal microscope is limited by the size of pinhole. In this paper, we attempt to introduce a new method to achieve structured detection through using spatial light modulator (SLM) to improve it. SLM modulates the Airy disk amplitude distribution according to the detection function in collection arm. Instead of using CCD to capture spot images and modulate them with numerical analysis in virtual structured detection (VSD), this method uses SLM to accomplish these aims with higher imaging rates. Based on simulation and the experiment results, it can be found that coherent transfer function expands and the resolution is 1.6 times as large as that of conventional confocal microscope.

Linear structured illumination microscopy (SIM) is a super-resolution microscopy technique that does not impose photophysics requirements on fluorescent samples. Multicolor SIM implementations typically rely on liquid crystal on silicon (LCoS) spatial light modulators (SLM's) for patterning the excitation light, but digital micromirror devices (DMD's) are a promising alternative, owing to their lower cost and higher speed. However, existing coherent DMD SIM implementations use only a single wavelength of light, limited by the lack of efficient approaches for solving the blazed grating effect for polychromatic light. We develop the requisite quantitative tools, including a closed form solution of the blaze and diffraction conditions, forward models of DMD diffraction and pattern projection, and a model of DMD aberrations. Based on these advances, we constructed a three-color DMD microscope, quantified the effect of aberrations from the DMD, developed a high-resolution optical transfer function measurement technique, and demonstrated SIM on fixed and live cells. This opens the door to applying DMD's in polychromatic applications previously restricted to LCoS SLM's.

Structured illumination microscopy (SIM) is a super-resolution fluorescence microscopy with a 2-fold higher lateral resolution than conventional wide-field fluorescence (WF) microscopy. Confocal fluorescence (CF) microscopy has approximately the same optical cutoff frequency as SIM; however, the maximum theoretical increase in lateral resolution over that of WF is 1.4-fold with an infinitesimal pinhole diameter. Quantitative comparisons based on an analytical imaging formula revealed that modulation transfer functions (MTFs) of SIM reconstructed images before postprocessing are nearly identical to those of CF images recorded with an infinitesimal pinhole diameter. Here, we propose a new method using an adequate pinhole diameter combined with the use of an apodized Fourier inverse filter to increase the lateral resolution of CF images to as much as that SIM images without significant noise degradation in practice. Furthermore, the proposed method does not require a posteriori parameterization and has reproducibility. This approach can be easily applied to conventional laser scanning CF, spinning disk CF, and multiphoton microscopies.

Structured illumination microscopy (SIM) allows non-invasive visualization of nanoscale subcellular structures. However, image acquisition and reconstruction become the bottleneck to further improve the imaging speed. Here, we propose a method to accelerate SIM imaging by combining the spatial re-modulation principle with Fourier domain filtering and using measured illumination patterns. This approach enables high-speed, high-quality imaging of dense subcellular structures using a conventional nine-frame SIM modality without phase estimation of the patterns. In addition, seven-frame SIM reconstruction and additional hardware acceleration further improve the imaging speed using our method. Furthermore, our method is also applicable to other spatially uncorrelated illumination patterns, such as distorted sinusoidal, multifocal, and speckle patterns.

Structured illumination microscopy (SIM) achieves superresolution in fluorescence imaging through patterned illumination and computational image reconstruction, yet current methods require bulky, costly modulation optics and high-precision optical alignment, thus hindering the widespread implementation of SIM. To address this challenge, this work demonstrates how nano-optical metasurfaces, rationally designed to tailor the far-field optical wavefront at sub-wavelength dimensions, hold great potential as ultrathin, single-surface, all-optical wavefront modulators for SIM. We computationally demonstrate this principle with a multipolar-resonant metasurface composed of silicon nanostructures that generate versatile optical wavefronts in the far field upon variation of the polarization or angle of incident light. Algorithmic optimization is performed to identify the seven most suitable illumination patterns for SIM generated by the metasurface based on three key criteria. We quantitatively demonstrate that multipolar-resonant metasurface SIM (mrm-SIM) achieves resolution gain that is comparable to conventional methods by applying the seven optimal metasurface-generated wavefronts to simulated fluorescent objects and reconstructing the objects using proximal gradient descent. Notably, we show that mrm-SIM achieves these resolution gains with a far-field illumination pattern that circumvents complex equipment and alignment requirements of comparable methodologies. The work presented here paves the way for a metasurface-enabled experimental simplification of structured illumination microscopy.

Structured-illumination microscopy allows widefield fluorescence imaging with resolution beyond the classical diffraction limit. Its linear form extends resolution by a factor of two, and its nonlinear form by an in-principle infinite factor, the effective resolution in practice being determined by noise. In this paper, we analyse the noise properties and achievable resolution of linear and nonlinear 1D and 2D patterned SIM from a frequency-space perspective. We develop an analytical theory for a general case of linear or nonlinear fluorescent imaging, and verify the analytical calculations with numerical simulation for a special case where nonlinearity is produced by photoswitching of fluorescent labels. We compare the performance of two alternative implementations, using either two-dimensional (2D) illumination patterns or sequentially rotated one-dimensional (ID) patterns. We show that 1D patterns are advantageous in the linear case, and that in the nonlinear case 2D patterns provide a slight signal-to-noise advantage under idealised conditions, but perform worse than 1D patterns in the presence of nonswitchable fluorescent background. LAY DESCRIPTION: Structured-illumination microscopy (SIM) is a high-resolution light microscopy technique that allows imaging of fluorescence at a resolution about twice the classical diffraction limit. There are various ways that the illumination can be structured, but it is not obvious how the choice of illumination pattern affects the final image quality, especially in view of the noise. We present a detailed performance analysis considering two illumination techniques: sequential illumination with line-gratings that are shifted and rotated during image acquisition and two-dimensional (2D) illumination structures requiring only shift operations. Our analysis is based on analytical theory, supported by simulations of images considering noise. We also extend our analysis to a nonlinear variant of SIM, with which enhanced resolution can be achieved, limited only by noise. This includes nonlinear SIM based on the light-induced switching of the fluorescent molecules between a bright and a dark state. We find sequential illumination with line-gratings to be advantageous in ordinary (linear) SIM, whereas 2D patterns provides a slight signal-to-noise advantage under idealised conditions in nonlinear SIM if there is no nonswitching background.

Phase-coded speckle illumination for laser Fourier ptychographic microscopy

Structured illumination microscopy (SIM) is one of the most powerful and versatile super-resolution methods due to its live-cell imaging ability of subcellular structures with high speed. In this paper, we propose an alternative SIM assisted by Bloch surface wave (BSW). Through replacing the conventional laser interference fringes with sub-diffraction BSW counterparts with higher spatial frequency, the imaging resolution of SIM could be enhanced greatly and the super-resolution imaging capability down to 80 nm could be achieved. Compared with traditional wide-field fluorescence microscopy, this BSW SIM demonstrates 2.78 times enhancement in imaging resolution, which surpasses general SIM with only 2 times improvement. Moreover, the structured illumination intensity could be boosted drastically, which is beneficial to nonlinear super-resolution imaging techniques, such as saturated SIM. This BSW SIM would provide a super-resolution, wide field of view approach for surface super-resolution fluorescent imaging while maintaining high imaging speed and good bio-compatibility.

Structured illumination microscopy (SIM) is a valuable tool for three-dimensional microscopy and has numerous applications in bioscience. Its success has been limited to static objects, though, as three sequential image acquisitions are required per final processed, focused image. To overcome this problem we have developed a multicolored grid which when used in tandem with a color camera is capable of performing SIM with just a single exposure. Images and movies demonstrating optical sectioning of three-dimensional objects are presented, and results of applying color SIM for wide-field focused imaging are compared to those of SIM. From computer modeling and analytical calculations a theoretical estimate of the maximum observable object velocity in both the lateral and axial directions is available, implying that the new method will be capable of imaging a variety of live objects. Sample images of the technique applied to lens paper and a pigeon feather are included to show both advantages and disadvantages of CSIM.