Spatial wavefront shaping with a multipolar-resonant metasurface for structured illumination microscopy [Invited

Structured-illumination microscopy allows widefield fluorescence imaging with resolution beyond the classical diffraction limit. Its linear form extends resolution by a factor of two, and its nonlinear form by an in-principle infinite factor, the effective resolution in practice being determined by noise. In this paper, we analyse the noise properties and achievable resolution of linear and nonlinear 1D and 2D patterned SIM from a frequency-space perspective. We develop an analytical theory for a general case of linear or nonlinear fluorescent imaging, and verify the analytical calculations with numerical simulation for a special case where nonlinearity is produced by photoswitching of fluorescent labels. We compare the performance of two alternative implementations, using either two-dimensional (2D) illumination patterns or sequentially rotated one-dimensional (ID) patterns. We show that 1D patterns are advantageous in the linear case, and that in the nonlinear case 2D patterns provide a slight signal-to-noise advantage under idealised conditions, but perform worse than 1D patterns in the presence of nonswitchable fluorescent background. LAY DESCRIPTION: Structured-illumination microscopy (SIM) is a high-resolution light microscopy technique that allows imaging of fluorescence at a resolution about twice the classical diffraction limit. There are various ways that the illumination can be structured, but it is not obvious how the choice of illumination pattern affects the final image quality, especially in view of the noise. We present a detailed performance analysis considering two illumination techniques: sequential illumination with line-gratings that are shifted and rotated during image acquisition and two-dimensional (2D) illumination structures requiring only shift operations. Our analysis is based on analytical theory, supported by simulations of images considering noise. We also extend our analysis to a nonlinear variant of SIM, with which enhanced resolution can be achieved, limited only by noise. This includes nonlinear SIM based on the light-induced switching of the fluorescent molecules between a bright and a dark state. We find sequential illumination with line-gratings to be advantageous in ordinary (linear) SIM, whereas 2D patterns provides a slight signal-to-noise advantage under idealised conditions in nonlinear SIM if there is no nonswitching background.

The structure of one-dimensional photonic crystal (1DPC) containing indefinite metamaterials with a hyperbolic dispersion relation is proposed to realize the omnidirectional gap for the design of omnidirectional reflectors and filters. It is demonstrated that this 1DPC can result in a similar zero average index (zero-n¯) gap usually appearing in the 1DPC containing isotropic left-handed materials. The properties of zero-n¯ gap and defect modes of this photonic crystal are studied in detail. The edge of this zero-n¯ gap is insensitive to incident angle and polarization of light in contrast to the Bragg gap. When a defect layer is introduced into the 1DPC, a defect mode appears inside the omnidirectional gap. The spectral position of defect mode is found to be weakly dependent on the incident angle of light and nearly invariant to the scale length of photonic crystal.

Structured illumination microscopy (SIM) allows non-invasive visualization of nanoscale subcellular structures. However, image acquisition and reconstruction become the bottleneck to further improve the imaging speed. Here, we propose a method to accelerate SIM imaging by combining the spatial re-modulation principle with Fourier domain filtering and using measured illumination patterns. This approach enables high-speed, high-quality imaging of dense subcellular structures using a conventional nine-frame SIM modality without phase estimation of the patterns. In addition, seven-frame SIM reconstruction and additional hardware acceleration further improve the imaging speed using our method. Furthermore, our method is also applicable to other spatially uncorrelated illumination patterns, such as distorted sinusoidal, multifocal, and speckle patterns.

Structured illumination microscopy (SIM) is a popular and powerful super-resolution (SR) technique in biomedical research. However, the conventional reconstruction algorithm for SIM heavily relies on the accurate prior knowledge of illumination patterns and signal-to-noise ratio (SNR) of raw images. To obtain high-quality SR images, several raw images need to be captured under high fluorescence level, which further restricts SIM’s temporal resolution and its applications. Deep learning (DL) is a data-driven technology that has been used to expand the limits of optical microscopy. In this study, we propose a deep neural network based on multi-level wavelet and attention mechanism (MWAM) for SIM. Our results show that the MWAM network can extract high-frequency information contained in SIM raw images and accurately integrate it into the output image, resulting in superior SR images compared to those generated using wide-field images as input data. We also demonstrate that the number of SIM raw images can be reduced to three, with one image in each illumination orientation, to achieve the optimal tradeoff between temporal and spatial resolution. Furthermore, our MWAM network exhibits superior reconstruction ability on low-SNR images compared to conventional SIM algorithms. We have also analyzed the adaptability of this network on other biological samples and successfully applied the pretrained model to other SIM systems.

Structured illumination microscopy (SIM) is an attractive choice for fast super-resolution imaging. The generation of structured illumination patterns made by interference of laser beams is broadly employed to obtain high modulation depth of patterns, while the polarizations of the laser beams must be elaborately controlled to guarantee the high contrast of interference intensity, which brings a more complex configuration for the polarization control. The emerging pattern projection strategy is much more compact, but the modulation depth of patterns is deteriorated by the optical transfer function (OTF) of the optical system, especially in high spatial frequency near diffraction limit. Therefore, the traditional super-resolution reconstruction algorithm for interference-based SIM will suffer from much artifact in the case of projection-based SIM that possesses a low modulation depth. Here, we propose an alternative reconstruction algorithm based on image recombination transform (IRT), which provides an alternative solution to address this problem even in a weak modulation depth. We demonstrated the effectiveness of this algorithm in the multicolor super-resolution imaging of BPAE cells in our developed projection-based SIM system, which applies a computer controlled digital micro-mirror device (DMD) for fast fringe generation and multicolor LEDs for illumination. The merit of the system incorporated with the proposed algorithm allows for a low excitation intensity fluorescence imaging even less than 1W/cm2, which is beneficial for the long-term, in vivo super-resolved imaging of live cells and tissues.

Structured illumination microscopy (SIM) has emerged as a promising super-resolution fluorescence imaging technique, offering diverse configurations and computational strategies to mitigate phototoxicity during real-time imaging of biological specimens. Traditional efforts to enhance system frame rates have concentrated on processing algorithms, like rolling reconstruction or reduced frame reconstruction, or on investments in costly sCMOS cameras with accelerated row readout rates. In this article, we introduce an approach to elevate SIM frame rates and region of interest (ROI) coverage at the hardware level, without necessitating an upsurge in camera expenses or intricate algorithms. Here, parallel acquisition-readout SIM (PAR-SIM) achieves the highest imaging speed for fluorescence imaging at currently available detector sensitivity. By using the full frame-width of the detector through synchronizing the pattern generation and image exposure-readout process, we have achieved a fundamentally stupendous information spatial-temporal flux of 132.9 MPixels · s−1, 9.6-fold that of the latest techniques, with the lowest SNR of −2.11 dB and 100 nm resolution. PAR-SIM demonstrates its proficiency in successfully reconstructing diverse cellular organelles in dual excitations, even under conditions of low signal due to ultra-short exposure times. Notably, mitochondrial dynamic tubulation and ongoing membrane fusion processes have been captured in live COS-7 cell, recorded with PAR-SIM at an impressive 408 Hz. We posit that this novel parallel exposure-readout mode not only augments SIM pattern modulation for superior frame rates but also holds the potential to benefit other complex imaging systems with a strategic controlling approach.

Structured illumination microscopy (SIM) is one of the most powerful and versatile super-resolution methods due to its live-cell imaging ability of subcellular structures with high speed. In this paper, we propose an alternative SIM assisted by Bloch surface wave (BSW). Through replacing the conventional laser interference fringes with sub-diffraction BSW counterparts with higher spatial frequency, the imaging resolution of SIM could be enhanced greatly and the super-resolution imaging capability down to 80 nm could be achieved. Compared with traditional wide-field fluorescence microscopy, this BSW SIM demonstrates 2.78 times enhancement in imaging resolution, which surpasses general SIM with only 2 times improvement. Moreover, the structured illumination intensity could be boosted drastically, which is beneficial to nonlinear super-resolution imaging techniques, such as saturated SIM. This BSW SIM would provide a super-resolution, wide field of view approach for surface super-resolution fluorescent imaging while maintaining high imaging speed and good bio-compatibility.

μLinear Structured Illumination Microscopy (SIM) provides a two-fold increase over the diffraction limited resolution. SIM produces excellent images with 120nm resolution in tissue culture cells in two and three dimensions. For SIM to work correctly, the point spread function (PSF) and optical transfer function (OTF) must be known, and, ideally, should be unaberrated. When imaging through thick samples, aberrations will be introduced into the optical system which will reduce the peak intensity and increase the width of the PSF. This will lead to reduced resolution and artifacts in SIM images. Adaptive optics can be used to correct the optical wavefront restoring the PSF to its unaberrated state, and AO has been used in several types of fluorescence microscopy. We demonstrate that AO can be used with SIM to achieve 120nm resolution through 25m of tissue by imaging through the full thickness of an adult C. elegans roundworm. The aberrations can be corrected over a 25μm × 45μm field of view with one wavefront correction setting, demonstrating that AO can be used effectively with widefield superresolution techniques.

Structured illumination microscopy (SIM) is a fast and gentle super-resolution fluorescence imaging technique, featuring live-cell compatible excitation light levels and high imaging speeds. To achieve SIM, spatial modulation of the fluorescence excitation light is employed. This is typically achieved by interfering coherent laser beams in the sample plane, which are often created by spatial light modulators (SLMs). Digital micromirror devices (DMDs) are a form of SLMs with certain advantages, such as high speed, low cost and wide availability, which present certain hurdles in their implementation, mainly the blazed grating effect caused by the jagged surface structure of the tilted mirrors. Recent works have studied this effect through modelling, simulations and experiments, and laid out possible implementations of multi-color SIM imaging based on DMDs. Here, we present an implementation of a dual-color DMD based SIM microscope using temperature-controlled wavelength matching. By carefully controlling the output wavelength of a diode laser by temperature, we can tune two laser wavelengths in such a way that no opto-mechanical realignment of the SIM setup is necessary when switching between both wavelengths. This reduces system complexity and increases imaging speed. With measurements on nano-bead reference samples, as well as the actin skeleton and membrane of fixed U2OS cells, we demonstrate the capabilities of the setup.

Structured illumination microscopy (SIM) can double the spatial resolution of a fluorescence microscope and video rate live cell imaging in a two-dimensional format has been demonstrated. However, rapid implementations of 2D SIM typically only cover a narrow slice of the sample immediately at the coverslip, with most of the cellular volume out of reach. Here, we implement oblique plane structured illumination microscopy (OPSIM) in a projection format to rapidly image an entire cell in a 2D SIM framework. As no mechanical scanning of the sample or objective is involved, this technique has the potential for rapid projection imaging with doubled resolution. We characterize the spatial resolution with fluorescent nanospheres, compare projection and 3D imaging using OPSIM and image mitochondria and ER dynamics across an entire cell at up to 2.7 Hz. To our knowledge, this represents the fastest whole cell SIM imaging to date.

Super-resolution structured illumination microscopy (SR-SIM) is an optical fluorescence microscopy method which is suitable for imaging a wide variety of cells and tissues in biological and biomedical research. Typically, SIM methods use high spatial frequency illumination patterns generated by laser interference. This approach provides high resolution but is limited to thin samples such as cultured cells. Using a different strategy for processing raw data and coarser illumination patterns, we imaged through a 150-micrometer-thick coronal section of a mouse brain expressing GFP in a subset of neurons. The resolution reached 144 nm, an improvement of 1.7-fold beyond conventional widefield imaging.

We developed a structured illumination microscopy (SIM) system that uses a spatial light modulator (SLM) to generate interference illumination patterns at four orientations - 0 degrees, 45 degrees, 90 degrees, and 135 degrees, to reconstruct a high-resolution image. The use of a SLM for pattern alterations is rapid and precise, without mechanical calibration; moreover, our design of SLM patterns allows generating the four illumination patterns of high contrast and nearly equivalent periods to achieve a near isotropic enhancement in lateral resolution. We compare the conventional image of 100-nm beads with those reconstructed from two (0 degrees +90 degrees or 45 degrees +135 degrees) and four (0 degrees +45 degrees +90 degrees +135 degrees) pattern orientations to show the differences in resolution and image, with the support of simulations. The reconstructed images of 200-nm beads at various depths and fine structures of actin filaments near the edge of a HeLa cell are presented to demonstrate the intensity distributions in the axial direction and the prospective application to biological systems.

Super-resolution structured illumination microscopy (SR-SIM) is a method in optical fluorescence microscopy which is suitable for imaging a wide variety of cells and tissues in biological and biomedical research. Typically, SIM methods use high spatial frequency illumination patterns generated by laser interference. This approach provides high resolution but is limited to thin samples such as cultured cells. Using a different strategy for processing the raw data and coarser illumination patterns, we imaged through a 150 μm thick coronal section of a mouse brain expressing GFP in a subset of neurons. The resolution reached 144 nm, an improvement of 1.7 fold beyond conventional widefield imaging.

Structured illumination microscopy (SIM) is a widefield super-resolution technique in fluorescent imaging. For an artifact-free reconstruction, some crucial parameters should be known with high accuracy. However, the initial phase and modulation factor of illumination pattern cannot be guaranteed with enough precision experimentally, so they have to be retrieved from the acquired data. We propose a fast and robust method to compute these two parameters and then the coefficients of frequency components can be normalized. We analyze the performance of this method using simulated data and experimental data. The results demonstrate that the coefficients normalization has important effect on the improvement of reconstruction image. Compared with widefield resolution (216 nm), the lateral resolution of SIM can achieve 97 nm.

This study presents a partially coherent illumination based (PCI-based) SIM apparatus for dual-modality (phase and fluorescent) microscopic imaging. The partially coherent illumination (PCI) is generated by placing a rotating diffuser on a monochromatic laser beam, which suppresses speckle noise in the dual-modality images and endows the apparatus with sound sectioning capability. With this system, label-free quantitative phase and super-resolved/sectioned fluorescent images can be obtained for the same sample. We have demonstrated the superiority of the system in phase imaging of transparent cells with high endogenous contrast and in a quantitative manner. In the meantime, we have also demonstrated fluorescent imaging of fluorescent beads, rat tail crosscut, wheat anther, and hibiscus pollen with super-resolution and optical sectioning. We envisage that the proposed method can be applied to many fields, including but not limited to biomedical, industrial, chemistry fields.