Multimodal simultaneous photoacoustic tomography, optical resolution microscopy, and OCT system

Optical microscopy, providing valuable insights at the cellular and organelle levels, has been widely recognized as an enabling biomedical technology. As the mainstays of in vivo three-dimensional (3-D) optical microscopy, single-/multi-photon fluorescence microscopy and optical coherence tomography (OCT) have demonstrated their extraordinary sensitivities to fluorescence and optical scattering contrasts, respectively. However, the optical absorption contrast of biological tissues, which encodes essential physiological/pathological information, has not yet been assessable. The emergence of biomedical photoacoustics has led to a new branch of optical microscopy optical-resolution photoacoustic microscopy (OR-PAM)1, where the optical irradiation is focused to the diffraction limit to achieve cellular1 or even subcellular2 level lateral resolution. As a valuable complement to existing optical microscopy technologies, OR-PAM brings in at least two novelties. First and most importantly, OR-PAM detects optical absorption contrasts with extraordinary sensitivity (i.e., 100%). Combining OR-PAM with fluorescence microscopy3 or with optical-scattering-based OCT4 (or with both) provides comprehensive optical properties of biological tissues. Second, OR-PAM encodes optical absorption into acoustic waves, in contrast to the pure optical processes in fluorescence microscopy and OCT, and provides background-free detection. The acoustic detection in OR-PAM mitigates the impacts of optical scattering on signal degradation and naturally eliminates possible interferences (i.e., crosstalks) between excitation and detection, which is a common problem in fluorescence microscopy due to the overlap between the excitation and fluorescence spectra. Unique for optical absorption imaging, OR-PAM has demonstrated broad biomedical applications since its invention, including, but not limited to, neurology5, 6, ophthalmology7, 8, vascular biology9, and dermatology10. In this video, we teach the system configuration and alignment of OR-PAM as well as the experimental procedures for in vivo functional microvascular imaging.

We present a dual modality ultra-thin imaging system based on a optical multimode fiber and a optical fiber hydrophone that combines optical resolution photoacoustic and fluorescence microscopy.

We present a multimodal optical setup, allowing non-contact photoacoustic imaging (PAI) and optical coherence tomography (OCT). Optical coherence tomography is sensitive to changes in the specimen’s refractive index, thereby offering complementary information to photoacoustic signals which are induced by light absorption. A multimodal setup, allowing OCT and photoacoustic measurements, should ideally not rely on any physical contact to a specimen and, thus, commonly used transducers for photoacoustic signal detection which require acoustic coupling to the specimen should be avoided. In this work photoacoustic signals are acquired by measuring the surface displacement of a specimen using a fiber-optic Mach-Zehnder interferometer. Photoacoustic signals are excited with a Nd:YAG pulse laser. The interferometer for non-contact photoacoustic detection and the OCT system are realized in the same fiber-optic network. Light from the PAI detection laser and the OCT source are multiplexed into a single optical fiber and the same objective is used for both imaging modalities. Light reflected from specimens is demultiplexed and guided to the respective imaging systems. To allow fast non-contact PAI and OCT imaging the detection spot is scanned across the specimens’ surface using a galvanometer scanner. As the same fiber-network and optical components are used for photoacoustic and OCT imaging the obtained, images are co-registered intrinsically. Imaging is demonstrated on a tissue mimicking sample.

Compared to piezoelectric based photoacoustic (PA) scanners, the planar Fabry-Perot (FP) scanner has several advantages. It can provide small element size with high sensitivity, a smooth broadband frequency response, and is transparent to excitation light. This enables the FP scanner to provide excellent high-resolution in vivo PA images of soft tissue to depths up to approximately 10 mm. However, unlike piezoelectric scanners, the FP scanner in its current form cannot provide a pulse-echo ultrasound (US) as well as a PA image, which is useful because of the additional tissue contrast it provides. To address this, a dual mode FP scanner-based system that, for the first time, can acquire co-registered 3D PA and US images has been developed. In order to provide an optical US generation capability, the FP ultrasound sensor was coated with a novel Gold-Nanoparticle-PDMS composite which was excited with nanosecond laser pulses to generate plane wave US pulses. By modifying the FP sensor in this way, it now acts as an US transmitter as well as a receiver. The coating is highly absorbing at the US generation wavelength (>95%) but transparent at the PA excitation wavelength, the latter to allow the system to also operate in PA imaging mode as before. The generated US pulses exhibited peak pressures in the MPa range, which is comparable to the output of conventional piezoelectric based medical US scanners. The pulses had a broad bandwidth (>40 MHz) and the emitted wavefront was planar to within λ/10 at 10 MHz. PA and pulse-echo US signals were mapped in turn by the FP scanner over centimetre scale areas with a step size of 100 μm and an element size of 64 μm. The -3dB bandwidth of the FP sensor was 30 MHz. Reconstruction methods using a k-space formulation recovered co-registered 3D PA and US images. The system’s lateral spatial resolution was evaluated by imaging a line target at depths up to 10 mm and ranged between 50 and 120 μm for both modes. Arbitrarily shaped 3D objects were imaged to demonstrate the volumetric US imaging capability of the scanner. Tissue mimicking phantoms, with impedance mismatches representative of soft tissues, and ex vivo tissue samples were imaged with the system as well as a conventional clinical US scanner for comparison. Finally, the system obtained promising high-resolution 3D dual mode PA-US images for a variety of phantoms with contrast based on both optical absorption and acoustic impedance. This novel all-optical system has the potential to add complementary morphological contrast to photoacoustic vascular images which could aid the clinical assessment of superficial tumours, lymph node disease and other conditions.

In this Letter, reflection-mode optical resolution photoacoustic microscopy (OR-PAM) using glancing angle-deposited (GLAD) nanostructured Fabry-Perot interferometers (FPI) for in vivo applications is reported. GLAD is a single-step physical vapor deposition (PVD) technique used to fabricate porous nanostructured thin films. Using titanium dioxide, a transparent semiconductor with a high refractive index (n=2.4), the GLAD technique can be employed to fabricate samples with tailored nano-porosity, refractive index periodicities, and high Q-factor reflectance spectra. The OR-PAM in vivo images of chorioallantoic membrane (CAM) of 5-day chicken embryo model are demonstrated. The phantom study shows lateral resolution and signal-to-noise ratio better than 7μm and 35dB, respectively. The sensitive GLAD FPI allows photoacoustic imaging down to a few-nJ pulse energy. To the best of our knowledge, this is the first time that a FPI-based reflection mode optical resolution photoacoustic imaging technique is demonstrated for in vivo applications.

Optical resolution photoacoustic microscopy (ORPAM) is a high-resolution hybrid imaging modality having potential for microscale in vivo imaging. Optical diffraction limits the lateral resolution of ORPAM. A photonic nanojet (PNJ) was used to break this diffraction limit. A single round microsphere can generate a PNJ with subwavelength waist, but its short axial length limits its applications to surface imaging only. We investigate different sphere designs to achieve ultralong nanojets that will make the nanojet more viable in far-field applications, such as photoacoustic imaging. The PNJ properties, including effective length, waist size, working distance, and peak intensity, can be tuned and controlled by changing the sphere design and its refractive index. A truncated multilayer microsphere design could generate an ultraelongated PNJ with length larger than ∼172λ (∼138 μm) while retaining a large working distance ∼32λ (∼26 μm). Through simulation study, we observed ∼11-fold enhancement in lateral resolution with 5 μm round sphere (refractive index 2.2) when used in a conventional ORPAM setup with NA=0.1 and λ=800 nm.

Photoacoustic microscopy for cells in a 3D microenvironment: Systems and applications

Optical-resolution photoacoustic microscopy (OR-PAM) has been shown to be an excellent tool for high-resolution imaging of microvasculature, and quantitative analysis of the microvasculature can provide valuable information for the early diagnosis and treatment of various vascular-related diseases. In order to address the characteristics of weak signals, discontinuity and small diameters in photoacoustic microvascular images, we propose a method adaptive to the microvascular segmentation in photoacoustic images, including Hessian matrix enhancement and the morphological connection operators. The accuracy of our vascular segmentation method is quantitatively evaluated by the multiple criteria. To obtain more precise and continuous microvascular skeletons, an improved skeleton extraction framework based on the multistencil fast marching (MSFM) method is developed. We carried out in vivo OR-PAM microvascular imaging in mouse ears and subcutaneous hepatoma tumor model to verify the correctness and superiority of our proposed method. Compared with the previous methods, our proposed method can extract the microvascular network more completely, continuously and accurately, and provide an effective solution for the quantitative analysis of photoacoustic microvascular images with many small branches.

Optical resolution photoacoustic microscopy (OR-PAM) can achieve an optical-dependent high lateral resolution (<; 1 μm) and visualize photoacoustic (PA) property at single-cell level. The spatial resolvability of the PA imaging is expected to precisely characterize biological activities of cells such as their interactions with drugs and contrast agents by comparing the acquired PA characteristics with the cell's morphology. However, since the conventional OR-PAM systems only visualize objects that generate PA signals, it was difficult to acquire a PA image and an optical morphological image simultaneously. Here, we report a novel system of the hybrid optical / PA microscopy that can acquire morphological and PA characteristics of cells at the same time. The performance of the developed system was validated by measuring a USAF1951 target and bovine red blood cells.

The conventional optical coherence tomography (OCT) images based on enhanced scattering and the photothermal (PT) images based on enhanced absorption of the localized surface plasmon (LSP) resonance of Au nanorings (NRIs) in a bio-tissue sample are demonstrated with the scans of an OCT system (1310-nm system), in which the spectral range covers the LSP resonance peak wavelength, and another OCT system (1060-nm system), in which the spectral range is away from the LSP resonance peak wavelength. A PT image is formed by evaluating the modulation frequency (400 Hz) response of an excitation laser with its wavelength (1308 nm) close to the LSP resonance peak at 1305 nm of the Au NRI solution. With the scan of the 1310-nm OCT system, the Au NRI distribution in the bio-tissue sample can be observed in both conventional OCT and PT images. However, with the scan of the 1060-nm OCT system, the Au NRI distribution can be clearly observed only in the PT image. The diffusion process of Au NRIs in the bio-tissue sample can be traced with the scan of either OCT system. Based on phantom experiments, it is shown that the PT image can help in resolving the ambiguity of a conventional OCT image between the enhanced scattering of Au NRIs and the strong scattering of a tissue structure in the 1310-nm OCT scanning. Also, under the condition of weak intrinsic sample scattering, particularly in the scan of the 1060-nm system, the PT signal can be lower than a saturating level, which is determined by the excitation power. By increasing OCT system signal-to-noise ratio or M-mode scan time, the PT signal level can be enhanced.

Conventional optical coherence tomography (OCT) systems generally have a limited imaging range within a depth of only 1-2 mm and suffers from unwanted noise such as speckle, ghost or mirror noise. To overcome these limitations, we developed a motorized-stage-based OCT system with an extended imaging range, using a common-path Fourier-domain optical coherence tomography (CP-FD-OCT) configuration. Using this OCT systems, OCT image was obtained from an onion, and their subsurface structure were observed. The result showed that the OCT images obtained using our motorized-stage-based system had a significantly extended imaging range due to its real-time accurate depth tracking. Consequently, the devised CP-FD-OCT systems and algorithms have good potential for the further development of endoscopic OCT for microsurgery.

Photoacoustic (PA) imaging is rapidly progressing imaging modality in which very short pulsed laser causes thermal expansion to generate PA signal. In previous PA microscope systems, relatively long time was required for image acquisition because they required mechanical scan of the PA transducer. The objective of the present study is to develop fast laser scanning optical resolution photoacoustic microscopy (OR-PAM) with fixed PA signal detector to realize very high frame rate PA imaging. Q-switched Nd:YAG laser with the wavelength of 532 nm, pulse width of 5.5 ns and pulse repetition rate of up to 50 kHz was equipped in the system. Low frequency PA detector was comprised of a glass prism configuring acoustic focusing and a polymethyl methacrylate (PMMA) prism with 5 MHz PZT (lead zirconate titanate) transducer. High frequency PA detector was comprised of the same glass prism and a glass prism with ZnO (zinc oxide) thin film transducer. Galvano scanner operating in the air was controlled by a microcomputer to scan laser beam. PA signal was detected with the fixed PA detector thus realized the frame rate of 5 fps for C-mode equivalent to 500 fps for B-mode. The lateral resolution of the low frequency system was found to be 11.6 μm and the blood vessel on the surface of cod roe was clearly visualized. The system may be applicable for imaging blood flow and vascular dynamics of micro vessel.

Optoacoustic tomography (OAT) is a promising imaging modality for human breast cancer imaging, with higher resolution and deeper penetration compared to other optical imaging modalities such as diffuse optical tomography or optical coherence tomography. It yields a resolution of 1 mm at depth up to 2 cm. But there is an inherent conflict between the limitations imposed on laser power and the need to adequately penetrate a substantial portion of the breast. To achieve sufficient penetration at every view angle, instead of illuminating the whole breast all at once, sometimes illumination is focused onto a small region of the breast and rotated along with the transducer array to cover the entire object. This paper evaluates the effect of this rotating partial illumination design on OAT image reconstruction. The optical process is simulated by conducting Monte Carlo simulations on a numerical phantom mimicking a real breast, with various specially designed illumination schemes. The acoustic process is simulated by incorporating the transducer's spatial impulse response. Iterative reconstruction is applied to estimate the OAT image. We conclude that rotating partial illumination introduces inconsistency into the system equation, and the degree of inconsistency determines the reconstruction quality.

IMPACT: Despite its importance in systemic diseases such as diabetes, the eye is notably difficult to examine for non-specialists; this study introduces a fully automated approach for eye disease screening, coupling a deep learning algorithm with a robotically-aligned optical coherence tomography system to improve eye care in non-ophthalmology settings. OBJECTIVES/GOALS: This study aims to develop and test a deep learning (DL) method to classify images acquired from a robotically-aligned optical coherence tomography (OCT) system as normal vs. abnormal. The long-term goal of our study is to integrate artificial intelligence and robotic eye imaging to fully automate eye disease screening in diverse clinical settings. METHODS/STUDY POPULATION: Between August and October 2020, patients seen at the Duke Eye Center and healthy volunteers (age ≥18) were imaged with a custom, robotically-aligned OCT (RAOCT) system following routine eye exam. Using transfer learning, we adapted a preexisting convolutional neural network to train a DL algorithm to classify OCT images as normal vs. abnormal. The model was trained and validated on two publicly available OCT datasets and two of our own RAOCT volumes. For external testing, the top-performing model based on validation was applied to a representative averaged B-scan from each of the remaining RAOCT volumes. The model’s performance was evaluated against a reference standard of clinical diagnoses by retina specialists. Saliency maps were created to visualize the areas contributing most to the model predictions. RESULTS/ANTICIPATED RESULTS: The training and validation datasets included 87,697 OCT images, of which 59,743 were abnormal. The top-performing DL model had a training accuracy of 96% and a validation accuracy of 99%. For external testing, 43 eyes of 27 subjects were imaged with the robotically-aligned OCT system. Compared to clinical diagnoses, the model correctly labeled 18 out of 22 normal averaged B-scans and 18 out of 21 abnormal averaged B-scans. Overall, in the testing set, the model had an AUC for the detection of pathology of 0.92, an accuracy of 84%, a sensitivity of 86%, and a specificity of 82%. For the correctly predicted scans, saliency maps identified the areas contributing most to the DL algorithm’s predictions, which matched the regions of greatest clinical importance. DISCUSSION/SIGNIFICANCE OF FINDINGS: This is the first study to develop and apply a DL model to images acquired from a self-aligning OCT system, demonstrating the potential of integrating DL and robotic eye imaging to automate eye disease screening. We are working to translate this technology for use in emergency departments and primary care, where it will have the greatest impact.

We present a three-dimensional (3-D) endoscopic optical coherence tomography (OCT) system based on a dual axis microelectromechanical system (MEMS) mirror. The diameter of MEMS mirror was 1.2 mm and both axes were capable of scanning up to 20° (optical) at greater than 1 kHz with excellent linearity. The MEMS mirror was packaged in a machined acrylic endoscopic housing which provided mechanical protection and electrical interconnects as well as optical alignment of the MEMS device to a focusing GRIN lens. The endoscopic MEMS probe was integrated and tested with both a fiber-based time domain (TD) OCT system and Fourier domain (FD) OCT system. Combining the 2-axis lateral scanning of the MEMS device with an axial scan allowed 3-D volume images to be obtained at a rate of 3 frames/s for the TD system and 7 frames/s for the FD system. In the initial investigations, in vivo 3-D OCT images of a human finger as well as images of animal tissue such as healthy rabbit trachea, normal and cancerous regions of hamster cheek pouch tissue were obtained. These images allowed real-time diagnosis of diseased tissue and also clearly delineated important features and tissue structures.