Camera Array Synthetic Aperture Focusing and Fusion Based Hidden Object Imaging

GPU-Based Minimum Variance Beamformer for Synthetic Aperture Imaging of the Eye

The occlusion problem is a major challenge in the field of computer vision. Synthetic aperture imaging (SAI) is often used for surface reconstruction of occluded objects. However, SAI usually relies on high-speed information transmission devices. In addition, a large amount of information in the scene is lost, when handling low-resolution input images. This limitation results in unclear reconstructed regions in the synthetic aperture image and thus hinders the application of SAI in downstream tasks. We propose a multi-view super-resolution SAI method. It aims to generate high-resolution synthetic aperture images using images acquired by few of low-resolution acquisition devices. The main contributions of this paper are: (1) a multi-view super-resolution algorithm is proposed. It can generate clear synthetic aperture images in an array with a limited number of cameras. (2) By exploiting the correlation between views, the proposed algorithm can generate super-resolution synthetic aperture images with more accurate image structure and sharper image edges. (3) A feature extraction module is proposed. It can effectively extract the complementary relationship between pictures from different perspectives. The experimental results show that the proposed method can generate a reconstructed image of the occluded object surface with clear edges and accurate structure. Compared to conventional SAI, our method improves 5.7 % / 21.1 % on peak signal-to-noise ratio (PSNR)/structure similarity index measure (SSIM) and 4.4 % / 9.2 % on PSNR/SSIM respectively on two datasets compared to other state-of-the-art super-resolution methods.

A novel multi-object detection method in complex scene using synthetic aperture imaging

High‐resolution millimetre wave images of contiguous targets often suffer from the influence of sidelobe artefacts, partial correlation between targets and so on. Owing to the characteristics of near‐field synthetic aperture imaging radiometers [such as the changing point spread function (PSF) and slender sideline], the existing CLEAN algorithms are unsuitable for near‐field synthetic aperture imaging. This study is devoted to establishing a novel CLEAN algorithm (named adaptive CLEAN) to clean the reconstructed millimetre wave images accurately. First, the characteristics of near‐field synthetic aperture imaging are studied. Then, the adaptive CLEAN algorithm is established based on these characteristics. In this study, the authors amend the amplitude of the targets and select the matching PSF for them according to their azimuths. Unlike other CLEAN algorithms, the parameters of this adaptive CLEAN algorithm are calculated by a formula, which is concluded from a lot of simulation experiments. Finally, the effectiveness of the proposed adaptive CLEAN algorithm is tested by several simulation experiments, and the superiority is also demonstrated by comparing it with the existing CLEAN algorithm. The results demonstrate that the proposed method is an efficient, feasible algorithm for cleaning the reconstructed images, irrespective of the point or contiguous targets.

Synthetic aperture imaging (SAI) is able to achieve the see through effect by blurring out the off-focus foreground occlusions and reconstructing the in-focus occluded targets from multi-view images. However, very dense occlusions and extreme lighting conditions may bring significant disturbances to the SAI based on conventional frame-based cameras, leading to performance degeneration. To address these problems, we propose a novel SAI system based on the event camera which can produce asynchronous events with extremely low latency and high dynamic range. Thus, it can eliminate the interference of dense occlusions by measuring with almost continuous views, and simultaneously tackle the over/under exposure problems. To reconstruct the occluded targets, we propose a hybrid encoder-decoder network composed of spiking neural networks (SNNs) and convolutional neural networks (CNNs). In the hybrid network, the spatio-temporal information of the collected events is first encoded by SNN layers, and then transformed to the visual image of the occluded targets by a style-transfer CNN decoder. Through experiments, the proposed method shows remarkable performance in dealing with very dense occlusions and extreme lighting conditions, and high quality visual images can be reconstructed using pure event data.

Designing an optical aerial imaging system with high resolution and large fields of view (FoV) is a longstanding problem in remote sensing, astronomical observation, and geological exploration. In this paper, we propose a light field-guided optical synthetic aperture imaging system on master-slave unmanned aerial vehicles (UAVs). This system consists of single-master UAV and multiple-slave UAVs to capture cross-scale multiview aerial images to stitch an aerial image and even a video with high resolution and large FoV. However, relative poses of UAVs change dynamically during the flight, which causes the inaccuracy of large-FoV image stitching. To address this problem, we convert image stitching as a novel-view synthesis problem on a large-FoV light field. Under this insight, we construct a 5D light field to cover FoVs of all slave UAVs via Gaussian splatting technique. Then we exploit a light field-guided synthetic aperture imaging scheme to generate the high-resolution image. Additionally, this scheme can be extended for large-FoV video generation. Experimental results on real-world scenes show that the proposed imaging system is capable of generating the accurate, large-FoV, high-resolution image sequences. Hence, we believe that this system has great potential in large-FoV high-resolution aerial imaging.

The synthetic aperture imaging (SAI) and backpropagation imaging (BPI) algorithms are compared for reconstructing a representation of scattering objects from time-domain ground-penetrating radar data. Synthetic data produced by a FDTD forward solver is used as a basis for the comparison. We assume initially a homogeneous, lossless host medium. The BPI algorithm, which includes waveform diffractions, is shown to result in a better focused image than SAI, with fewer artifacts. The superiority of the BPI algorithm is particularly evident at lower frequencies, where the scattering objects are on the order of the wavelength of the incident field.

Synthetic aperture imaging with active systems is relatively well developed. The implementation of passive systems so far has been hindered by low signal-to-noise ratio (SNR) and the difficulty in achieving 2-D aperture fill. The achromaticity of the grating interferometer permits the use of a wider instantaneous spectral bandwidth to produce better SNR and it provides a simple means to synthesize a 2-D aperture. A passive synthetic aperture imaging approach implemented with an achromatic grating interferometer is described and laboratory experimental results are presented to demonstrate the proposed concept.

Synthetic aperture imaging with active systems is relatively well developed. The implementation of passive systems, on the other hand, is being hindered by a low SNR and the difficulty in achieving 2-D aperture fill. The achromaticity of the grating interferometer permits the use of a wider instantaneous spectral bandwidth to produce better SNR, and it provides a simple means to synthesize a 2-D aperture. A passive synthetic aperture imaging approach implemented with an achromatic grating interferometer is described, and laboratory experimental results are presented to demonstrate the proposed concept.

Currently available medical ultrasonic imaging systems are limited in some applications by their resolution. In particular: better resolution is needed to detect small lesions in the female breast. The apertures required to improve resolution can be obtained using large transducers at the expense of depth of field. Alternatively, synthetic aperture techniques offer the potential for achieving the necessary resolution without sacrificing depth of field. Advantages of synthetic aperture imaging are high focus, independent of depth, coupled with the absence of near field aberrations. The goal of this study is to develop a synthetic aperture ultrasonic imaging system specifically designed for breast scanning.

High‐resolution imaging of distant, dynamic targets is fundamentally limited by finite‐aperture diffraction. Unlike radar, optical detectors record only intensity and lack the temporal resolution for direct phase measurement, hindering straightforward extension of synthetic aperture techniques to the optical domain. While Macroscopic Fourier ptychography (FP) offers a promising computational alternative, its reliance on mechanical scanning or engineered illumination restricts its use to cooperative, static scenes. In this paper, we present Inverse Synthetic Aperture Macroscopic Fourier ptychography (ISAMFP), which, to the best of our knowledge, is the first practical realization of inverse synthetic aperture imaging for diffusely reflecting targets within the Fourier ptychography framework. By transforming the natural target motion from a detrimental factor into an effective source of angular diversity, ISAMFP eliminates the need for mechanical scanning or illumination modulation and achieves resolution enhancement far beyond the aperture limit using intensity‐only measurements. Experimental validations on USAF resolution targets, unmanned aerial vehicles, and complex multi‐target scenes highlight both the robustness and versatility of ISAMFP, establishing it as a powerful tool for non‐interferometric synthetic aperture imaging of moving, non‐cooperative targets, with broad implications for surveillance, defense, and remote sensing.

Photonics‐based radar enables a large operation bandwidth that is particularly favourable for high‐resolution synthetic aperture imaging. However, how to implement fast and high‐accuracy imaging with photonics‐based broadband radar is still an open question. In this Letter, the performance of photonics‐based inverse synthetic aperture radar imaging with frequency‐domain and time‐domain algorithms are experimentally investigated and compared. The results show that, frequency‐domain range–Doppler algorithm has fast imaging capability, but the image suffers from defocusing and distortions. Although migration compensation techniques can be applied to improve the imaging accuracy, the imaging speed is significantly reduced. On the other hand, using time‐domain back‐projection (BP) algorithm can achieve well‐focused images, and the imaging speed can be enhanced with fast BP methods. Therefore, the time‐domain imaging method is found to be the best choice for fast and high‐accuracy synthetic aperture imaging with photonics‐based broadband radars.

During the data processing and interpretation of mine transient electromagnetic method (MTEM), in order to improve the identification of the geo‐electrical interface between low resistivity abnormal body and surrounding rock in advanced detection, transient electromagnetic field was transformed to pseudo‐seismic wave‐field based on the function relationship between spreading electromagnetic field and seismic wave‐field in whole‐space. Meanwhile, the signal of pseudo‐seismic after being transformed was processed with correlative stack to strengthen the amplitude and improve signal‐noise‐ratio (SNR) using the synthetic aperture imaging (SAI). The data of different detection directions on one surveying point in MTEM were imaged as aperture data, which would highlight weak abnormality and improve SNR. In addition, the application effect of SAI was testified with the in‐site advanced detection in roadway using MTEM. The results showed that the SAI of the MTEM could improve SNR of the electrical interface information and highlight the geometrical resolution to increase exploration accuracy. The technique is significant theoretically and practically in accurate advanced detection of aquifer structure by MTEM.

In scan-mode synthetic aperture imaging radar, spatial resolution in a range is given by a frequency-swept waveform, whereas resolution in the orthogonal direction is derived from the record of phase as the beam footprint executes linear motion over the object. We demonstrate here what is to our knowledge the first two-dimensional imaging that uses exactly this process in the optical domain for a 1 cm x 1 cm object with 90 mumx170 mum resolution.

Recently, short-lag spatial coherence (SLSC) imaging has drawn much attention from researchers due to benefits such as improved speckle signal-to-noise ratio and contrast-to-noise ratio compared to conventional B-mode imaging based on delay-and-sum beamforming. However, SLSC imaging has good performance just around the transmit focal point, which is quite a drawback. In this paper, we propose a new method that combines SLSC imaging and synthetic aperture imaging to address such a shortcoming. The efficacy of the proposed method is verified through simulations and experiments using Field II echo data and phantom data acquired with an actual ultrasound system.