Bayesian retinex underwater image enhancement

Underwater images often have severe quality degradation and distortion due to light absorption and scattering in the water medium. A hazy image formation model is widely used to restore the image quality. It depends on two optical parameters: the background light (BL) and the transmission map (TM). Underwater images can also be enhanced by color and contrast correction from the perspective of image processing. In this paper, we propose an effective underwater image enhancement method for underwater images in composition of underwater image restoration and color correction. Firstly, a manually annotated background lights (MABLs) database is developed. With reference to the relationship between MABLs and the histogram distributions of various underwater images, robust statistical models of BLs estimation are provided. Next, the TM of R channel is roughly estimated based on the new underwater dark channel prior (NUDCP) via the statistic of clear and high resolution (HD) underwater images, then a scene depth map based on the underwater light attenuation prior (ULAP) and an adjusted reversed saturation map (ARSM) are applied to compensate and modify the coarse TM of R channel. Next, TMs of G-B channels are estimated based on the difference of attenuation ratios between R and G-B channels. Finally, to improve the color and contrast of the restored image with a dehazed and natural appearance, a variation of white balance is introduced as post-processing. In order to guide the priority of underwater image enhancement, sufficient evaluations are conducted to discuss the impacts of the key parameters including BL and TM, and the importance of the color correction. Comparisons with other state-of-the-art methods demonstrate that our proposed underwater image enhancement method can achieve higher accuracy of estimated BLs, lower computation time, overall superior performance, and better information retention.

Learning-based methods for underwater image enhancement (UWIE) have undergone extensive exploration. However, learning-based models are usually vulnerable to adversarial examples so as the UWIE models. To the best of our knowledge, there is no comprehensive study on the adversarial robustness of UWIE models, which indicates that UWIE models are potentially under the threat of adversarial attacks. In this paper, we propose a general adversarial attack protocol. We make a first attempt to conduct adversarial attacks on five well-designed UWIE models on three common underwater image benchmark datasets. Considering the scattering and absorption of light in the underwater environment, there exists a strong correlation between color correction and underwater image enhancement. On the basis of that, we also design two effective UWIE-oriented adversarial attack methods, Pixel Attack and Color Shift Attack targeting different color spaces. The results show that five models exhibit varying degrees of vulnerability to adversarial attacks and well-designed small perturbations on degraded images are capable of preventing UWIE models from generating enhanced results. In addition, we conduct adversarial training on these models and successfully mitigated the effectiveness of adversarial attacks. In summary, we reveal the adversarial vulnerability of UWIE models and propose a new evaluation dimension of UWIE models.

Underwater image enhancement has drawn much attention due to the significance of underwater vision. Although considerable progress has been made in this field, a key problem remains unsolved: how can we extract and enhance minutiae while trying to remove the noise caused by scattering and attenuation? To address this limitation, we propose a new underwater image enhancement technique with a novel spiral generative adversarial framework, named Spiral-GAN, which can effectivelly recover real-world underwater images with more details, vivid colors and better contrast. For steady training and color correction, we include the pixelwise losses that consist of a mean squared error and an angle error in our objective function. In addition, we design our generator with several deconv-conv blocks to preserve the details from the original distorted images. Furthermore, we present a spiral learning strategy for generalizing the enhancing model to effectively recover the real-world underwater images. Finally, we perform a number of qualitative and quantitative evaluations that suggest that our proposed approach can efficiently enhance the quality of underwater images, which can be further used for underwater object detection.

Aimed at the two problems of color deviation and poor visibility of the underwater image, this paper proposes an underwater image enhancement method based on the multi-scale fusion and global stretching of dual-model (MFGS), which does not rely on the underwater optical imaging model. The proposed method consists of three stages: Compared with other color correction algorithms, white-balancing can effectively eliminate the undesirable color deviation caused by medium attenuation, so it is selected to correct the color deviation in the first stage. Then, aimed at the problem of the poor performance of the saliency weight map in the traditional fusion processing, this paper proposed an updated strategy of saliency weight coefficient combining contrast and spatial cues to achieve high-quality fusion. Finally, by analyzing the characteristics of the results of the above steps, it is found that the brightness and clarity need to be further improved. The global stretching of the full channel in the red, green, blue (RGB) model is applied to enhance the color contrast, and the selective stretching of the L channel in the Commission International Eclairage-Lab (CIE-Lab) model is implemented to achieve a better de-hazing effect. Quantitative and qualitative assessments on the underwater image enhancement benchmark dataset (UIEBD) show that the enhanced images of the proposed approach achieve significant and sufficient improvements in color and visibility.

Degraded underwater image enhancement is a challenging task. Due to the light scattering and absorption of suspended particles in water, the original underwater image has a low definition, blurred details, and color distortion, thus affecting advanced underwater visual tasks such as underwater target detection. However, the existing methods are difficult to enhance the image details effectively. In this paper, we proposed an effective deep convolutional neural network model of multi-scale spatial and channel attention fusion (MS-SCANet) for underwater image enhancement. First, a new training data set (UIRDs) is constructed from the existing data. Then, a multi-loss function is constructed to enhance the detail of the image. Finally, the performance of the model in image visibility and color correction is discussed. Through experiments and comparative analysis on two test sets, our method is superior to the existing traditional methods and deep learning models in terms of image visibility, detail enhancement, and color correction.

Underwater optical imaging can intuitively reflect internal state of the ocean. However, due to absorption and scattering of light, the degree of attenuation of different wavelengths of light in seawater is different, and underwater images suffer from low contrast and color distortion. To address the problems, a novel network based on U-Net is proposed for underwater image enhancement in this paper. The network consists of two branches namely Branch1 and Branch2: Branch 1 contains a channel attention module and a recurrent residual convolutional neural network based on spatial attention termed AttR2U-Net that is capable of extracting multiscale features. Branch 2 contains three residual groups, embedded in the residual dense block of the channel attention model, by re-weighting the features of different channels to enhance useful features. Furthermore, through dense cascading and residual learning, convolutional enhancement branches extract high-frequency information such as edges in the corrected image to maintain original structure and edges. Finally, results of the outputs of the two branches are fused. Comparable studies demonstrate that the proposed method is superior to state-of-art methods in color correction on underwater images in different scenes and enhancement of the clarity and contrast of images.

Diving deeper into underwater image enhancement: A survey

In ocean engineering, an underwater vehicle is widely used as an important equipment to explore the ocean. However, due to the reflection and attenuation of light when propagating in water, the images captured by the visual system of an underwater vehicle in the complex underwater environment usually suffer from low visibility, blurred details, and color distortion. To solve this problem, in this article, we present an underwater image enhancement framework based on transfer learning, which consists of a domain transformation module and an image enhancement module. The two modules, respectively, perform color correction and image enhancement, effectively transferring in-air image dehazing to underwater image enhancement. To maintain the physical properties of an underwater image, we embed the physical model into the domain transformation module which ensures that the transformed image complies with the physical model. To effectively remove the color deviation, a coarse-grained similarity calculation is added to the domain transformation module to improve the model performance. The experimental results on real-world underwater images of different scenes show that the presented method is superior to some advanced underwater image enhancement algorithms both qualitatively and quantitatively. Furthermore, we conduct ablation experiments to indicate the contribution of each component and further validate the effectiveness of the presented method through application tests.

The underwater color disparity is an important cue for enhancing an underwater image. Applying the underwater color disparity indiscriminately to the entire underwater image tends to give rise to foreground-background crosstalk with either excessive foreground or insufficient background enhancement. To address the discriminativeness between underwater color disparities in foreground and background regions, we develop a discriminative underwater image enhancement method empowered by large foundation model technology. We first utilize the Segment Anything Model to generate segmentation masks, dividing the underwater image into foreground and background regions. This enables accurate foreground-background separation. Then, we conduct adaptive color compensation and fusion to improve the color histogram similarity for foreground and background regions separately. This corrects color deviations and improves contrasts in a discriminative manner that avoids the foreground-background crosstalk. Finally, we propose high-frequency edge fusion to extract high-frequency components from both the original underwater image and the fused image, and then fuse these components to obtain the final enhanced image. This eliminates blurred details arising from the discriminative processing of foreground and background regions. Our method represents the pioneering application of large foundation model technology to empower underwater image enhancement. Experimental results indicate that our method outperforms nine state-of-the-art underwater image enhancement methods in visual quality, achieves superior results across five underwater image quality evaluation metrics on three underwater image datasets, and is beneficial for practical applications such as underwater feature matching. We release our code at https://gitee.com/wanghaoupc/UIE SAM.

Due to complex underwater environments characterized by severe scattering, absorption, and color distortion, accurate restoration remains challenging. This paper proposes a hybrid approach combining dual transmission estimation, adaptive ambient light estimation with color correction, and a U-Net Transformer (Uformer) for underwater image enhancement. Our method estimates transmission maps by integrating boundary constraints and local contrast, which effectively address visibility degradation. An adaptive ambient light estimation and color correction strategy are further developed to correct color distortion robustly. Subsequently, a Uformer network enhances the restored image by capturing global and local contextual features effectively. Experiments conducted on publicly available underwater image datasets validate our approach. Performance is quantitatively evaluated using widely adopted non-reference image quality metrics, especially Underwater Image Quality Measure (UIQM) and Underwater Color Image Quality Evaluation (UCIQE). The results demonstrate that our proposed method achieves superior enhancement performance over several state-of-the-art methods.

Underwater imaging posts a challenge due to the degradation by the absorption and scattering occurred during light propagation as well as poor lighting conditions in water medium. Although image filtering techniques are utilized to improve image quality effectively, problems of the distortion of image details and the bias of color correction still exist in output images due to the complexity of image texture distribution. This paper proposes a new underwater image enhancement method based on image structural decomposition. By introducing a curvature factor into the Mumford_Shah_G decomposition algorithm, image details and structure components are better preserved without the gradient effect. Thus, histogram equalization and Retinex algorithms are applied in the decomposed structure component for global image enhancement and non-uniform brightness correction for gray level and the color images, then the optical absorption spectrum in water medium is incorporate to improve the color correction. Finally, the enhanced structure and preserved detail component are recomposed to generate the output. Experiments with real underwater images verify the image improvement by the proposed method in image contrast, brightness and color fidelity.

Region-specialized underwater image restoration in inhomogeneous optical environments

A novel biologically-inspired method for underwater image enhancement

Vision-based underwater exploration is crucial for marine research. However, the degradation of underwater images due to light attenuation and scattering poses a significant challenge. This results in the poor visual quality of underwater images and impedes the development of vision-based underwater exploration systems. Recent popular learning-based Underwater Image Enhancement (UIE) methods address this challenge by training enhancement networks with annotated image pairs, where the label image is manually selected from the reference images of existing UIE methods since the groundtruth of underwater images do not exist. Nevertheless, these methods encounter uncertainty issues stemming from ambiguous multiple-candidate references. Moreover, they often suffer from local perception and color perception limitations, which hinder the effective mitigation of wide-range underwater degradation. This paper proposes a novel NUAM-Net (Novel Underwater Image Enhancement Attention Mechanism Network) that addresses these limitations. NUAM-Net leverages a probabilistic training framework, measuring enhancement uncertainty to learn the UIE mapping from a set of ambiguous reference images. By extracting features from both the RGB and LAB color spaces, our method fully exploits the fine-grained color degradation clues of underwater images. Additionally, we enhance underwater feature extraction by incorporating a novel Adaptive Underwater Image Enhancement Module (AUEM) that incorporates both local and long-range receptive fields. Experimental results on the well-known UIEBD benchmark demonstrate that our method significantly outperforms popular UIE methods in terms of PSNR while maintaining a favorable Mean Opinion Score. The ablation study also validates the effectiveness of our proposed method.

Underwater polarimetric imaging for visibility enhancement utilizing active unpolarized illumination