Learning adaptive contrast combinations for visual saliency detection

Due to complex lighting circumstances and other factors, visual saliency recognition of underwater images is not as good as visual saliency detection models that function well on land when applied to underwater environments. The dearth of large-scale annotated underwater picture datasets has further hindered the development of visual saliency detection in underwater images. we propose an attention-based approach for underwater image saliency detection to address this issue. The backbone network is pre-trained using both land and underwater image datasets, which effectively solves the problem of fewer datasets. After that, a residual refinement module incorporating a channel-space attention mechanism is merged, the model as a whole is trained end-to-end using underwater image datasets, and the model accuracy is experimentally tested. The experimental results in three underwater image datasets show that our method is better than several other methods in the mainstream evaluation indicators of the saliency detection.

Nowadays, ship detection in sea-sky background is not only useful in maritime visual surveillance, but also helpful in maritime search and rescue. Since ships are salient objects in infrared images with sea-sky background, we present a novel and effective algorithm based on saliency for ship detection in this situation. Our algorithm adopts global saliency, local saliency and background prior to generate saliency maps. Ships are finally segmented in saliency maps. Our algorithm is compared with four classic salient object detection algorithms. And experimental results show our algorithm outperforms the other four algorithms in qualitative and quantitative terms. Keyword list: ship detection ; salient object detection ; infrared image ; sea - sky background . 1. INTRODUCTION Since ships are important vehicles for sea transportation, ship detection in sea-sky background is extensively used in maritime visual surveillance and reconnaissance, avoidance of ship collision accidents, maritime search and rescue, etc. Infrared imaging systems can almost work in any environment and all-weather conditions with its visual capacity in darkness and frog, which makes it a very suitable tool in this application. In recent years, ship detection in infrared images with sea-sky background attracts increasing attention. Many methods are proposed in this field, including image segmentation methods [1-2] and morphological methods [3]. However, due to complex sea-sky environment and large variation of ship sizes, these methods cannot solve the issue completely. And since ships are often salient objects in infrared images with sea-sky background, some researchers have recently tried salient object detection ideas used in color images [4-6]. And the paper is focused on using salient object detection methods to solve the issue. Salient objects are objects which stand out in the image and attract most people ¶VLPPHGLDWHDWWHQWLRQ7KHVWDQGDUGway to detect salient ob MHFWVLVILUVWO\XVLQJVDOLHQF\GHWHFWLRQPHWKRGVWRJHQHUDWHVDOLHQF\PDSVLQZKLFKDSL[HO¶VJUH\value is proportional to its degree of saliency and then segmenting salient objects in saliency maps. Many salient detection methods can be divided into three categories: local contrast methods, global rarity methods and other methods. In local contrast methods, regions which have high contrast with local neighbouring regions are regarded as salient regions. Itti et al. [7] decompose an image into several feature maps . The saliency in each feature map is measured by local center-surround difference in several scales and saliency of different feature maps are integrated to a final saliency

Even though there have been great advancements in computer vision tasks, the development of human visual attention models is still not well investigated. In day-to-day life, one can find ample applications of saliency detection in image and video processing. This paper presents an efficient visual saliency detection model based on Ripplet transform, which aims at detecting the salient region and achieving higher Receiver Operating Characteristics (ROC). Initially the feature maps are obtained from Ripplet transform in different scales and different directions of the image. The global and local saliency maps are computed based on the global probability density distribution and feature distribution of local areas, which are combined together to get the final saliency map. Ripplet-transform-based visual saliency detection is the novel approach carried out in this paper. Experimental results indicate that the proposed method based on Ripplet transformation can give excellent performance in terms of precision, recall, F measure and Mean Absolute Error (MAE), and is compared with 10 state-of-the-art methods on five benchmark datasets.

The ability of human visual system to detect visual saliency is extraordinarily fast and reliable. However, computational modeling of this basic intelligent behavior still remains a challenge. This paper presents a simple method for the visual saliency detection. Our model is independent of features, categories, or other forms of prior knowledge of the objects. By analyzing the log-spectrum of an input image, we extract the spectral residual of an image in spectral domain, and propose a fast method to construct the corresponding saliency map in spatial domain. We test this model on both natural pictures and artificial images such as psychological patterns. The result indicate fast and robust saliency detection of our method.

A novel visual saliency detection method for infrared video sequences

Salient object detection is a process of extracting an object which is visually attractive from a single image or a video. As a powerful technique for automatic image or video segmentation, saliency detection has been focused and studied recently. In this paper, we propose a novel method for salient object detection without training or learning-based techniques. The proposed framework consists of two major steps, the generation of saliency map candidates and the selection of an optimal saliency map. To generate saliency map candidates, prior maps based on combinations of RGB color components are proposed. To select the optimal saliency map among the candidates, we propose a compactness measure, which evaluates the degree to which the generated saliency maps show objects. As a result, among recent works on saliency detection, our saliency detection method achieves the highest performance in terms of saliency detection.

This paper studies audio-visual salient object detection. The task of salient object detection is to detect and mark the objects that are most concerned by people in the visual scene. Traditionally, visual salient object detection uses only images or video frames to detect salient objects, without modeling human multi-modal perception which includes the interaction between vision and hearing. Therefore, in order to improve the visual salient object detection, we incorporate audio modality into the traditional visual salient object detection task by applying a two-stream audio-visual deep learning network. To this end, we also build an audio-visual salient object detection dataset called AVSOD based on the existing dataset. To verify the effectiveness of audio modality in salient object detection, we compare the experimental performance of the deep learning model with and without audio modality. The experimental results demonstrate that audio modality has a good supplementary effect on the task of visual salient object detection, and also verified the effectiveness of the proposed dataset.

Visual saliency detection is usually a prerequisite for image processing tasks like object segmentation, object recognition and information compression. In this work, we first present a novel method that combines cognitive-based objectness and image-based saliency to obtain a better saliency map with less negligible background information. Then, by introducing some top-down attention priors, we further propose a computational selective attention model for object segmentation task on the saliency map. Experiments have shown that our method obviously refines the saliency map of several state-of-the-art algorithms, and our selective attention model meanwhile evidently improves salient object segmentation performance in the challenging saliency benchmark-Extend Complex Scene Saliency Dataset (ECSSD).

Visual saliency detection has become a challenging area in computer vision. In this paper, we propose a novel region based saliency detection model which considers background priors. The proposed method consists of two successive steps - region weighting and contrast computing. In the step of region weighting, we calculate the region weight for each region by region-level image feature and a log-linear prediction model. In the step of contrast computing, we propose a modified contrast computing algorithm by exploiting the advantage of region weights for bottom-up saliency detection. The experimental results on two datasets prove that our method effectively improves the performance on visual saliency detection.

This study aims to improve the quality of multi-view video, and designs a new method by integrating Convolutional neural network (CNN), visual saliency detection and image enhancement theory. The experimental results show that the proposed visual saliency detection model and convolution filter sensor have made remarkable progress. The superiority of the visual saliency detection model is helpful to accurately locate the key features of the image and provide accurate targets for subsequent enhancement processing. The convolution filter sensor improves the peak value of the image, narrows the gap with the original image and improves the visual effect. Supplementary experiments further verify the effectiveness of the method. Through the quantitative comparison between SSIM and MS-SSIM, the method is obviously superior to the existing methods on several data sets, showing a robust video quality enhancement effect. These results highlight the superiority and robustness of the method, and bring strong empirical support to the field of multi-view video quality enhancement, which is expected to have an important impact in practical applications.

We propose a method of predicting human egocentric visual attention using bottom-up visual saliency and egomotion information. Computational models of visual saliency are often employed to predict human attention; however, its mechanism and effectiveness have not been fully explored in egocentric vision. The purpose of our framework is to compute attention maps from an egocentric video that can be used to infer a person’s visual attention. In addition to a standard visual saliency model, two kinds of attention maps are computed based on a camera’s rotation velocity and direction of movement. These rotation-based and translation-based attention maps are aggregated with a bottom-up saliency map to enhance the accuracy with which the person’s gaze positions can be predicted. The efficiency of the proposed framework was examined in real environments by using a head-mounted gaze tracker, and we found that the egomotion-based attention maps contributed to accurately predicting human visual attention.

A frequency domain algorithm using the image anisotropic is proposed for visual saliency in this paper. Based on the SSS algorithm, we generate 8 saliency maps corresponding 8 Gaussian kernels. Then, use the Renyi entropy to divide these saliency maps into two classes and select one optimal map for each class. Finally, combine these two optimal maps for the finally saliency map. The experimental comparison between the proposed and original approach demonstrate the effectiveness and accuracy of our method.

Visual saliency detection based on homology similarity and an experimental evaluation

Multimodal medical image fusion is to extract information from different modal images into a single one and obtain the organizational characteristics of source images. Different medical imaging measures such as CT and MRI often bring different visual morphology, however, the salient features of tissues are basically the same from the perspective of human eyes. According to this characteristic, an improved image fusion algorithm based on visual salience detection is proposed in this paper. First, the GBVS algorithm was introduced to calculate visual salience of two registered source images, and then decompose the source images in NSST domain to obtain their low-frequency and high-frequency sub-bands. For the low-frequency sub-bands, local energy and GBVS graph are input into fuzzy logic system to obtain the respective weights for the fused low-frequency sub-band. For the high-frequency sub-bands, the NSML values of each sub-band were calculated and compared to obtain the fused high-frequency sub-band. The final fused image was obtained by using the inverse NSST transformation. Applying this method to multimodal medical image fusion, the visual quality of the image can be enhanced effectively and the salient features of tissues can be preserved well. Experiments on multimodal fusion of different gray-scale medical images show that the proposed method has advantages in retention of image salient features and the overall image contrast, and has better objective index than the comparison models.

Since 20th century generation, image segmentation has been attached great importance by the people and thousands of the segmentation algorithms have been proposed. In practice, in order to facilitate research and analysis of the images that often only needs to be interested in certain parts of the image part is divided into a certain properties of a particular area, in order to use the target further, we also need to complete for their separation. This paper integrates the visual attention model to propose the novel image segmentation algorithm based on visual saliency detection and the integrated feature extraction. We have achieved the better numerical performance compared with other state-of-the-art methodologies. The propose method integrates the local and the regional features to construct the global optimized saliency map to serve as the basis for segmentation. The entropy of the image is used for determining the threshold and the effectiveness is proved through experiment.