No-Reference Image Quality Assessment for Contrast Distorted Images

We present a no-reference (NR) image quality assessment (IQA) algorithm that is inspired by the representation of visual scenes in the primary visual cortex of the human visual system. Specifically, we use the sparse coding model of the area V1 to construct an overcomplete dictionary for sparsely representing pristine (undistorted) natural images. First, we empirically demonstrate that the distribution of the sparse representation coefficients of natural images have sharp peaks and heavy tails, and can therefore be modeled using a Univariate Generalized Gaussian Distribution (UGGD). We then show that the UGGD model parameters form good features for distortion estimation and formulate our no-reference IQA algorithm based on this observation. Subsequently, we find UGGD model parameters that are representative of the class of pristine natural images. This is achieved using a training set of undistorted natural images. The perceptual quality of a test image is then defined to be the likelihood of its sparse coefficients being generated from the pristine UGGD model. We show that the proposed algorithm correlates well with subjective evaluation over several standard image databases. Further, the proposed method allows us to construct a distortion map that has several useful applications like distortion localization, adaptive rate allocation etc. Finally and importantly, the proposed NR-IQA algorithm does not make use of any distortion information or subjective scores during the training process.

Objective quality assessment metrics that are consistent with human judgments of image quality, play an important role in many image processing applications. No-reference image quality assessment (NR-IQA) algorithms evaluate the quality of distorted images without any information about the reference images. In this paper, we propose an accurate and simple method for NR-IQA. In this method local binary pattern (LBP) operator is first applied to subbands of wavelet decomposed image separately; then histogram of LBP codes is calculated and concatenated to form quality aware features. Finally, support vector regression (SVR) is utilized to map the feature vectors to subjective quality scores. The experimental results for LIVE and TID2008 databases show that our proposed method is highly correlated to the subjective scores, and competitive to state-of-the-art NR-IQA methods.

No-reference image quality assessment algorithms: A survey

Prior knowledge about anticipated distortions and their corresponding human opinion scores is needed in the most general purpose no-reference image quality assessment algorithms. When creating the model, all distortion types may not be existed. Predicting the quality of distorted images in practical no-reference image quality assessment algorithms is devised without prior knowledge about images or their distortions. In this study, a blind/no-reference opinion and distortion unaware image quality assessment algorithm based on natural scenes is developed. The proposed approach uses a set of novel features to measure image quality in a spatial domain. The extracted features which are from the scenes gist are formed using Weibull distribution statistics. When testing the proposed algorithm on LIVE database, experiments show that it correlates well with subjective opinion scores. They also show that the proposed algorithm significantly outperforms the popular full-reference peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) methods. Not only do the results reasonably well compete with the recently developed natural image quality evaluator (NIQE) model, but also outperform it.

Existing no-reference image quality assessment (NR-IQA) methods mainly focus on designing the low-level features related to image degradation. However, the evaluation of image quality is the human visual perception of image content, involving the integrated analysis of global high-level semantics and local low-level characteristics. From this perspective, we propose a NR-IQA framework based on global and local content perception. We adopt the deep convolutional neural network (DCNN) to extract the semantic feature implied in global image content. The perception of visual quality associated with local content utilizes the visual attention and filtering mechanisms of human visual system. The overall image quality is estimated by combining the semantic and local characteristic features generated from the perceptions. Experimental results on the LIVE IQA database demonstrate that our method is superior to the state-of-the-art NR-IQA algorithms and competitive to the popular full-reference IQA methods. Further experiments on the TID2008 dataset show that the proposed approach is robust for various kinds of distortion types.

Measuring visual quality, as perceived by human observers, is becoming increasingly important in many applications where humans are the ultimate consumers of visual information. Significant progress has been made for assessing the subjective quality of natural images, such as those taken by optical cameras. Natural Scene Statistics (NSS) is an important tool for no-reference visual quality assessment of natural images, where the reference image is not needed for comparison. In this paper, we take an important step towards using NSS to automate visual quality assessment of photorealistic synthetic scenes typically found in video games and animated movies. Our primary contributions are (1) conducting subjective tests on our publicly available ESPL Synthetic Image Database containing 500 distorted images (20 distorted images for each of the 25 original images) in 1920 × 1080 format, and (2) evaluating the performance of 17 no-reference image quality assessment (IQA) algorithms using synthetic scene statistics. We find that similar to natural scenes, synthetic scene statistics can be successfully used for IQA and certain statistical features are good for certain image distortions.

The adaptive optics (AO) technique is widely used to compensate for ocular aberrations and improve imaging resolution. However, when affected by intraocular scatter, speckle noise, and other factors, the quality of the retinal image will be degraded. To effectively improve the image quality without increasing the imaging system's complexity, the post-processing method of image deblurring is adopted. In this study, we proposed a conditional adversarial network-based method for directly learning an end-to-end mapping between blurry and restored AO retinal images. The proposed model was validated on synthetically generated AO retinal images and real retinal images. The restoration results of synthetic images were evaluated with the metrics of peak signal-to-noise ratio (PSNR), structural similarity (SSIM), perceptual distance, and error rate of cone counting. Moreover, the blind image quality index (BIQI) was used as the no-reference image quality assessment (NR-IQA) algorithm to evaluate the restoration results on real AO retinal images. The experimental results indicate that the images restored by the proposed method have sharper quality and higher signal-to-noise ratio (SNR) when compared with other state-of-the-art methods, which has great practical significance for clinical research and analysis.

Images can be distorted in the real world via many sources like faulty sensors, artifacts generated by compression algorithms, defocus, faulty lens, and poor lighting conditions. Our biological vision system can identify the quality of image by looking at the images, but developing an algorithm to assess the quality of an image is a very challenging task as an image can be corrupted by different types of distortions and statistical properties of different types of distortions are dissimilar. The main objective of this article is to propose an image quality assessment technique for images corrupted by blurring and compression-based artifacts. Machine learning-based approaches have been used in recent times to perform this task. Images can be analyzed in different transform domains like discrete cosine transform domain, wavelet domains, curvelet domains, and singular value decomposition. These domains generate sparse matrices. In this paper, we propose no-reference image quality assessment algorithms for images corrupted by blur and different compression algorithms using sparsity-based features computed from different domains and all features pooled by support vector regression. The proposed model has been tested on three standard image quality assessment datasets LIVE, CSIQ, and TID2013, and correlation with subjected human opinion scores has been presented along with comparative study with state-of-the-art quality measures. Experiments run on standard image quality databases show that the results obtained are outperforming the existing results.

No Reference Image Quality Assessment (NR-IQA) refers to algorithms that predict the quality of distorted image where the reference image is not available. NR-IQA algorithms are divided into two categories: specific distortion quality assessment and general purpose quality assessment. The first type of algorithms deals with a specific distortion and predict the quality of the image based on this distortion. Which means it assumes that the distortion in the image is known. On the other hand, the general purpose quality assessment type predicts the quality of image with no information about the distortion that affecting the tested image. A two-stage framework, is proposed by Moorthy and Bovik [1], which classifies the distortion followed by distortion-specific quality assessment method. Our proposal here is to improve the classification portion by investigating the performance of different classification techniques and different features. Each feature is validated using different features evaluation techniques. As a result, we construct a set of optimal features that classify image distortions with a high accuracy rate.

The goal of no-reference image quality assessment (NR-IQA) is to predict the quality of an image as perceived by human observers without using any pristine, reference images. In this study, an NR-IQA algorithm is proposed which is driven by a novel feature vector containing statistical and perceptual features. Different from other methods, normalized local fractal dimension distribution and normalized first digit distributions in the wavelet and spatial domains are incorporated into the statistical features. Moreover, powerful perceptual features, such as colorfulness, dark channel feature, entropy, and mean of phase congruency image, are also incorporated to the proposed model. Experimental results on five large publicly available databases (KADID-10k, ESPL-LIVE HDR, CSIQ, TID2013, and TID2008) show that the proposed method is able to outperform other state-of-the-art methods.

No-reference image quality assessment for photographic images based on robust statistics

Effect of Contrast Measures on the Performance of No-Reference Image Quality Assessment Algorithm for Contrast-Distorted Images

With the development of digital imaging techniques, image quality assessment methods are receiving more attention in the literature. Since distortion-free versions of camera images in many practical, everyday applications are not available, the need for effective no-reference image quality assessment algorithms is growing. Therefore, this paper introduces a novel no-reference image quality assessment algorithm for the objective evaluation of authentically distorted images. Specifically, we apply a broad spectrum of local and global feature vectors to characterize the variety of authentic distortions. Among the employed local features, the statistics of popular local feature descriptors, such as SURF, FAST, BRISK, or KAZE, are proposed for NR-IQA; other features are also introduced to boost the performances of local features. The proposed method was compared to 12 other state-of-the-art algorithms on popular and accepted benchmark datasets containing RGB images with authentic distortions (CLIVE, KonIQ-10k, and SPAQ). The introduced algorithm significantly outperforms the state-of-the-art in terms of correlation with human perceptual quality ratings.

Image Quality Assessment (IQA) is essential for the accuracy of systems for automatic recognition of tree species for wood samples. In this study, a No-Reference IQA (NR-IQA), wood NR-IQA (WNR-IQA) metric was proposed to assess the quality of wood images. Support Vector Regression (SVR) was trained using Generalized Gaussian Distribution (GGD) and Asymmetric Generalized Gaussian Distribution (AGGD) features, which were measured for wood images. Meanwhile, the Mean Opinion Score (MOS) was obtained from the subjective evaluation. This was followed by a comparison between the proposed IQA metric, WNR-IQA, and three established NR-IQA metrics, namely Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE), deepIQA, Deep Bilinear Convolutional Neural Networks (DB-CNN), and five Full Reference-IQA (FR-IQA) metrics known as MSSIM, SSIM, FSIM, IWSSIM, and GMSD. The proposed WNR-IQA metric, BRISQUE, deepIQA, DB-CNN, and FR-IQAs were then compared with MOS values to evaluate the performance of the automatic IQA metrics. As a result, the WNR-IQA metric exhibited a higher performance compared to BRISQUE, deepIQA, DB-CNN, and FR-IQA metrics. Highest quality images may not be routinely available due to logistic factors, such as dust, poor illumination, and hot environment present in the timber industry. Moreover, motion blur could occur due to the relative motion between the camera and the wood slice. Therefore, the advantage of WNR-IQA could be seen from its independency from a “perfect” reference image for the image quality evaluation.

With the rapid access convenience of content brought by 5G technology, the integrity protection of content becomes more important. The reversible visible watermarking algorithm has attracted more attention due to its effective content protection. In this paper, a novel improved reversible visible image watermarking scheme based on gradient-weighted class activation mapping (Grad-CAM) and the just noticeable difference (JND) model has been presented. The proposed region of interest (ROI) selection strategy is used to locate the main protected body of images for watermark embedding. Divide the watermark and ROI into nonoverlapping blocks in the same way and then embed the classified two types of watermark blocks into corresponding ROI blocks with the JND model. The optimal bit positions for watermark embedding can be selected adaptively with JND threshold and achieve the tradeoff between the watermark visibility and watermarked image quality. For lossless image recovery and watermark extraction, the recovery information is reversibly hidden into watermarked image. In the experiments, the same process of grayscale images is used to each channel separately for color images watermarking. Besides, there are six aspects in this paper to estimate the proposed scheme; with the comparison to other reversible visible watermarking schemes, experimental results demonstrate the effectiveness of our proposed scheme.