No-reference image quality assessment for photographic images based on robust statistics

In this paper, we propose a new standard haze image database with nearly all kinds of haze situations. Our database includes haze-free images as well as different levels and situations of haze images, such as snowy and extremely serious haze images. Our database also records the related weather and air quality information. Moreover, the database offers a mean opinion score (MOS) for each image as the subjective evaluation of the haze severity. Our database provides ample haze images with various objective and subjective descriptions, and has significantly potential scientific value. Since haze is a reason leading to the degradation of the image quality, obtaining the quality of haze images is also necessary and meaningful. In this paper, a novel no-reference image quality assessment (IQA) method for haze images is also proposed. Our method analyzes the model of haze images to evaluate the quality. The experimental results on the haze database show that our method is consistent with the subjective evaluation.

Objective quality assessment metrics that are consistent with human judgments of image quality, play an important role in many image processing applications. No-reference image quality assessment (NR-IQA) algorithms evaluate the quality of distorted images without any information about the reference images. In this paper, we propose an accurate and simple method for NR-IQA. In this method local binary pattern (LBP) operator is first applied to subbands of wavelet decomposed image separately; then histogram of LBP codes is calculated and concatenated to form quality aware features. Finally, support vector regression (SVR) is utilized to map the feature vectors to subjective quality scores. The experimental results for LIVE and TID2008 databases show that our proposed method is highly correlated to the subjective scores, and competitive to state-of-the-art NR-IQA methods.

High Dynamic Range (HDR) imaging captures a wider range of luminance and color than Standard Dynamic Range (SDR), enabling more faithful representations of real-world scenes. Since most displays only support SDR, HDR content must be converted to SDR, often resulting in perceptual distortions like unnatural contrast, loss of detail or color artifacts. This paper evaluates No-Reference Image Quality Assessment (NR-IQA) methods on SDR images derived from HDR using the ESPL-LIVE HDR Image Database, which includes tone-mapped images and images created by multi-exposure fusion, together with associated mean opinion scores (MOS) and standard deviations, providing a reliable ground truth for evaluation. Seven NR-IQA methods, both traditional and Deep Learning (DL)-based, were tested and compared. DL algorithms performed best, with prediction errors below the standard deviation of MOS. Despite moderate correlation values (around 0.5), the results demonstrate the potential of these methods for practical image quality monitoring.

No-reference image quality assessment (NR-IQA), which aims to predict image quality without accessing to reference images, is a fundamental and challenging problem in the field of image processing. Nevertheless, there are few researches about contrast-distorted images and results of the existing NR-IQA methods which cannot be in accordance with the subjective assessment results further. Therefore, an effective NR-IQA method for contrast-distorted image is proposed in this paper. Firstly, the proposed method extracts five features of all images from the database based on the natural scene statistics (NSS) model. Then the curve fitting method is subsequently represented to calculate values of natural image features. Finally, an improved Support Vector Regression (SVR) learning method based on grid search is proposed to establish the mapping between image feature values and the quality score of a test image. Experiments proved that the proposed method is effective when compared with other related state-of-the-art image quality assessment (IQA) methods based on three standard databases.

Quality assessment of images with multiple distortions based on phase congruency and gradient magnitude

Image content variation is a typical and challenging problem in no-reference image-quality assessment (NR-IQA). This work pays special attention to the impact of image content variation on NR-IQA methods. To better analyze this impact, we focus on blur-dominated distortions to exclude the impacts of distortion-type variations. We empirically show that current NR-IQA methods are inconsistent with human visual perception when predicting the relative quality of image pairs with different image contents. In view of deep semantic features of pretrained image classification neural networks always containing discriminative image content information, we put forward a new NR-IQA method based on semantic feature aggregation (SFA) to alleviate the impact of image content variation. Specifically, instead of resizing the image, we first crop multiple overlapping patches over the entire distorted image to avoid introducing geometric deformations. Then, according to an adaptive layer selection procedure, we extract deep semantic features by leveraging the power of a pretrained image classification model for its inherent content-aware property. After that, the local patch features are aggregated using several statistical structures. Finally, a linear regression model is trained for mapping the aggregated global features to image-quality scores. The proposed method, SFA, is compared with nine representative blur-specific NR-IQA methods, two general-purpose NR-IQA methods, and two extra full-reference IQA methods on Gaussian blur images (with and without Gaussian noise/JPEG compression) and realistic blur images from multiple databases, including LIVE, TID2008, TID2013, MLIVE1, MLIVE2, BID, and CLIVE. Experimental results show that SFA is superior to the state-of-the-art NR methods on all seven databases. It is also verified that deep semantic features play a crucial role in addressing image content variation, and this provides a new perspective for NR-IQA.

The human visual system is sensitive to structural information in images, and modeling this information has been regarded as useful for predicting their perceptual quality. In this study, we propose a no-reference (NR) image quality assessment (IQA) method based on a sparse representation of the distribution of structural information. The grayscale fluctuation map of an image is first calculated and divided into patches of fixed size that are rearranged into column vectors, which are regarded as structural elements of the image. Following this, using sparse coding, these structural elements can be represented by sparse representation coefficients and a trained dictionary. By using the former, a probability vector for observing different elements in the trained dictionary can then be obtained. Finally, the prediction model is trained using support vector regression. The results of experiments to test the proposed method show that it can accurately predict humans’ perception of image quality and is competitive in comparison with prevalent NR–IQA methods.

In practice, images available to consumers usually undergo several stages of processing including acquisition, compression, transmission, and presentation, and each stage may introduce certain type of distortion. It is common that images are simultaneously distorted by multiple types of distortions. Most existing objective image quality assessment (IQA) methods have been designed to estimate perceived quality of images corrupted by a single image processing stage. In this letter, we propose a no-reference (NR) IQA method to predict the visual quality of multiply-distorted images based on structural degradation. In the proposed method, a novel structural feature is extracted as the gradient-weighted histogram of local binary pattern (LBP) calculated on the gradient map (GWH-GLBP), which is effective to describe the complex degradation pattern introduced by multiple distortions. Extensive experiments conducted on two public multiply-distorted image databases have demonstrated that the proposed GWH-GLBP metric compares favorably with existing full-reference and NR IQA methods in terms of high accordance with human subjective ratings.

Faithful measurement of perceptual quality is of significant importance to various multimedia applications. By fully utilizing reference images, full-reference image quality assessment (FR-IQA) methods usually achieves better prediction performance. On the other hand, no-reference image quality assessment (NR-IQA), also known as blind image quality assessment (BIQA), which does not consider the reference image, makes it a challenging but important task. Previous NR-IQA methods have focused on spatial measures at the expense of information in the available frequency bands. In this paper, we present a multiscale deep blind image quality assessment method (BIQA, M.D.) with spatial optimal-scale filtering analysis. Motivated by the multi-channel behavior of the human visual system and contrast sensitivity function, we decompose an image into a number of spatial frequency bands by multiscale filtering and extract features for mapping an image to its subjective quality score by applying convolutional neural network. Experimental results show that BIQA, M.D. compares well with existing NR-IQA methods and generalizes well across datasets.

Existing no-reference image quality assessment (NR-IQA) methods mainly focus on designing the low-level features related to image degradation. However, the evaluation of image quality is the human visual perception of image content, involving the integrated analysis of global high-level semantics and local low-level characteristics. From this perspective, we propose a NR-IQA framework based on global and local content perception. We adopt the deep convolutional neural network (DCNN) to extract the semantic feature implied in global image content. The perception of visual quality associated with local content utilizes the visual attention and filtering mechanisms of human visual system. The overall image quality is estimated by combining the semantic and local characteristic features generated from the perceptions. Experimental results on the LIVE IQA database demonstrate that our method is superior to the state-of-the-art NR-IQA algorithms and competitive to the popular full-reference IQA methods. Further experiments on the TID2008 dataset show that the proposed approach is robust for various kinds of distortion types.

Image Quality Assessment (IQA) is essential for the accuracy of systems for automatic recognition of tree species for wood samples. In this study, a No-Reference IQA (NR-IQA), wood NR-IQA (WNR-IQA) metric was proposed to assess the quality of wood images. Support Vector Regression (SVR) was trained using Generalized Gaussian Distribution (GGD) and Asymmetric Generalized Gaussian Distribution (AGGD) features, which were measured for wood images. Meanwhile, the Mean Opinion Score (MOS) was obtained from the subjective evaluation. This was followed by a comparison between the proposed IQA metric, WNR-IQA, and three established NR-IQA metrics, namely Blind/Referenceless Image Spatial Quality Evaluator (BRISQUE), deepIQA, Deep Bilinear Convolutional Neural Networks (DB-CNN), and five Full Reference-IQA (FR-IQA) metrics known as MSSIM, SSIM, FSIM, IWSSIM, and GMSD. The proposed WNR-IQA metric, BRISQUE, deepIQA, DB-CNN, and FR-IQAs were then compared with MOS values to evaluate the performance of the automatic IQA metrics. As a result, the WNR-IQA metric exhibited a higher performance compared to BRISQUE, deepIQA, DB-CNN, and FR-IQA metrics. Highest quality images may not be routinely available due to logistic factors, such as dust, poor illumination, and hot environment present in the timber industry. Moreover, motion blur could occur due to the relative motion between the camera and the wood slice. Therefore, the advantage of WNR-IQA could be seen from its independency from a “perfect” reference image for the image quality evaluation.

This paper presents a No-Reference Image Quality Assessment (NR-IQA) method inspired by human visual perception. It integrates a dual-branch multi-level residual network that combines two complementary streams: one processing HSV images to capture content features aligned with human perception, and another utilizing contrast-sensitive weighted gradient (CSG) images to extract structural and texture features. This dual-branch architecture provides a comprehensive assessment of image quality from both content and structural perspectives. An advanced feature fusion strategy is introduced, employing a dedicated weight module to assign varying importance to content and structural features, ensuring an accurate final quality score. Experimental results on benchmark datasets, including LIVE, CSIQ, TID2013, LIVEC, and KonIQ-10k, showcase the superiority of our method over existing state-of-the-art NR-IQA techniques in key metrics like PLCC and SROCC. Our work holds significant practical value in advancing image quality assessment and has potential applications in multimedia compression, image restoration, enhancement, and related image processing technologies.

No-reference image quality assessment in contourlet domain

No-reference image quality assessment based on spatial and spectral entropies

We present a no-reference (NR) image quality assessment (IQA) algorithm that is inspired by the representation of visual scenes in the primary visual cortex of the human visual system. Specifically, we use the sparse coding model of the area V1 to construct an overcomplete dictionary for sparsely representing pristine (undistorted) natural images. First, we empirically demonstrate that the distribution of the sparse representation coefficients of natural images have sharp peaks and heavy tails, and can therefore be modeled using a Univariate Generalized Gaussian Distribution (UGGD). We then show that the UGGD model parameters form good features for distortion estimation and formulate our no-reference IQA algorithm based on this observation. Subsequently, we find UGGD model parameters that are representative of the class of pristine natural images. This is achieved using a training set of undistorted natural images. The perceptual quality of a test image is then defined to be the likelihood of its sparse coefficients being generated from the pristine UGGD model. We show that the proposed algorithm correlates well with subjective evaluation over several standard image databases. Further, the proposed method allows us to construct a distortion map that has several useful applications like distortion localization, adaptive rate allocation etc. Finally and importantly, the proposed NR-IQA algorithm does not make use of any distortion information or subjective scores during the training process.