A shallow convolutional neural network for blind image sharpness assessment

Shaode Yu; Shibin Wu; Lei Wang; Fan Jiang; Yaoqin Xie; Leida Li

doi:10.1371/journal.pone.0176632

Abstract

Blind image quality assessment can be modeled as feature extraction followed by score prediction. It necessitates considerable expertise and efforts to handcraft features for optimal representation of perceptual image quality. This paper addresses blind image sharpness assessment by using a shallow convolutional neural network (CNN). The network takes single feature layer to unearth intrinsic features for image sharpness representation and utilizes multilayer perceptron (MLP) to rate image quality. Different from traditional methods, CNN integrates feature extraction and score prediction into an optimization procedure and retrieves features automatically from raw images. Moreover, its prediction performance can be enhanced by replacing MLP with general regression neural network (GRNN) and support vector regression (SVR). Experiments on Gaussian blur images from LIVE-II, CSIQ, TID2008 and TID2013 demonstrate that CNN features with SVR achieves the best overall performance, indicating high correlation with human subjective judgment.

Citation: Yu S, Wu S, Wang L, Jiang F, Xie Y, Li L (2017) A shallow convolutional neural network for blind image sharpness assessment. PLoS ONE 12(5): e0176632. https://doi.org/10.1371/journal.pone.0176632

Editor: You Yang, Huazhong University of Science and Technology, CHINA

Received: November 18, 2016; Accepted: April 13, 2017; Published: May 1, 2017

Copyright: © 2017 Yu et al. This is an open access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.

Data Availability: All relevant data are within the manuscript.

Funding: This work is supported in part by grants from National Natural Science Foundation of China (Grant Nos. 81501463 and 61379143), Natural Science Foundation of Guangdong Province (Grant No. 2014A030310360), Major Project of Guangdong Province (Grant No. 2014B010111008), the Qing Lan Project of Jiangsu Province, National 863 Programs of China (Grant No. 2015AA043203), National Key Research Program of China (Grant No. 2016YFC0105102) and Guangdong Innovative Research Team Program (Grant No. 2011S013). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

Competing interests: The authors have declared that no competing interests exist.

Introduction

A picture wins a thousand words. With the rapid pace of modern life and the massive dissemination of smart phones, digital images have been a major source of information acquisition and distribution. Since an image is prone to various kinds of distortions from its capture to the final display on digital devices, a lot of attention has been paid to the assessment of perceptual image quality [1–8].

Subjective image quality assessment (IQA) is the most straightforward. However, it is laborious and may introduce bias and errors. Comparatively, objective evaluation of visual image quality with full- or reduced-reference based methods enables impartial judgment [9–22]. These algorithms have reached high-level performance, while in most possible situations, the reference messages are not easy or impossible to acquire. Thus, no-reference or blind IQA methods are more useful in real applications [23–34].

Blind image quality assessment (BIQA) mainly consists of two steps, feature extraction (T) and score prediction (f). Before rating an image, T and f should be prepared. The former aims to select optimal features for image quality representation, while the latter builds the functional relationship between the features and subjective scores. With considerable expertise and efforts, a BIQA system can be built. As such, a test image (I) is input to the system and represented with features (T). Finally, the function f will quantify the features and figure out a numerical score (s) as the output, denoting the predicted quality of the test image. The procedure for score prediction can be formulated as follows, (1)

Blind image sharpness assessment (BISA) is studied in this paper. Among various kinds of distortions, sharpness is commonly degraded by camera out-of-focus, relative target motion and lossy image compression. It is crucial to readability and content understanding. Sharpness is inversely related to blur which is typically determined by the spread of edges in the spatial domain, and accordingly the attenuation of high frequency components. Karam et al. [35] introduced the Just Noticeable Blur (JNB) model and integrated local contrast and edge width in each edge blocks into a probability summation model. Later, they improved the model with the cumulative probability of blur detection (CPBD) [36]. Ciancia et al. [37] selected blur-related features as the input of a neural network and realized no-reference blur assessment with multi-feature classifiers. Vu et al. [38] combined two features, the high frequency content with the slope of local magnitude spectrum and the local contrast with total variation, to form the spectral and spatial sharpness (S3) index. Vu et al. [39] defined a fast image sharpness (FISH) metric which weights the log-energies of wavelet coefficients. Hassen et al. [40] explored the strength of local phase coherence (LPC) based on the observation that blur disrupts image LPC structures. Sang et al. [41, 42] used the shape of singular value curve (SVC) to measure the extent of blur, because the extent of blur results in attenuation of singular values. Bahrami and Kot [43] took account of maximum local variation (MLV) of each pixel and utilized the standard deviation of ranking weighted MLVs as the sharpness score. Li et al. [44] proposed the sparse representation based image sharpness (SPARISH) model that utilizes dictionary learning of natural image patches. Gu et al. [45] designed an autoregressive based image sharpness metric (ARISM) via image analysis in the autoregressive parameter space. Li et al. [46] presented a blind image blur evaluation (BIBLE) index which characterizes blur with discrete moments, because noticeable blur affects the moment magnitudes of images.

Deep learning has revolutionized image representation and shed light on utilizing high-level features for BIQA [47, 48]. Li et al. [49] adapted Shearlet transform for spatial feature extraction and employed a deep network for image score regression. Hou and Gao [50] recast BIQA as a classification problem and used a saliency-guided deep framework for feature retrieval. Li et al. [51] took the Prewitt magnitudes of segmented images as the input of convolutional neural network (CNN). Lv et al. [52] explored the local normalized multi-scale difference of Gaussian response as features and designed a deep network for image quality rating. Hou et al. [53] designed a deep learning model trained by deep belief net and then fine-tuned it for image quality estimation. Yet it is found that some deep learning based methods need to handcraft features [49–52] or redundant operations [50, 52, 53].

This paper presents a shallow CNN to address BISA. On the one hand, several studies indicate that image sharpness is generally characterized by the spread of edge structures [35–38, 44, 46]. Interestingly, what CNN learns in the first layer are mainly edges [47, 48]. Thus, it is intuitive to design a single feature layer CNN for image sharpness estimation. On the other hand, small data sets make deep networks hard to converge which may increase the risk of over-fitting. Consequently, a shallow CNN can be well trained with limited samples [54]. To the best of our knowledge, the most similar work is Kang’s CNN [55]. The network utilizes two full-connection layers and obtains dense features by both maximum and minimum pooling before image scoring. Relatively, our network is much simpler in the architecture and more suitable for the analysis of small databases. Besides, our CNN is verified with Gaussian blurring images from four popular databases. After features are retrieved for representation of sharpness, the prediction performance of multilayer perceptron (MLP) is compared to both general regression neural network (GRNN) [56] and support vector regression (SVR) [57]. In the end, the effect of color information on our CNN and the running time are reported.

A shallow CNN

The simplified CNN consists of one feature layer and the feature layer is made up of convolutional filtering and average pooling. As shown in Fig 1, a gray-scale image is pre-processed with local contrast normalization. Then, a number of image patches are randomly cropped for feature extraction. At last, the features are as input to MLP for score prediction. By supervised learning, parameters in the network are updated and fine-tuned with back-propagation.

Download:

Fig 1. The proposed BISA system.

A gray-scale image is pre-processed with local contrast normalization and then a number of image patches are randomly cropped for CNN training, validation and final testing.

https://doi.org/10.1371/journal.pone.0176632.g001

Feature extraction

Local contrast normalization.

It has a decorrelating effect in spatial image analysis by applying a local non-linear operation to remove local mean displacements and to normalize the local variance [25, 58]. As in [52, 55], the local normalization is formulated as following, (2) where, (3) and (4)

In the equations, I(i, j) is the pixel intensity value at (i, j), is its normalized value, μ(i, j) is the mean value, σ(i, j) is the standard deviation and C is a positive constant (C = 10). Besides, [2P + 1, 2Q + 1] is the window size and P = Q = 3.

Feature representation.

Each patch randomly cropped in the pre-processed image is through convolutional filtering and pooling before full connection to MLP. A feature vector of an image patch is generated and formulated as, (5) where I_p is an image patch, n is the feature dimension and x_l is the l^th component of the feature vector X.

Score prediction

Multilayer perceptron (MLP).

Fig 2 illustrates an MLP with a hidden layer. The output f(X) with regard to the input feature X can be expressed as following, (6) where f_mlp denotes an activation function, while w and b respectively stand for the weight vector and the bias vector.

Download:

Fig 2. MLP with one hidden layer.

It consists of three layers, the input layer, the hidden layer and the output layer.

https://doi.org/10.1371/journal.pone.0176632.g002

General regression neural network (GRNN).

GRNN is a powerful regression tool based on statistical principles [56]. It takes only a single pass through a set of feature instances and requires no iterative training. GRNN consists of four layers as shown in Fig 3. Assume that m samples have been used to train the GRNN. To an input feature vector X, its output f(X) can be described as below, (7)

Download:

Fig 3. A semantic description of GRNN.

It consists of four layers, the input layer, the pattern layer, the summation layer and the output layer.

https://doi.org/10.1371/journal.pone.0176632.g003

where Y_i is the weight between the i^th neuron in the pattern layer and the numerator neuron in the summation layer, and σ is a spread parameter. In GRNN, only σ is tunable and a larger value leads to a smoother prediction.

Support vector regression (SVR).

SVR is effective in handling numerical prediction in high dimension space [57, 59]. For an input X, the goal of ε-SVR is to find a function f(X) that has the maximum deviation of ε from the subjective score Y for all the training patches. The function is defined by (8) where φ(⋅) is a nonlinear function, w is a weight vector and γ is a bias. The aim is to find w and γ from the training data such that the error is less than a predefined value of ε. The radial basis function is used as the kernel function, K(X_i, X) = e^{−ρ||X_i−X||}, and ρ is a positive parameter that controls the radius and X_i is a training sample. By using a validation set to tradeoff the prediction error, ρ and ε are determined [60].

Network training

CNN is end-to-end trained by supervised learning with stochastic gradient descent. Assume there are a set of features and corresponding scores . The training aims to minimize the loss function L(w, b), (9) which is the sum of square error between the predicted s_i and the subjective score Y_i.

Using gradient descent, the relationship between the l^th and the (l + 1)^th iteration to each weight component can be described as following, (10) (11) where μ is the momentum that indicates the contribution of the previous weight update in the current iteration, and η denotes the learning rate.

Experiments

Images for performance evaluation

Gaussian blurring images are collected from four popular databases. LIVE-II [10] and CSIQ [61] respectively contain 29 and 30 reference images which are distorted with 5 blur levels and scored by differential mean opinion scores (DMOS). Both TID2008 [62] and TID2013 [63] have 25 references and use mean opinion scores (MOS) for scoring. Each reference image in TID2008 and TID2013 is degraded with 4 and 5 different blur levels, respectively. Fig 4 shows some representative images.

Download:

Fig 4. Example of Gaussian blurring images in four databases.

https://doi.org/10.1371/journal.pone.0176632.g004

Experiment design

LIVE-II is taken as the baseline database for tuning parameters in CNN, GRNN and SVR. Blurred images in LIVE-II are portioned into 20:4:5 for training, validation and test, respectively. After that, parameters in GRNN and SVR are optimized based on learned features from CNN. In the end, about 60%, 20% and 20% blurring images in each database are randomly selected for training, validation and test, respectively.

Besides Kang’s CNN [55], ten state-of-the-art BISA methods are evaluated. These methods are JNB [35], CPBD [36], S3 [38], FISH [39], LPC [40], SVC [42], MLV [43], SPARISH [44], ARISM [45] and BIBLE [46]. In the end, the running time of involved algorithms and the effect of color information on our CNN are studied.

Performance criteria

Two criteria are recommended for IQA performance evaluation by the video quality experts groups (VQEG, http://www.vqeg.org). Pearson linear correlation coefficient (PLCC) evaluates the prediction accuracy, while Spearman rank-order correlation coefficient (SROCC) measures the prediction monotonicity. Values of both criteria range in [0, 1] and higher value indicates better rating prediction.

A nonlinear regression is first applied to map the predicted scores to subjective human ratings using a five-parameter logistic function as follows, (12) where s and Q(s) are the input score and the mapped score, and q_i (i = 1, 2, 3, 4, 5) are determined during the curve fitting.

Software and platform

Softwares are run on Linux system (Ubuntu 14.04). The system is embedded with 8 Intel Xeon(R) CPU (3.7GHz), 16GB DDR RAM and one GPU card (Nvidia 1070). Kang’s CNN is implemented by us following the paper [55]. Both CNN models are realized with Theano 0.8.2 (Python 2.7.6) and accessible on GitHub at present for fair comparison (https://github.com/Dakar-share/Plosone-IQA). Other codes are realized with Matlab. Ten BISA methods are provided by authors and estimated without any modifications, GRNN is with the function newgrnn and SVR is from LIBSVM [59].

Result

Parameter tuning

Several parameters are experimentally determined, the patch number per image (P_n), the kernel number (K_n) and the kernel size ([K_x, K_y]) in feature extraction, and the iteration number (N_i) in network training. In addition, the spread parameter (σ) in GRNN and cost function (c) in ε-SVR are also studied. Note that in the network, we define the size of image patch [16 16], the learning rate η = 0.01, the bias γ = 0.1 and the momentum μ = 0.9, and other parameters are set by default.

Parameters in CNN.

Fig 5 shows CNN performance when the iteration number (N_i) varies from 10³ to 10⁴ and the patch number per image (P_n) changes from 10² to 10³. No much change is found after N_i reaches 4000. On the other side, P_n = 400 is a good point to tradeoff PLCC and SROCC. Therefore, we use N_i = 4000 and P_n = 400 hereafter.

Download:

Fig 5. CNN prediction performance with N_i or P_n changes.

https://doi.org/10.1371/journal.pone.0176632.g005

Table 1 shows the CNN performance with regard to the kernel number (K_n) and the kernel size ([K_x, K_y]). When K_n = 16, CNN performs well, while it is unstable when K_n = 32. On the other hand, prediction performance of CNN is insensitive to kernel size [K_x, K_y] changes. So we define K_n = 16 and K_x = K_y = 7.

Download:

Table 1. CNN performance with regard to kernel number and kernel size.

https://doi.org/10.1371/journal.pone.0176632.t001

Parameters in GRNN and SVR.

The spread parameter (σ) in GRNN and the cost function (c) in ε-SVR are studied with learned CNN features. Fig 6 shows PLCC and SROCC values when σ or c changes. The left plot indicates that when σ = 0.01, GRNN performs the best. The right shows that PLCC and SROCC increase when log₁₀(c) increases, while when log₁₀(c) > 1, SROCC keeps stable. Thus, σ = 0.01 in GRNN and c = 50 in ε-SVR.

Download:

Fig 6. GRNN (left) and SVR (right) respectively perform when the spread parameter σ and the cost function c changes based on learned CNN features.

https://doi.org/10.1371/journal.pone.0176632.g006

Learned CNN features

One trained kernel is visualized by using “monarch.bmp” in LIVE-II. Blurred images and their filtered results are shown in Fig 7. The top row shows Gaussian blurring images and the bottom row are images after convolutional filtering with the trained kernel. Underneath the filtered results are subjective scores, where lower scores indicate better visual quality. Compared to the relatively high-quality image (y₉₆), fine structures vanish in low-quality images (y₁₁ and y₁₀₃).

Download:

Fig 7. One trained kernel visualized by using “monarch.bmp”.

After convolutional filtering with the trained kernel, edge structures is hard to notice in heavily blurred images (y₁₁), while fine structures can be seen in relatively high-quality images (y₉₆).

https://doi.org/10.1371/journal.pone.0176632.g007

Algorithm performance

Table 2 summarizes the PLCC values and the highest values are marked in bold face. With handcrafted features, BIBLE [46] predicts the best, followed by SPARISH [44]. For CNNs, Kang’s CNN is instable. It achieves the best performance on TID2013 and the lowest value on CSIQ. For the proposed methods, CNN features with GRNN or SVR shows advantage. In general, retrieved features with SVR reaches an average PLCC value of 0.9435, and CNN features with GRNN gets 0.9377, followed by BIBLE (0.9251) and SPARISH (0.9217). Our CNN achieves an average PLCC of 0.9184.

Download:

Table 2. Performance evaluation with PLCC on Gaussian blurring images.

https://doi.org/10.1371/journal.pone.0176632.t002

Table 3 shows SROCC and bolded values indicate best predication monotonicity. BIBLE [46] shows superiority over algorithms based on handcrafted features, followed by SPARISH [44] and ARISM [45]. Kang’s CNN [55] achieves the highest SROCC on Gaussian blurring images from LIVE-II and TID2013, while it gets the second lowest SROCC on images from CSIQ among all metrics. On contrary, SROCC values from our CNN methods are robust on images from different databases. Particularly, CNN features with SVR outperforms other methods on CSIQ and TID2008. Furthermore, it ranks the second and the third place on TID2013 and LIVE-II, respectively. Generally, learned CNN features with SVR reaches an average SROCC of 0.9310, which is higher than CNN features with GRNN (0.9283), BIBLE (0.9160) and other methods.

Download:

Table 3. Performance evaluation of SROCC on Gaussian blurring images.

https://doi.org/10.1371/journal.pone.0176632.t003

Time consumption

The time spent on score prediction of image sharpness is shown in Fig 8. Among traditional methods, several algorithms show promise in real-time image sharpness estimation, such as LPC, MLV, SVC and FISH which require less than 1 s. For CNN-based methods, both models take about 0.02 s to rate an image. It should be noted that the major time of CNN models is spent on local contrast normalization which costs about 8 s for an image. Moreover, GRNN and SVR need time after the model is well trained. Fortunately, with the help of code optimization and advanced hardware, it is feasible to accelerate these algorithms and to satisfy real time requirement.

Download:

Fig 8. The time spent on score prediction of image sharpness.

Several algorithms show promise in real-time image sharpness estimation.

https://doi.org/10.1371/journal.pone.0176632.g008

Effect of color information

Chroma is an important underlying property of human vision system [64, 65] and it is highly correlated with image quality perception [30, 44]. Effect of color information on image sharpness estimation is studied with our CNN. The performance of CNN with gray and color inputs is shown in Fig 9. It is observed that chromatic information positively enhances CNN’s performance on image sharpness estimation. The improved magnitude of PLCC ranges from 0.013 (LIVE-II) to 0.040 (TID2008). Meanwhile, the improved magnitude range of SROCC is from 0.014 (CSIQ) to 0.067 (TID2008).

Download:

Fig 9. Effect of color information on our CNN.

Compared to gray-scale input, color image input positively enhances our network’s prediction metrics.

https://doi.org/10.1371/journal.pone.0176632.g009

Future work

The proposed shallow CNN methods have achieved the state-of-the-art performance on simulated Gaussian blur images from four popular databases. Our future work will be to integrate handcrafted features and CNN features for improved prediction capacity. On the other hand, deeper networks will also be considered for representative features in image sharpness. In addition, with the public accessibility to the real-life blurring image databases of BID2011 [37] and CID2013 [66], it will be interesting to explore the proposed algorithm for more general and more practical applications [32, 67, 68].

Conclusion

A shallow convolutional neural network is proposed to address blind image sharpness assessment. Its retrieved features with support vector regression achieves the best overall performance, indicating high correlation with subjective judgment. In addition, incorporating color information benefits image sharpness estimation with the shallow network.

Acknowledgments

The authors would like to thank reviewers for their valuable advices that has helped to improve the paper quality. Thanks are also given to researchers who share their codes for fair comparison. This work is supported in part by grants from National Natural Science Foundation of China (Grant Nos. 81501463 and 61379143), Natural Science Foundation of Guangdong Province (Grant No. 2014A030310360), Major Project of Guangdong Province (Grant No. 2014B010111008), Guangdong Innovative Research Team Program (Grant No. 2011S013), the Qing Lan Project of Jiangsu Province, National 863 Programs of China (Grant No. 2015AA043203) and National Key Research Program of China (Grant No. 2016YFC0105102).

Author Contributions

Conceptualization: SDY FJ YQX.
Data curation: SDY SBW FJ LDL.
Formal analysis: SDY LDL YQX LW.
Funding acquisition: SDY LDL YQX LW.
Investigation: LDL YQX.
Methodology: SDY FJ LDL YQX.
Project administration: SDY LDL.
Resources: SDY SBW LDL.
Software: SDY SBW FJ LDL.
Supervision: SDY LDL YQX.
Validation: SDY LDL.
Visualization: SDY FJ.
Writing – original draft: SDY SBW.
Writing – review & editing: LDL YQX LW.

References

1. Lin W, Kuo CCJ. Perceptual visual quality metrics: A survey. Journal of Visual Communication and Image Representation. 2011 Jan; 22(4): 297–312.
- View Article
- Google Scholar
2. Manap RA, Shao L. Non-distortion-specific no-reference image quality assessment: A survey. Information Sciences. 2015 Dec; 301(1): 141–160.
- View Article
- Google Scholar
3. Gao X, Gao F, Tao D, Li X. Universal blind image quality assessment metrics via natural scene statistics and multiple kernel learning. IEEE Transactions on Neural Networks and Learning Systems. 2013 Jul; 24(12): 2013–2026. pmid:24805219
- View Article
- PubMed/NCBI
- Google Scholar
4. Li L, Lin W, Zhu H. Learning structural regularity for evaluating blocking artifacts in JPEG images. IEEE Signal Processing Letters. 2014 Aug; 21(8): 918–922.
- View Article
- Google Scholar
5. Xue W, Mou X, Zhang L, Bovik AC, Feng X. Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Transactions on Image Processing. 2014 Nov; 23(11): 4850–4862. pmid:25216482
- View Article
- PubMed/NCBI
- Google Scholar
6. Li L, Zhu H, Yang G, Qian J. Referenceless measure of blocking artifacts by Tchebichef kernel analysis. IEEE Signal Processing Letters. 2014 Jan; 21(1): 122–125.
- View Article
- Google Scholar
7. Wu Q, Wang Z, Li H. A highly efficient method for blind image quality assessment. IEEE Conference on Image Processing. 2015 Sep; 1: 339–343.
8. Oszust M. Full-reference image quality assessment with linear combination of genetically selected quality measures. PloS one. 2016 Jun; 11(6):e0158333. pmid:27341493
- View Article
- PubMed/NCBI
- Google Scholar
9. Gu K, Li L, Lu H, Min X, Lin W. A fast computational metric for perceptual image quality assessment. IEEE Transactions on Industrial Electronics. 2017 Jan.
- View Article
- Google Scholar
10. Sheikh HR, Sabir MF, Bovik AC. A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing. 2006 Nov; 15(11):3440–3451. pmid:17076403
- View Article
- PubMed/NCBI
- Google Scholar
11. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing. 2004 Apr; 13(4):600–612. pmid:15376593
- View Article
- PubMed/NCBI
- Google Scholar
12. Zhang L, Zhang L, Mou X, Zhang D. FSIM: A feature similarity index for image quality assessment. IEEE Transactions on Image Processing. 2011 Aug; 20(8):2378–2386. pmid:21292594
- View Article
- PubMed/NCBI
- Google Scholar
13. Qian J, Wu D, Li L, Cheng D, Wang X. Image quality assessment based on multi-scale representation of structure. Digital Signal Processing. 2014 Oct; 33:125–133.
- View Article
- Google Scholar
14. Zhou F, Lu Z, Wang C, Sun W, Xia ST, Liao Q. Image quality assessment based on inter-patch and intra-patch similarity. PloS one. 2015 Mar; 10(3):e0116312. pmid:25793282
- View Article
- PubMed/NCBI
- Google Scholar
15. Yuan H, Kwong S, Wang X, Zhang Y, Li F. A virtual view PSNR estimation method for 3-D videos. IEEE Transactions on Broadcasting. 2016 Mar; 62(1):134–140.
- View Article
- Google Scholar
16. Yang Y, Wang X, Liu Q, Xu ML, Wu W. User models of subjective image quality assessment of virtual viewpoint in free-viewpoint video system. Multimedia Tools and Applications. 2016 Oct; 75(20):12499–12519.
- View Article
- Google Scholar
17. Chen L, Jiang F, Zhang H, Wu S, Yu S, Xie Y. Edge preservation ratio for image sharpness assessment. IEEE World Congress on Intelligent Control and Automation. 2016 Jun; 1:1377–1381.
18. Wang Z, Bovik AC. Reduced- and no-reference image quality assessment. IEEE Signal Processing Magazine. 2011 Nov; 28(6):29–40.
- View Article
- Google Scholar
19. Soundararajan R, Bovik AC. RRED indices: Reduced reference entropic differencing for image quality assessment. IEEE Transactions on Image Processing. 2012 Feb; 21(2):517–526. pmid:21878414
- View Article
- PubMed/NCBI
- Google Scholar
20. Wu J, Lin W, Shi G. Reduced-reference image quality assessment with visual information fidelity. IEEE Transactions on Multimedia. 2013 Feb; 15(7):1700–1705.
- View Article
- Google Scholar
21. Wang X, Liu Q, Wang R, Chen Z. Ratural image statistics based 3D reduced reference image quality assessment in Contourlet domain. Neurocomputing. 2015 Mar; 151(2):683–691.
- View Article
- Google Scholar
22. Ma L, Wang X, Liu Q, Ngan KN. Reorganized DCT-based image representation for reduced reference stereoscopic image quality assessment. Neurocomputing. 2016 Nov; 215:21–31.
- View Article
- Google Scholar
23. Moorthy AK, Bovik AC. Blind image quality assessment: From natural scene statistics to perceptual quality. IEEE transactions on Image Processing. 2011 Dec; 20(12): 3350–3364. pmid:21521667
- View Article
- PubMed/NCBI
- Google Scholar
24. Saad MA, Bovik AC, Charrier C. Blind image quality assessment: A natural scene statistics approach in the DCT domain. IEEE transactions on Image Processing. 2012 Aug; 21(8): 3339–3352. pmid:22453635
- View Article
- PubMed/NCBI
- Google Scholar
25. Mittal A, Moorthy AK, Bovik AC. No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing. 2012 Dec; 21(12): 4695–4708. pmid:22910118
- View Article
- PubMed/NCBI
- Google Scholar
26. Gao F, Tao D, Gao X, Li X. Learning to rank for blind image quality assessment. IEEE Transactions on Neural Networks and Learning Systems. 2015 Oct; 26(10): 2275–2290. pmid:25616080
- View Article
- PubMed/NCBI
- Google Scholar
27. Zhang L, Zhang L, Bovik AC. A feature-enriched completely blind image quality evaluator. IEEE Transactions on Image Processing. 2015 Aug; 24(8): 2579–2591. pmid:25915960
- View Article
- PubMed/NCBI
- Google Scholar
28. Wu Q, Li H, Meng F, Ngan KN, Zhu S. No reference image quality assessment metric via multi-domain structural information and piecewise regression. Journal of Visual Communication and Image Representation. 2015 Oct; 32: 205–216.
- View Article
- Google Scholar
29. Gu K, Zhai G, Yang X, Zhang W. Using free energy principle for blind image quality assessment. IEEE Transactions on Multimedia. 2015 Jan; 17(1): 50–63.
- View Article
- Google Scholar
30. Wu Q, Li H, Meng F, Ngan KN, Luo B, Huang C, et al. Blind image quality assessment based on multichannel feature fusion and label transfer. IEEE Transactions on Circuits and Systems for Video Technology. 2016 Mar; 26(3): 425–440.
- View Article
- Google Scholar
31. Li L, Zhou Y, Lin W, Wu J, Zhang X, Chen B. No-reference quality assessment of deblocked images. Neurocomputing. 2016 Feb; 177: 572–584.
- View Article
- Google Scholar
32. Gu K, Zhai G, Lin W, Liu M. The analysis of image contrast: From quality assessment to automatic enhancement. IEEE Transactions on Cybernetics. 2016 Jan; 46(1): 284–297. pmid:25775503
- View Article
- PubMed/NCBI
- Google Scholar
33. Zhang C, Pan J, Chen S, Wang T, Sun D. No reference image quality assessment using sparse feature representation in two dimensions spatial correlation. Neurocomputing. 2016 Jan; 173: 462–470.
- View Article
- Google Scholar
34. Wang S, Deng C, Lin W, Huang G, Zhao B. NMF-based image quality assessment using extreme learning machine. IEEE Transactions on Cybernetics. 2017 Jan; 47(1): 232–243. pmid:26863686
- View Article
- PubMed/NCBI
- Google Scholar
35. Ferzli R, Karam LJ. A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB). IEEE Transactions on Image Processing. 2009 Aug; 18(4):717–728. pmid:19278916
- View Article
- PubMed/NCBI
- Google Scholar
36. Narvekar ND, Karam LJ. A no-reference image blur metric based on the cumulative probability of blur detection (CPBD). IEEE Transactions on Image Processing. 2011 Sep; 20(9):2678–2683. pmid:21447451
- View Article
- PubMed/NCBI
- Google Scholar
37. Ciancio A, da Costa ALANT, da Silva EAB, Said A, Samadani R, Obrador P. No-reference blur assessment of digital pictures based on multifeature classifiers. IEEE Transactions on Image Processing. 2011 Jan; 20(1):64–75. pmid:21172744
- View Article
- PubMed/NCBI
- Google Scholar
38. Vu CT, Phan TD, Chandler DM. S3: A spectral and spatial measure of local perceived sharpness in natural images. IEEE Transactions on Image Processing. 2012 Jan; 21(3):934–945. pmid:21965207
- View Article
- PubMed/NCBI
- Google Scholar
39. Vu PV, Chandler DM. A fast wavelet-based algorithm for global and local image sharpness estimation. IEEE Signal Processing Letters. 2012 Jul; 19(7):423–426.
- View Article
- Google Scholar
40. Hassen R, Wang Z, Salama MM. Image sharpness assessment based on local phase coherence. IEEE Transactions on Image Processing. 2013 Jul; 22(7):2798–2810. pmid:23481852
- View Article
- PubMed/NCBI
- Google Scholar
41. Sang QB, Wu XJ, Li CF, Lu Y. Blind image blur assessment using singular value similarity and blur comparisons. PloS one. 2014 Sep; 9(9): e108073. pmid:25247555
- View Article
- PubMed/NCBI
- Google Scholar
42. Sang Q, Qi H, Wu X, Li C, Bovik AC. No-reference image blur index based on singular value curve. Journal of Visual Communication and Image Representation. 2014 Oct; 25(7):1625–1630.
- View Article
- Google Scholar
43. Bahrami K, Kot AC. A fast approach for no-reference image sharpness assessment based on maximum local variation. IEEE Signal Processing Letters. 2014 Jun; 21(6):751–755.
- View Article
- Google Scholar
44. Li L, Wu D, Wu J, Li H, Lin W, Kot AC. Image sharpness assessment by sparse representation. IEEE Transactions on Multimedia. 2016 Jun; 18(6):1085–1097.
- View Article
- Google Scholar
45. Gu K, Zhai G, Lin W, Yang X, Zgabg W. No-reference image sharpness assessment in autoregressive parameter space. IEEE Transactions on Image Processing. 2015 Oct; 24(10):3218–3231. pmid:26054063
- View Article
- PubMed/NCBI
- Google Scholar
46. Li L, Lin W, Wang X, Yang G, Bahrami K, Kot AC. No-reference image blur assessment based on discrete orthogonal moments. IEEE Transactions on Cybernetics. 2016 Jan; 46(1):39–50. pmid:25647763
- View Article
- PubMed/NCBI
- Google Scholar
47. Bengio Y, Courville A, Vincent P. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013 Aug; 35(8): 1798–1828. pmid:23787338
- View Article
- PubMed/NCBI
- Google Scholar
48. LeCun Y, Bengio Y, Hinton GE. Deep learning. Nature. 2015 May; 521:436–444. pmid:26017442
- View Article
- PubMed/NCBI
- Google Scholar
49. Li Y, Po L, Xu X, Feng L, Yuan F, Cheung C, et al. No-reference image quality assessment with shearlet transform and deep neural networks. Neurocomputing. 2015 Apr; 154: 94–109.
- View Article
- Google Scholar
50. Hou W, Gao X. Saliency-guided deep framework for image quality assessment. IEEE Multimedia. 2015 Jul; 22(2): 46–55.
- View Article
- Google Scholar
51. Li J, Zou L, Yan J, Deng D, Qu T, Xie G. No-reference image quality assessment using Prewitt magnitude based on convolutional neural networks. Signal, Image and Video Processing. 2016 Apr; 10(4): 609–616.
- View Article
- Google Scholar
52. Lv Y, Jiang G, Yu M, Xu H, Shao F, Liu S. Difference of Gaussian statistical features based blind image quality assessment: A deep learning approach. IEEE Conference on Image Processing. 2015 Sep; 1: 2344–2348.
53. Hou W, Gao X, Tao D, Li X. Blind image quality assessment via deep learning. IEEE Transactions on Neural Networks and Learning Systems. 2015 Aug; 26(6): 1275–1286. pmid:25122842
- View Article
- PubMed/NCBI
- Google Scholar
54. Yu S, Jiang F, Li L, Xie Y. CNN-GRNN for image sharpness assessment. Asian Conference on Computer Vision. 2016 Oct; 1: 50–61.
55. Kang L, Ye P, Li Y, Doermann D. Convolutional neural networks for no-reference image quality assessment. IEEE Conference on Computer Vision and Pattern Recognition. 2014 Jun; 1: 1733–1740.
56. Specht DF. A general regression neural network. IEEE Transactions on Neural Networks. 1991 Nov; 2(6):568–576. pmid:18282872
- View Article
- PubMed/NCBI
- Google Scholar
57. Basak D, Pal S, Patranabis DC. Support vector regression. Neural Information Processing—Letters and Reviews. 2007 Oct; 11(10): 203–224.
- View Article
- Google Scholar
58. Ruderman DL. The statistics of natural images. Network: Computation in Neural Systems. 1994 Jul; 5(4): 517–548.
- View Article
- Google Scholar
59. Chang CC, Lin CJ. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology. 2011 Apr; 2(3): 27.
- View Article
- Google Scholar
60. Narwaria M, Lin W. Objective image quality assessment based on support vector regression. IEEE Transactions on Neural Networks. 2010 Mar; 21(3):515–519. pmid:20100674
- View Article
- PubMed/NCBI
- Google Scholar
61. Larson EC, Chandler DM. Most apparent distortion: Full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging. 2010 Jul; 19(1): 11006.
- View Article
- Google Scholar
62. Ponomarenko N, Lukin V, Zelensky A, Egiazarian K, Astola J, Carli M, et al. TID2008—A database for evaluation of full-reference visual quality assessment metrics. Advances of Modern Radioelectronics. 2009 Apr; 10(4): 30–45.
- View Article
- Google Scholar
63. Ponomarenko N, Jin J, Ieremeiev O, Lukin V, Egiazarian K, Astola J, et al. Image database TID2013: Peculiarities, results and perspectives. Signal Processing: Image Communication. 2015 Jan; 20: 57–77.
- View Article
- Google Scholar
64. Solomon SG, Lennie P. The machinery of colour vision. Nature Reviews Neuroscience. 2007 Apr; 8(4): 276–286. pmid:17375040
- View Article
- PubMed/NCBI
- Google Scholar
65. Van De Sande K, Gevers T, Snoek C. Evaluating color descriptors for object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2010 Sep; 32(9): 1582–1596. pmid:20634554
- View Article
- PubMed/NCBI
- Google Scholar
66. Virtanen T, Nuutinen M, Vaahteranoksa M, Oittinen P, Hakkinen J. CID2013: A database for evaluating no-reference image quality assessment algorithms. IEEE Transactions on Image Processing. 2015 Jan; 24(1): 390–402. pmid:25494511
- View Article
- PubMed/NCBI
- Google Scholar
67. Li L, Xia W, Lin W, Fang Y, Wang S. No-reference and robust image sharpness evaluation based on multi-scale spatial and spectral features. IEEE Transactions on Multimedia. 2016 Dec.
- View Article
- Google Scholar
68. Chow LS, Rajagopal H, Paramesran R, Alzheimer’s Disease Neuroimaging Initiative. Correlation between subjective and objective assessment of magnetic resonance (MR) images. Magnetic Resonance Imaging. 2016 Jul; 34(6): 820–831. pmid:26969762
- View Article
- PubMed/NCBI
- Google Scholar

[ref1] 1. Lin W, Kuo CCJ. Perceptual visual quality metrics: A survey. Journal of Visual Communication and Image Representation. 2011 Jan; 22(4): 297–312.
View Article
Google Scholar

[2] View Article

[3] Google Scholar

[ref2] 2. Manap RA, Shao L. Non-distortion-specific no-reference image quality assessment: A survey. Information Sciences. 2015 Dec; 301(1): 141–160.
View Article
Google Scholar

[5] View Article

[6] Google Scholar

[ref3] 3. Gao X, Gao F, Tao D, Li X. Universal blind image quality assessment metrics via natural scene statistics and multiple kernel learning. IEEE Transactions on Neural Networks and Learning Systems. 2013 Jul; 24(12): 2013–2026. pmid:24805219
View Article
PubMed/NCBI
Google Scholar

[8] View Article

[9] PubMed/NCBI

[10] Google Scholar

[ref4] 4. Li L, Lin W, Zhu H. Learning structural regularity for evaluating blocking artifacts in JPEG images. IEEE Signal Processing Letters. 2014 Aug; 21(8): 918–922.
View Article
Google Scholar

[12] View Article

[13] Google Scholar

[ref5] 5. Xue W, Mou X, Zhang L, Bovik AC, Feng X. Blind image quality assessment using joint statistics of gradient magnitude and Laplacian features. IEEE Transactions on Image Processing. 2014 Nov; 23(11): 4850–4862. pmid:25216482
View Article
PubMed/NCBI
Google Scholar

[15] View Article

[16] PubMed/NCBI

[17] Google Scholar

[ref6] 6. Li L, Zhu H, Yang G, Qian J. Referenceless measure of blocking artifacts by Tchebichef kernel analysis. IEEE Signal Processing Letters. 2014 Jan; 21(1): 122–125.
View Article
Google Scholar

[19] View Article

[20] Google Scholar

[ref7] 7. Wu Q, Wang Z, Li H. A highly efficient method for blind image quality assessment. IEEE Conference on Image Processing. 2015 Sep; 1: 339–343.

[ref8] 8. Oszust M. Full-reference image quality assessment with linear combination of genetically selected quality measures. PloS one. 2016 Jun; 11(6):e0158333. pmid:27341493
View Article
PubMed/NCBI
Google Scholar

[23] View Article

[24] PubMed/NCBI

[25] Google Scholar

[ref9] 9. Gu K, Li L, Lu H, Min X, Lin W. A fast computational metric for perceptual image quality assessment. IEEE Transactions on Industrial Electronics. 2017 Jan.
View Article
Google Scholar

[27] View Article

[28] Google Scholar

[ref10] 10. Sheikh HR, Sabir MF, Bovik AC. A statistical evaluation of recent full reference image quality assessment algorithms. IEEE Transactions on Image Processing. 2006 Nov; 15(11):3440–3451. pmid:17076403
View Article
PubMed/NCBI
Google Scholar

[30] View Article

[31] PubMed/NCBI

[32] Google Scholar

[ref11] 11. Wang Z, Bovik AC, Sheikh HR, Simoncelli EP. Image quality assessment: From error visibility to structural similarity. IEEE Transactions on Image Processing. 2004 Apr; 13(4):600–612. pmid:15376593
View Article
PubMed/NCBI
Google Scholar

[34] View Article

[35] PubMed/NCBI

[36] Google Scholar

[ref12] 12. Zhang L, Zhang L, Mou X, Zhang D. FSIM: A feature similarity index for image quality assessment. IEEE Transactions on Image Processing. 2011 Aug; 20(8):2378–2386. pmid:21292594
View Article
PubMed/NCBI
Google Scholar

[38] View Article

[39] PubMed/NCBI

[40] Google Scholar

[ref13] 13. Qian J, Wu D, Li L, Cheng D, Wang X. Image quality assessment based on multi-scale representation of structure. Digital Signal Processing. 2014 Oct; 33:125–133.
View Article
Google Scholar

[42] View Article

[43] Google Scholar

[ref14] 14. Zhou F, Lu Z, Wang C, Sun W, Xia ST, Liao Q. Image quality assessment based on inter-patch and intra-patch similarity. PloS one. 2015 Mar; 10(3):e0116312. pmid:25793282
View Article
PubMed/NCBI
Google Scholar

[45] View Article

[46] PubMed/NCBI

[47] Google Scholar

[ref15] 15. Yuan H, Kwong S, Wang X, Zhang Y, Li F. A virtual view PSNR estimation method for 3-D videos. IEEE Transactions on Broadcasting. 2016 Mar; 62(1):134–140.
View Article
Google Scholar

[49] View Article

[50] Google Scholar

[ref16] 16. Yang Y, Wang X, Liu Q, Xu ML, Wu W. User models of subjective image quality assessment of virtual viewpoint in free-viewpoint video system. Multimedia Tools and Applications. 2016 Oct; 75(20):12499–12519.
View Article
Google Scholar

[52] View Article

[53] Google Scholar

[ref17] 17. Chen L, Jiang F, Zhang H, Wu S, Yu S, Xie Y. Edge preservation ratio for image sharpness assessment. IEEE World Congress on Intelligent Control and Automation. 2016 Jun; 1:1377–1381.

[ref18] 18. Wang Z, Bovik AC. Reduced- and no-reference image quality assessment. IEEE Signal Processing Magazine. 2011 Nov; 28(6):29–40.
View Article
Google Scholar

[56] View Article

[57] Google Scholar

[ref19] 19. Soundararajan R, Bovik AC. RRED indices: Reduced reference entropic differencing for image quality assessment. IEEE Transactions on Image Processing. 2012 Feb; 21(2):517–526. pmid:21878414
View Article
PubMed/NCBI
Google Scholar

[59] View Article

[60] PubMed/NCBI

[61] Google Scholar

[ref20] 20. Wu J, Lin W, Shi G. Reduced-reference image quality assessment with visual information fidelity. IEEE Transactions on Multimedia. 2013 Feb; 15(7):1700–1705.
View Article
Google Scholar

[63] View Article

[64] Google Scholar

[ref21] 21. Wang X, Liu Q, Wang R, Chen Z. Ratural image statistics based 3D reduced reference image quality assessment in Contourlet domain. Neurocomputing. 2015 Mar; 151(2):683–691.
View Article
Google Scholar

[66] View Article

[67] Google Scholar

[ref22] 22. Ma L, Wang X, Liu Q, Ngan KN. Reorganized DCT-based image representation for reduced reference stereoscopic image quality assessment. Neurocomputing. 2016 Nov; 215:21–31.
View Article
Google Scholar

[69] View Article

[70] Google Scholar

[ref23] 23. Moorthy AK, Bovik AC. Blind image quality assessment: From natural scene statistics to perceptual quality. IEEE transactions on Image Processing. 2011 Dec; 20(12): 3350–3364. pmid:21521667
View Article
PubMed/NCBI
Google Scholar

[72] View Article

[73] PubMed/NCBI

[74] Google Scholar

[ref24] 24. Saad MA, Bovik AC, Charrier C. Blind image quality assessment: A natural scene statistics approach in the DCT domain. IEEE transactions on Image Processing. 2012 Aug; 21(8): 3339–3352. pmid:22453635
View Article
PubMed/NCBI
Google Scholar

[76] View Article

[77] PubMed/NCBI

[78] Google Scholar

[ref25] 25. Mittal A, Moorthy AK, Bovik AC. No-reference image quality assessment in the spatial domain. IEEE Transactions on Image Processing. 2012 Dec; 21(12): 4695–4708. pmid:22910118
View Article
PubMed/NCBI
Google Scholar

[80] View Article

[81] PubMed/NCBI

[82] Google Scholar

[ref26] 26. Gao F, Tao D, Gao X, Li X. Learning to rank for blind image quality assessment. IEEE Transactions on Neural Networks and Learning Systems. 2015 Oct; 26(10): 2275–2290. pmid:25616080
View Article
PubMed/NCBI
Google Scholar

[84] View Article

[85] PubMed/NCBI

[86] Google Scholar

[ref27] 27. Zhang L, Zhang L, Bovik AC. A feature-enriched completely blind image quality evaluator. IEEE Transactions on Image Processing. 2015 Aug; 24(8): 2579–2591. pmid:25915960
View Article
PubMed/NCBI
Google Scholar

[88] View Article

[89] PubMed/NCBI

[90] Google Scholar

[ref28] 28. Wu Q, Li H, Meng F, Ngan KN, Zhu S. No reference image quality assessment metric via multi-domain structural information and piecewise regression. Journal of Visual Communication and Image Representation. 2015 Oct; 32: 205–216.
View Article
Google Scholar

[92] View Article

[93] Google Scholar

[ref29] 29. Gu K, Zhai G, Yang X, Zhang W. Using free energy principle for blind image quality assessment. IEEE Transactions on Multimedia. 2015 Jan; 17(1): 50–63.
View Article
Google Scholar

[95] View Article

[96] Google Scholar

[ref30] 30. Wu Q, Li H, Meng F, Ngan KN, Luo B, Huang C, et al. Blind image quality assessment based on multichannel feature fusion and label transfer. IEEE Transactions on Circuits and Systems for Video Technology. 2016 Mar; 26(3): 425–440.
View Article
Google Scholar

[98] View Article

[99] Google Scholar

[ref31] 31. Li L, Zhou Y, Lin W, Wu J, Zhang X, Chen B. No-reference quality assessment of deblocked images. Neurocomputing. 2016 Feb; 177: 572–584.
View Article
Google Scholar

[101] View Article

[102] Google Scholar

[ref32] 32. Gu K, Zhai G, Lin W, Liu M. The analysis of image contrast: From quality assessment to automatic enhancement. IEEE Transactions on Cybernetics. 2016 Jan; 46(1): 284–297. pmid:25775503
View Article
PubMed/NCBI
Google Scholar

[104] View Article

[105] PubMed/NCBI

[106] Google Scholar

[ref33] 33. Zhang C, Pan J, Chen S, Wang T, Sun D. No reference image quality assessment using sparse feature representation in two dimensions spatial correlation. Neurocomputing. 2016 Jan; 173: 462–470.
View Article
Google Scholar

[108] View Article

[109] Google Scholar

[ref34] 34. Wang S, Deng C, Lin W, Huang G, Zhao B. NMF-based image quality assessment using extreme learning machine. IEEE Transactions on Cybernetics. 2017 Jan; 47(1): 232–243. pmid:26863686
View Article
PubMed/NCBI
Google Scholar

[111] View Article

[112] PubMed/NCBI

[113] Google Scholar

[ref35] 35. Ferzli R, Karam LJ. A no-reference objective image sharpness metric based on the notion of just noticeable blur (JNB). IEEE Transactions on Image Processing. 2009 Aug; 18(4):717–728. pmid:19278916
View Article
PubMed/NCBI
Google Scholar

[115] View Article

[116] PubMed/NCBI

[117] Google Scholar

[ref36] 36. Narvekar ND, Karam LJ. A no-reference image blur metric based on the cumulative probability of blur detection (CPBD). IEEE Transactions on Image Processing. 2011 Sep; 20(9):2678–2683. pmid:21447451
View Article
PubMed/NCBI
Google Scholar

[119] View Article

[120] PubMed/NCBI

[121] Google Scholar

[ref37] 37. Ciancio A, da Costa ALANT, da Silva EAB, Said A, Samadani R, Obrador P. No-reference blur assessment of digital pictures based on multifeature classifiers. IEEE Transactions on Image Processing. 2011 Jan; 20(1):64–75. pmid:21172744
View Article
PubMed/NCBI
Google Scholar

[123] View Article

[124] PubMed/NCBI

[125] Google Scholar

[ref38] 38. Vu CT, Phan TD, Chandler DM. S3: A spectral and spatial measure of local perceived sharpness in natural images. IEEE Transactions on Image Processing. 2012 Jan; 21(3):934–945. pmid:21965207
View Article
PubMed/NCBI
Google Scholar

[127] View Article

[128] PubMed/NCBI

[129] Google Scholar

[ref39] 39. Vu PV, Chandler DM. A fast wavelet-based algorithm for global and local image sharpness estimation. IEEE Signal Processing Letters. 2012 Jul; 19(7):423–426.
View Article
Google Scholar

[131] View Article

[132] Google Scholar

[ref40] 40. Hassen R, Wang Z, Salama MM. Image sharpness assessment based on local phase coherence. IEEE Transactions on Image Processing. 2013 Jul; 22(7):2798–2810. pmid:23481852
View Article
PubMed/NCBI
Google Scholar

[134] View Article

[135] PubMed/NCBI

[136] Google Scholar

[ref41] 41. Sang QB, Wu XJ, Li CF, Lu Y. Blind image blur assessment using singular value similarity and blur comparisons. PloS one. 2014 Sep; 9(9): e108073. pmid:25247555
View Article
PubMed/NCBI
Google Scholar

[138] View Article

[139] PubMed/NCBI

[140] Google Scholar

[ref42] 42. Sang Q, Qi H, Wu X, Li C, Bovik AC. No-reference image blur index based on singular value curve. Journal of Visual Communication and Image Representation. 2014 Oct; 25(7):1625–1630.
View Article
Google Scholar

[142] View Article

[143] Google Scholar

[ref43] 43. Bahrami K, Kot AC. A fast approach for no-reference image sharpness assessment based on maximum local variation. IEEE Signal Processing Letters. 2014 Jun; 21(6):751–755.
View Article
Google Scholar

[145] View Article

[146] Google Scholar

[ref44] 44. Li L, Wu D, Wu J, Li H, Lin W, Kot AC. Image sharpness assessment by sparse representation. IEEE Transactions on Multimedia. 2016 Jun; 18(6):1085–1097.
View Article
Google Scholar

[148] View Article

[149] Google Scholar

[ref45] 45. Gu K, Zhai G, Lin W, Yang X, Zgabg W. No-reference image sharpness assessment in autoregressive parameter space. IEEE Transactions on Image Processing. 2015 Oct; 24(10):3218–3231. pmid:26054063
View Article
PubMed/NCBI
Google Scholar

[151] View Article

[152] PubMed/NCBI

[153] Google Scholar

[ref46] 46. Li L, Lin W, Wang X, Yang G, Bahrami K, Kot AC. No-reference image blur assessment based on discrete orthogonal moments. IEEE Transactions on Cybernetics. 2016 Jan; 46(1):39–50. pmid:25647763
View Article
PubMed/NCBI
Google Scholar

[155] View Article

[156] PubMed/NCBI

[157] Google Scholar

[ref47] 47. Bengio Y, Courville A, Vincent P. Representation learning: A review and new perspectives. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2013 Aug; 35(8): 1798–1828. pmid:23787338
View Article
PubMed/NCBI
Google Scholar

[159] View Article

[160] PubMed/NCBI

[161] Google Scholar

[ref48] 48. LeCun Y, Bengio Y, Hinton GE. Deep learning. Nature. 2015 May; 521:436–444. pmid:26017442
View Article
PubMed/NCBI
Google Scholar

[163] View Article

[164] PubMed/NCBI

[165] Google Scholar

[ref49] 49. Li Y, Po L, Xu X, Feng L, Yuan F, Cheung C, et al. No-reference image quality assessment with shearlet transform and deep neural networks. Neurocomputing. 2015 Apr; 154: 94–109.
View Article
Google Scholar

[167] View Article

[168] Google Scholar

[ref50] 50. Hou W, Gao X. Saliency-guided deep framework for image quality assessment. IEEE Multimedia. 2015 Jul; 22(2): 46–55.
View Article
Google Scholar

[170] View Article

[171] Google Scholar

[ref51] 51. Li J, Zou L, Yan J, Deng D, Qu T, Xie G. No-reference image quality assessment using Prewitt magnitude based on convolutional neural networks. Signal, Image and Video Processing. 2016 Apr; 10(4): 609–616.
View Article
Google Scholar

[173] View Article

[174] Google Scholar

[ref52] 52. Lv Y, Jiang G, Yu M, Xu H, Shao F, Liu S. Difference of Gaussian statistical features based blind image quality assessment: A deep learning approach. IEEE Conference on Image Processing. 2015 Sep; 1: 2344–2348.

[ref53] 53. Hou W, Gao X, Tao D, Li X. Blind image quality assessment via deep learning. IEEE Transactions on Neural Networks and Learning Systems. 2015 Aug; 26(6): 1275–1286. pmid:25122842
View Article
PubMed/NCBI
Google Scholar

[177] View Article

[178] PubMed/NCBI

[179] Google Scholar

[ref54] 54. Yu S, Jiang F, Li L, Xie Y. CNN-GRNN for image sharpness assessment. Asian Conference on Computer Vision. 2016 Oct; 1: 50–61.

[ref55] 55. Kang L, Ye P, Li Y, Doermann D. Convolutional neural networks for no-reference image quality assessment. IEEE Conference on Computer Vision and Pattern Recognition. 2014 Jun; 1: 1733–1740.

[ref56] 56. Specht DF. A general regression neural network. IEEE Transactions on Neural Networks. 1991 Nov; 2(6):568–576. pmid:18282872
View Article
PubMed/NCBI
Google Scholar

[183] View Article

[184] PubMed/NCBI

[185] Google Scholar

[ref57] 57. Basak D, Pal S, Patranabis DC. Support vector regression. Neural Information Processing—Letters and Reviews. 2007 Oct; 11(10): 203–224.
View Article
Google Scholar

[187] View Article

[188] Google Scholar

[ref58] 58. Ruderman DL. The statistics of natural images. Network: Computation in Neural Systems. 1994 Jul; 5(4): 517–548.
View Article
Google Scholar

[190] View Article

[191] Google Scholar

[ref59] 59. Chang CC, Lin CJ. LIBSVM: A library for support vector machines. ACM Transactions on Intelligent Systems and Technology. 2011 Apr; 2(3): 27.
View Article
Google Scholar

[193] View Article

[194] Google Scholar

[ref60] 60. Narwaria M, Lin W. Objective image quality assessment based on support vector regression. IEEE Transactions on Neural Networks. 2010 Mar; 21(3):515–519. pmid:20100674
View Article
PubMed/NCBI
Google Scholar

[196] View Article

[197] PubMed/NCBI

[198] Google Scholar

[ref61] 61. Larson EC, Chandler DM. Most apparent distortion: Full-reference image quality assessment and the role of strategy. Journal of Electronic Imaging. 2010 Jul; 19(1): 11006.
View Article
Google Scholar

[200] View Article

[201] Google Scholar

[ref62] 62. Ponomarenko N, Lukin V, Zelensky A, Egiazarian K, Astola J, Carli M, et al. TID2008—A database for evaluation of full-reference visual quality assessment metrics. Advances of Modern Radioelectronics. 2009 Apr; 10(4): 30–45.
View Article
Google Scholar

[203] View Article

[204] Google Scholar

[ref63] 63. Ponomarenko N, Jin J, Ieremeiev O, Lukin V, Egiazarian K, Astola J, et al. Image database TID2013: Peculiarities, results and perspectives. Signal Processing: Image Communication. 2015 Jan; 20: 57–77.
View Article
Google Scholar

[206] View Article

[207] Google Scholar

[ref64] 64. Solomon SG, Lennie P. The machinery of colour vision. Nature Reviews Neuroscience. 2007 Apr; 8(4): 276–286. pmid:17375040
View Article
PubMed/NCBI
Google Scholar

[209] View Article

[210] PubMed/NCBI

[211] Google Scholar

[ref65] 65. Van De Sande K, Gevers T, Snoek C. Evaluating color descriptors for object and scene recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2010 Sep; 32(9): 1582–1596. pmid:20634554
View Article
PubMed/NCBI
Google Scholar

[213] View Article

[214] PubMed/NCBI

[215] Google Scholar

[ref66] 66. Virtanen T, Nuutinen M, Vaahteranoksa M, Oittinen P, Hakkinen J. CID2013: A database for evaluating no-reference image quality assessment algorithms. IEEE Transactions on Image Processing. 2015 Jan; 24(1): 390–402. pmid:25494511
View Article
PubMed/NCBI
Google Scholar

[217] View Article

[218] PubMed/NCBI

[219] Google Scholar

[ref67] 67. Li L, Xia W, Lin W, Fang Y, Wang S. No-reference and robust image sharpness evaluation based on multi-scale spatial and spectral features. IEEE Transactions on Multimedia. 2016 Dec.
View Article
Google Scholar

[221] View Article

[222] Google Scholar

[ref68] 68. Chow LS, Rajagopal H, Paramesran R, Alzheimer’s Disease Neuroimaging Initiative. Correlation between subjective and objective assessment of magnetic resonance (MR) images. Magnetic Resonance Imaging. 2016 Jul; 34(6): 820–831. pmid:26969762
View Article
PubMed/NCBI
Google Scholar

[224] View Article

[225] PubMed/NCBI

[226] Google Scholar

Figures

Abstract

Introduction

A shallow CNN

Feature extraction

Local contrast normalization.

Feature representation.

Score prediction

Multilayer perceptron (MLP).

General regression neural network (GRNN).

Support vector regression (SVR).

Network training

Experiments

Images for performance evaluation

Experiment design

Performance criteria

Software and platform

Result

Parameter tuning

Parameters in CNN.

Parameters in GRNN and SVR.

Learned CNN features

Algorithm performance

Time consumption

Effect of color information

Future work

Conclusion

Acknowledgments

Author Contributions

References