• Home
  • Search
  • PIPAL: A Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration
  • Open Access IconOpen Access
  • Cite Icon146
  • https://doi.org/10.1007/978-3-030-58621-8_37Copy DOI Icon

PIPAL: A Large-Scale Image Quality Assessment Dataset for Perceptual Image Restoration

  • Jan 1, 2020
  • Gu Jinjin +5 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Image quality assessment (IQA) is the key factor for the fast development of image restoration (IR) algorithms. The most recent IR methods based on Generative Adversarial Networks (GANs) have achieved significant improvement in visual performance, but also presented great challenges for quantitative evaluation. Notably, we observe an increasing inconsistency between perceptual quality and the evaluation results. Then we raise two questions: (1) Can existing IQA methods objectively evaluate recent IR algorithms? (2) When focus on beating current benchmarks, are we getting better IR algorithms? To answer these questions and promote the development of IQA methods, we contribute a large-scale IQA dataset, called Perceptual Image Processing Algorithms (PIPAL) dataset. Especially, this dataset includes the results of GAN-based methods, which are missing in previous datasets. We collect more than 1.13 million human judgments to assign subjective scores for PIPAL images using the more reliable Elo system. Based on PIPAL, we present new benchmarks for both IQA and super-resolution methods. Our results indicate that existing IQA methods cannot fairly evaluate GAN-based IR algorithms. While using appropriate evaluation methods is important, IQA methods should also be updated along with the development of IR algorithms. At last, we improve the performance of IQA networks on GAN-based distortions by introducing anti-aliasing pooling. Experiments show the effectiveness of the proposed method.

Similar Papers
  • Conference Article
  • Citations62

NTIRE 2021 Challenge on Perceptual Image Quality Assessment

  • Jun 01, 2021
  • Jinjin Gu +49
  • Research Article
  • Citations1

새로운 광적응 효과 모델을 이용한 정교한 영상 화질 측정

  • Nov 30, 2015
  • Journal of Broadcast Engineering
  • Sung-Ho Bae +1
  • Research Article
  • Citations9

Blind image quality assessment based on progressive multi-task learning

  • May 18, 2022
  • Neurocomputing
  • Aobo Li +5
  • Research Article

A Novel Weight Pooling Method for Objective Image Quality Assessment with the Luminance Adaptation Effect in the Pixel Intensity Domain

  • Sep 01, 2019
  • Journal of Imaging Science and Technology
  • Sung-Ho Bae +4
  • Research Article
  • Citations5

Objective assessment method of image quality based on visual perception of image content

  • Jan 01, 2018
  • Acta Physica Sinica
  • Yao Jun-Cai +1
  • Conference Article
  • Citations15

EGB: Image Quality Assessment based on Ensemble of Gradient Boosting

  • Jun 01, 2021
  • Dounia Hammou +2
  • Conference Article
  • Citations57

NTIRE 2022 Challenge on Perceptual Image Quality Assessment

  • Jun 01, 2022
  • Jinjin Gu +55
  • Research Article
  • Citations50

Image Quality Assessment Based on Local Linear Information and Distortion-Specific Compensation.

  • Dec 14, 2016
  • IEEE Transactions on Image Processing
  • Hanli Wang +5
  • PDF
  • Research Article
  • Citations3

An Ingenious Application-Specific Quality Assessment Methods for Compressed Wireless Capsule Endoscopy Images

  • Oct 24, 2020
  • Transactions on Environment and Electrical Engineering
  • Kinde Anlay Fante +2
  • Research Article
  • Citations5

Full-reference calibration-free image quality assessment

  • Sep 23, 2024
  • Signal Processing: Image Communication
  • Paolo Giannitrapani +2
  • PDF
  • Research Article
  • Citations4

Full-Reference Image Quality Assessment with Transformer and DISTS

  • Mar 26, 2023
  • Mathematics
  • Pei-Fen Tsai +3
  • PDF
  • Research Article
  • Citations26

On the Application LBP Texture Descriptors and Its Variants for No-Reference Image Quality Assessment

  • Oct 04, 2018
  • Journal of Imaging
  • Pedro Garcia Freitas +3
  • Conference Article

Image Quality Assessment Methods for Near-Infrared Wildfire Imagery

  • Oct 27, 2022
  • Zimbini Faniso-Mnyaka +3
  • Conference Article
  • Citations2

Non-invasive Image Quality Assessment Based on Eye-tracking

  • Dec 10, 2021
  • Hongan Wei +4
  • Book Chapter

Image Quality Assessment: A Case Study on Ultrasound Images of Supraspinatus Tendon

  • Jan 01, 2016
  • Rishu Gupta +2
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.