• Home
  • Search
  • Semi-Supervised Learning of Perceptual Video Quality by Generating Consistent Pairwise Pseudo-Ranks
  • Open Access IconOpen Access
  • Cite Icon5
  • https://doi.org/10.1109/tmm.2023.3347090Copy DOI Icon

Semi-Supervised Learning of Perceptual Video Quality by Generating Consistent Pairwise Pseudo-Ranks

Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Designing learning-based no-reference (NR) video quality assessment (VQA) algorithms for camera-captured videos is cumbersome due to the large number of human annotations of quality. In this work, we propose a semi-supervised learning (SSL) framework exploiting many unlabelled and very limited numbers of authentically distorted labelled videos. Our main contributions are twofold. Leveraging the benefits of consistency regularization and pseudo-labelling, our SSL model generates pairwise pseudo-ranks for the unlabelled videos using a student-teacher model on strong-weak augmented videos. We design the strong-weak augmentations to be quality invariant to use the unlabelled videos effectively in SSL. The generated pseudo-ranks are used along with the limited labels to train our SSL model. Our primary focus in SSL for NR VQA is to learn mapping from video feature representations to quality scores. We compare various feature extraction methods and show that our SSL framework can lead to improved performance on these features. We present a spatial and temporal feature extraction method based on predicting spatial and temporal entropic differences. We show that these features help achieve robust performance when trained with limited data, providing a better baseline to apply SSL. Extensive experiments on three popular VQA datasets demonstrate that the proposed semi-supervised VQA method improves on the performance of existing methods in terms of correlation with human opinion by approximately <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"><tex-math notation="LaTeX">$15 \! - \! 20 \%$</tex-math></inline-formula>

Similar Papers
  • Research Article
  • Citations27

Bitrate-Based No-Reference Video Quality Assessment Combining the Visual Perception of Video Contents

  • Sep 01, 2019
  • IEEE Transactions on Broadcasting
  • Juncai Yao +1
  • Conference Article
  • Citations1

No-Reference Video Quality Assessment by Multilayer Selected Deep Features and Neural Networks

  • Sep 28, 2020
  • Zheng-Lung Chu +2
  • Conference Article

No-reference video quality assessment using data dimensionality reduction and attention-based pooling

  • Oct 12, 2022
  • Zhiwei Wang +1
  • Research Article
  • Citations125

No-Reference Video Quality Assessment With 3D Shearlet Transform and Convolutional Neural Networks

  • Jun 01, 2016
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Yuming Li +6
  • Conference Article
  • Citations2

Spatiotemporal No-Reference Video Quality Assessment model on distortions based on encoding

  • Apr 01, 2013
  • E Zerman +3
  • Conference Article
  • Citations3

No-Reference Video Quality Assessment based on Convolutional Neural Network and Human Temporal Behavior

  • Nov 01, 2018
  • Sewoong Ahn +1
  • Conference Article
  • Citations1

Optimizing feature pooling and prediction models of VQA algorithms

  • Oct 01, 2014
  • Kongfeng Zhu +4
  • Conference Article
  • Citations9

No-reference video quality assessment by HEVC codec analysis

  • Dec 01, 2015
  • Xin Huang +2
  • Conference Article
  • Citations2

No-reference video quality assessment based on spatiotemporal slice images and deep convolutional neural networks

  • Nov 18, 2019
  • Peng Yan +1
  • Conference Article
  • Citations3

A parametric video quality model based on source and network characteristics

  • Oct 01, 2014
  • Emin Zerman +3
  • Conference Article
  • Citations5

No-Reference Video Quality Assessment by A Cascade Combination of Neural Networks and Regression Model

  • Oct 11, 2020
  • Zheng-Lung Chu +2
  • Conference Article

No-reference video quality assessment metric using spatiotemporal features through LSTM

  • Mar 13, 2021
  • Ngai-Wing Kwong +4
  • Research Article
  • Citations4

Deep Learning-Based Supervised and Semisupervised Segmentation of Confocal and SEM Micrographs for Microstructural Characterization of Plant Protein Gels.

  • Jan 02, 2026
  • Microscopy and microanalysis : the official journal of Microscopy Society of America, Microbeam Analysis Society, Microscopical Society of Canada
  • Zhi Yang
  • Research Article
  • Citations53

No-Reference Video Quality Assessment Using Codec Analysis

  • Oct 01, 2015
  • IEEE Transactions on Circuits and Systems for Video Technology
  • Jacob Sogaard +2
  • Research Article
  • Citations28

Self-Supervised Representation Learning for Video Quality Assessment

  • Mar 01, 2023
  • IEEE Transactions on Broadcasting
  • Shaojie Jiang +3
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.