• Home
  • Search
  • Pseudo-labeling of transfer learning convolutional neural network data for human facial emotion recognition
  • Cite Icon2
  • https://doi.org/10.15276/hait.06.2023.13Copy DOI Icon

Pseudo-labeling of transfer learning convolutional neural network data for human facial emotion recognition

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

The relevance of solving the problem of facial emotion recognition on human images in the creation of modern intelligent systems of computer vision and human-machine interaction, online learning and emotional marketing, health care and forensics, machine graphics and game intelligence is shown. Successful examples of technological solutions to the problem of facial emotion recognition using transfer learning of deep convolutional neural networks are shown. But the use of such popular datasets as DISFA, CelebA, AffectNet, for deep learning of convolutional neuralnetworks does not give good results in terms of the accuracy of emotion recognition, because almost all training sets have fundamental flaws related to errors in their creation, such as the lack of data of a certain class, imbalance of classes, subjectivity and ambiguity of labeling, insufficient amount of data for deep learning, etc. It is proposed to overcome the noted shortcomings of popular datasets for emotion recognition by adding to the training sample additional pseudo-labeled images with human emotions, on which recognition occurs with high accuracy. The aim of the research is to increase the accuracy of facial emotion recognitionon the image of a human by developing a pseudo-labeling method for transfer learning of a deep neural network. To achieve the aim, the following tasks were solved: a convolutional neural network model, previously trained on the ImageNet set using the transfer learning method, was adjusted on the RAF-DB data set to solve emotion recognition tasks; a pseudo-labeling method of the RAF−DB set data was developed for semi-supervised learning of a convolutional neural network model for the task of facial emotion recognition; the accuracy of facial emotion recognition was analyzed based on the developed convolutional neural network model and the method of pseudo-labeling of RAF-DB set data for its correction. It is shown that the use of the developed method of pseudo-labeling data and transfer learning of the MobileNet V1 convolutional neural network model allowed to increase the accuracy of facial emotion recognitionon the images of the RAF-DB dataset by 2 percent (from 76 to 78%) according to the F1 estimate. Atthe same time, taking into account the significant imbalance of the classes, for the 7 main emotions in the trainingset, we have a significant increase in the accuracy of recognizing a few representatives of such emotions as surprise (from 71 to 77%), fearful(from 64 to 69%), sad (from 72 to 76%), angrywith (from 64 to 74%), neutral(from 66 to 71%). The accuracy of recognizing the emotion of happy, which is the most common, decreased (from 91 to 86 %) Thus, it can be concluded that the use of the developed pseudo-labeling method gives good results in overcoming such shortcomings of datasets for deep learning of convolutional neural networks such as lack of data of a certain type, imbalance of classes, insufficient amount of data for deep learning, etc.

Loading PDF

Similar Papers
  • Research Article
  • Citations32

A deep learning framework for automatic detection of arbitrarily shaped fiducial markers in intrafraction fluoroscopic images.

  • Apr 15, 2019
  • Medical Physics
  • Adam Mylonas +6
  • Research Article
  • Citations3

Multimodal Human Facial Emotion Recognition Using DenseNet-161 and Image Feature Stabilization Algorithm

  • Dec 31, 2022
  • Traitement du Signal
  • Angeline R +1
  • Research Article
  • Citations326

Development of Efficient CNN model for Tomato crop disease identification

  • Jul 04, 2020
  • Sustainable Computing: Informatics and Systems
  • Mohit Agarwal +2
  • Research Article
  • Citations8

Deep learning technology of convolutional neural networks for facial expression recognition

  • Jun 30, 2021
  • Applied Aspects of Information Technology
  • Denys V Petrosiuk +3
  • Dissertation

Enhancing Robustness of CNN Model for Malware Detection using GAN-Based Data Augmentation and Transfer Learning

  • Jan 01, 2025
  • Milind Anand Pathak
  • Research Article
  • Citations3

Indonesian Fake News Classification Using Transfer Learning in CNN and LSTM

  • Sep 30, 2024
  • JOIV : International Journal on Informatics Visualization
  • Tohpatti Crippa Praha +2
  • PDF
  • Research Article
  • Citations322

Facial Emotion Recognition Using Transfer Learning in the Deep CNN

  • Apr 27, 2021
  • Electronics
  • M A H Akhand +4
  • Book Chapter
  • Citations1

Theory, Practical Concepts, Strategies and Methods for Emotion Recognition

  • Feb 11, 2022
  • Varsha Kiran Patil +5
  • Conference Article
  • Citations16

Progress and Challenges in Deep Learning Analysis of Geoscience Images

  • Jan 01, 2019
  • R Pires De Lima +3
  • Research Article
  • Citations5

Comparative analysis between convolutional neural network learned and engineered features: A case study on cardiac arrhythmia detection

  • Jul 01, 2020
  • Cardiovascular Digital Health Journal
  • Ruhi Mahajan +2
  • Conference Article
  • Citations6

Non-deep CNN for multi-modal image classification and feature learning: An Azure-based model

  • Dec 01, 2016
  • Sohini Roychowdhury +1
  • PDF
  • Research Article
  • Citations55

Comparisons of Convolutional Neural Network and Other Machine Learning Methods in Landslide Susceptibility Assessment: A Case Study in Pingwu

  • Jan 31, 2023
  • Remote Sensing
  • Ziyu Jiang +2
  • Research Article
  • Citations1

Optimizer Comparison In Convolutional Neural Network For Real Time Face Recognition

  • Jan 31, 2025
  • Engineering, MAthematics and Computer Science Journal (EMACS)
  • Elbert Elbert +2
  • PDF
  • Research Article
  • Citations144

An Investigation of Deep Learning Models for EEG-Based Emotion Recognition

  • Dec 23, 2020
  • Frontiers in Neuroscience
  • Yaqing Zhang +9
  • Conference Article
  • Citations41

End-to-End Driving Activities and Secondary Tasks Recognition Using Deep Convolutional Neural Network and Transfer Learning

  • Jun 01, 2018
  • Yang Xing +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.