• Home
  • Search
  • Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention
  • Cite Icon14
  • https://doi.org/10.3390/app14156471Copy DOI Icon

Facial Expression Recognition Based on Vision Transformer with Hybrid Local Attention

Show More
  • Abstract
  • Highlights & Summary
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Facial expression recognition has wide application prospects in many occasions. Due to the complexity and variability of facial expressions, facial expression recognition has become a very challenging research topic. This paper proposes a Vision Transformer expression recognition method based on hybrid local attention (HLA-ViT). The network adopts a dual-stream structure. One stream extracts the hybrid local features and the other stream extracts the global contextual features. These two streams constitute a global–local fusion attention. The hybrid local attention module is proposed to enhance the network’s robustness to face occlusion and head pose variations. The convolutional neural network is combined with the hybrid local attention module to obtain feature maps with local prominent information. Robust features are then captured by the ViT from the global perspective of the visual sequence context. Finally, the decision-level fusion mechanism fuses the expression features with local prominent information, adding complementary information to enhance the network’s recognition performance and robustness against interference factors such as occlusion and head posture changes in natural scenes. Extensive experiments demonstrate that our HLA-ViT network achieves an excellent performance with 90.45% on RAF-DB, 90.13% on FERPlus, and 65.07% on AffectNet.

Loading PDF

Similar Papers
  • Research Article
  • Citations17

Adults with a history of childhood maltreatment with and without mental disorders show alterations in the recognition of facial expressions

  • Jun 15, 2023
  • European Journal of Psychotraumatology
  • Lara-Lynn Hautle +7
  • Research Article

Facial Expression Localization and Recognition Using MDMO and Transformer for Mental Health Diagnosis Support

  • Feb 21, 2026
  • Informatica
  • Yan Yan +1
  • Research Article
  • Citations16

A Video-Based Facial Motion Tracking and Expression Recognition System

  • Sep 01, 2016
  • Multimedia Tools and Applications
  • Jun Yu +1
  • Conference Article
  • Citations10

The recognition of facial expressions with automatic detection of the reference face

  • Mar 07, 2000
  • H Ebine +3
  • Conference Article
  • Citations5

Facial Expression Recognition and Synthesis on Affective Emotions Composition

  • Dec 01, 2008
  • Xu Chao +1
  • Research Article
  • Citations6

Assessment of relationship between comorbid oppositional defiant disorder and recognition of emotional facial expressions in children with attention-deficit/hyperactivity disorder

  • Sep 08, 2017
  • Psychiatry and Clinical Psychopharmacology
  • Halil Kara +4
  • Abstract

Salvarsan in the Treatment of Surra in Horses

  • Jan 01, 1913
  • Journal of Comparative Pathology and Therapeutics
  • PDF
  • Research Article
  • Citations19

Facial expression recognition for low resolution images using convolutional neural networks and denoising techniques

  • Mar 27, 2021
  • Indian Journal of Science and Technology
  • Pavan Nageswar Reddy Bodavarapu +1
  • Research Article
  • Citations1

Deep Learning Based on Facial Expression Recognition from Images to Videos

  • Jan 01, 2025
  • ITM Web of Conferences
  • Rui Deng
  • PDF
  • Research Article
  • Citations17

Person-Independent Facial Expression Recognition Based on Improved Local Binary Pattern and Higher-Order Singular Value Decomposition

  • Jan 01, 2020
  • IEEE Access
  • Ying He +1
  • Research Article

Dynamic facial expression recognition of sprinters based on multi-scale detail enhancement

  • Jan 01, 2022
  • International Journal of Biometrics
  • Xiang Cao +1
  • Book Chapter
  • Citations31

Facial Recognition, Expression Recognition, and Gender Identification

  • Aug 10, 2018
  • Shraddha Mane +1
  • Book Chapter

A Unified Framework for Monocular Video-Based Facial Motion Tracking and Expression Recognition

  • Dec 31, 2016
  • Jun Yu
  • PDF
  • Research Article
  • Citations51

Misrecognition of facial expressions in delinquents

  • Sep 18, 2009
  • Child and Adolescent Psychiatry and Mental Health
  • Wataru Sato +3
  • Research Article

Facial Expression Recognition and Generation for Virtual Characters Using an Enhanced MTCNN with HR-PCN and GCN

  • Oct 28, 2025
  • Informatica
  • Fangzhou Zhou
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.