• Home
  • Search
  • Learning from Heterogeneity: Generalizing Dynamic Facial Expression Recognition via Distributionally Robust Optimization
  • Cite Icon4
  • https://doi.org/10.1145/3746027.3755036Copy DOI Icon

Learning from Heterogeneity: Generalizing Dynamic Facial Expression Recognition via Distributionally Robust Optimization

  • Oct 27, 2025
  • Feng-Qi Cui +6 more
Show More
  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Dynamic Facial Expression Recognition (DFER) plays a critical role in affective computing and human-computer interaction. Although existing methods achieve comparable performance, they inevitably suffer from performance degradation under sample heterogeneity caused by multi-source data and individual expression variability. To address these challenges, we propose a novel framework, called Heterogeneity-aware Distributional Framework (HDF), and design two plug-and-play modules to enhance time-frequency modeling and mitigate optimization imbalance caused by hard samples. Specifically, the Time-Frequency Distributional Attention Module (DAM) captures both temporal consistency and frequency robustness through a dual-branch attention design, improving tolerance to sequence inconsistency and visual style shifts. Then, based on gradient sensitivity and information bottleneck principles, an adaptive optimization module Distribution-aware Scaling Module (DSM) is introduced to dynamically balance classification and contrastive losses, enabling more stable and discriminative representation learning. Extensive experiments on two widely used datasets, DFEW and FERV39k, demonstrate that HDF significantly improves both recognition accuracy and robustness. Our method achieves superior weighted average recall (WAR) and unweighted average recall (UAR) while maintaining strong generalization across diverse and imbalanced scenarios. Codes are released at https://github.com/QIcita/HDF_DFER.

Similar Papers
  • Research Article
  • Citations2

Static for Dynamic: Towards a Deeper Understanding of Dynamic Facial Expressions Using Static Expression Data

  • Jan 01, 2026
  • IEEE Transactions on Affective Computing
  • Yin Chen +6
  • Research Article
  • Citations36

Enhanced spatial-temporal learning network for dynamic facial expression recognition

  • Aug 21, 2023
  • Biomedical Signal Processing and Control
  • Weijun Gong +3
  • Research Article
  • Citations59

Dynamic Facial Expression Recognition With Atlas Construction and Sparse Representation

  • Mar 02, 2016
  • IEEE Transactions on Image Processing
  • Yimo Guo +2
  • Book Chapter
  • Citations1

Dynamic Facial Expression Recognition Based on Trained Convolutional Neural Networks

  • Jan 01, 2018
  • Ming Li +1
  • Research Article

Mathematical Analysis and Performance Evaluation of CBAM-DenseNet121 for Speech Emotion Recognition Using the CREMA-D Dataset

  • Sep 03, 2025
  • Applied Sciences
  • Zineddine Sarhani Kahhoul +6
  • Research Article
  • Citations5

Learning Sequential Variation Information for Dynamic Facial Expression Recognition.

  • Jun 01, 2025
  • IEEE transactions on neural networks and learning systems
  • Bei Pan +5
  • Research Article
  • Citations2

Dynamic facial expression recognition with pseudo‐label guided multi‐modal pre‐training

  • Jul 21, 2023
  • IET Computer Vision
  • Bing Yin +6
  • PDF
  • Research Article
  • Citations4

A Waveform-Feature Dual Branch Acoustic Embedding Network for Emotion Recognition

  • May 15, 2020
  • Frontiers in Computer Science
  • Jeng-Lin Li +3
  • Research Article

Enhanced Video Anomaly Detection Through Dual Triplet Contrastive Loss for Hard Sample Discrimination.

  • Jun 20, 2025
  • Entropy (Basel, Switzerland)
  • Chunxiang Niu +2
  • Conference Article
  • Citations14

Automatic Screening Of Children With Speech Sound Disorders Using Paralinguistic Features

  • Oct 01, 2019
  • Mostafa Shahin +4
  • Conference Article
  • Citations4

All rivers run into the sea: Unified Modality Brain-Inspired Emotional Central Mechanism

  • Oct 28, 2024
  • Xinji Mai +12
  • Conference Article
  • Citations25

Dynamic Facial Expression Recognition based on Two-Stream-CNN with LBP-TOP

  • Nov 01, 2018
  • Duo Feng +1
  • Research Article

Speech Emotion Recognition Using MFCC Features and LSTM-Based Deep Learning

  • Feb 28, 2026
  • Indian Journal of Signal Processing
  • Dr Devraj +4
  • Research Article

EmoVisioNet: A hybrid network unifying lightweight CNN and attention-based vision model for facial emotion detection

  • Nov 28, 2025
  • Neurocomputing
  • Gargi Mishra +5
  • Conference Article
  • Citations12

Dynamic facial expression recognition using Laplacian Eigenmaps-based manifold learning

  • May 01, 2010
  • Bogdan Raducanu +1
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.