• Home
  • Search
  • Benchmarking Micro-Action Recognition: Dataset, Methods, and Applications
  • Cite Icon129
  • https://doi.org/10.1109/tcsvt.2024.3358415Copy DOI Icon

Benchmarking Micro-Action Recognition: Dataset, Methods, and Applications

  • Abstract
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

Micro-action is an imperceptible non-verbal behaviour characterised by low-intensity movement. It offers insights into the feelings and intentions of individuals and is important for human-oriented applications such as emotion recognition and psychological assessment. However, the identification, differentiation, and understanding of micro-actions pose challenges due to the imperceptible and inaccessible nature of these subtle human behaviors in everyday life. In this study, we innovatively collect a new micro-action dataset designated as Micro-action-52 (MA-52), and propose a benchmark named micro-action network (MANet) for micro-action recognition (MAR) task. Uniquely, MA-52 provides the whole-body perspective including gestures, upper- and lower-limb movements, attempting to reveal comprehensive micro-action cues. In detail, MA-52 contains 52 micro-action categories along with seven body part labels, and encompasses a full array of realistic and natural micro-actions, accounting for 205 participants and 22,422 video instances collated from the psychological interviews. Based on the proposed dataset, we assess MANet and other nine prevalent action recognition methods. MANet incorporates squeeze-and-excitation (SE) and temporal shift module (TSM) into the ResNet architecture for modeling the spatiotemporal characteristics of micro-actions. Then a joint-embedding loss is designed for semantic matching between video and action labels; the loss is used to better distinguish between visually similar yet distinct micro-action categories. The extended application in emotion recognition has demonstrated one of the important values of our proposed dataset and method. In the future, further exploration of human behaviour, emotion, and psychological assessment will be conducted in depth. The dataset and source code are released at https://github.com/VUT-HFUT/Micro-Action.

Similar Papers
  • Supplementary Content

Traveling Long-Distance with Bad Conscience? Discrepancies Between Everyday and Long-Distance Travel of Urbanites

  • Jan 01, 2020
  • Repository KITopen (Karlsruhe Institute of Technology)
  • Miriam Magdolen +3
  • PDF
  • Research Article
  • Citations181

Facial Emotion Recognition: A Survey and Real-World User Experiences in Mixed Reality.

  • Feb 01, 2018
  • Sensors
  • Dhwani Mehta +2
  • Research Article
  • Citations1

Deep Learning-Based EEG Emotion Recognition: A Review.

  • Dec 28, 2025
  • Brain sciences
  • Yunyang Liu +3
  • Research Article
  • Citations14

What drives visitors to tourist sites to choose “green” accommodation facilities?

  • Feb 19, 2021
  • Environment, Development and Sustainability
  • Roman Švec +7
  • Conference Article
  • Citations12

The Audio-Visual Arabic Dataset for Natural Emotions

  • Aug 01, 2019
  • Ftoon Abu Shaqra +2
  • PDF
  • Research Article
  • Citations4

Factors influencing hikers’ litter behavior in national park in China

  • Jan 08, 2024
  • Frontiers in Forests and Global Change
  • Huazhen Sun +2
  • Research Article
  • Citations9

Auditory Behavior in Everyday Life (ABEL) questionnaire in Hebrew and in Arabic and its association with clinical tests in cochlear-implanted children.

  • Aug 05, 2014
  • Journal of basic and clinical physiology and pharmacology
  • Miriam Geal-Dor +4
  • PDF
  • Research Article

THE RELATIONSHIPS BETWEEN RELIGIOUS EXPERIENCES AND THE REST OF LIFE EXPERIENCE. AN AUTOBIOGRAPHICAL STUDY

  • Jan 01, 2002
  • Trames. Journal of the Humanities and Social Sciences
  • T Lehtsaar
  • Research Article
  • Citations259

Smartphone sensing methods for studying behavior in everyday life

  • Sep 06, 2017
  • Current Opinion in Behavioral Sciences
  • Gabriella M Harari +3
  • Research Article
  • Citations2

감성 트리를 이용한 이미지 감성 분석 알고리즘

  • Nov 28, 2013
  • The Journal of the Korea Contents Association
  • Yean-Ran Lee +4
  • Research Article
  • Citations59

Advances in Neuroimaging and Deep Learning for Emotion Detection: A Systematic Review of Cognitive Neuroscience and Algorithmic Innovations.

  • Feb 13, 2025
  • Diagnostics (Basel, Switzerland)
  • Constantinos Halkiopoulos +3
  • Book Chapter

Security Threats in SIoT

  • Feb 21, 2023
  • A V Ajay +1
  • Research Article
  • Citations16

Distant Emotion Recognition

  • Sep 11, 2017
  • Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
  • Asif Salekin +7
  • Research Article
  • Citations72

A Survey on Human Emotion Recognition Approaches, Databases and Applications

  • Dec 16, 2015
  • ELCVIA Electronic Letters on Computer Vision and Image Analysis
  • C Vinola +1
  • Research Article
  • Citations12

The relations among prosocial behavior, hedonic, and eudaimonic well-being in everyday life.

  • May 16, 2024
  • Journal of personality
  • Fulvio Gregori +8
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.