• Home
  • Search
  • A Gesture Recognition Framework for Cognitive Assessment
  • Cite Icon1
  • https://doi.org/10.4017/gt.2018.17.s.164.00Copy DOI Icon

A Gesture Recognition Framework for Cognitive Assessment

Show More
  • Abstract
  • PDF
  • Literature Map
  • References
  • Citations
  • Similar Papers
Abstract

17(Suppl.): . Purpose: Most developed countries have been confronted with an acute growth in their elderly population. This situation is accompanied by increased prevalence of several health issues decreasing their quality of life. Alzheimer's disease is one of the most common cognitive disorders associated with aging. This has resulted in an urge to take advantage of technological tools to help doctors by providing early diagnosis which is vital for treatment of the elderly. These patients are not able to correctly emulate forelimb gestures and commit spatial/temporal errors, e.g. pretend to strike a nail with a hammer. 1 We developed a gesture recognition and evaluation tool to assist doctors in early detection of cognitive disorders (Figure 1). The framework performs precise gesture recognition based on state-of-the-art computer vision algorithms and evaluates subjects' performances to obtain a diagnostic report for clinicians. Method: The gesture recognition part of the framework uses four different methods. The first method employs local descriptors such as HOG/HOF 2 using shape and motion cues of a person performing a gesture. In the second method, skeleton information of the subjects is used to benefit from the body pose information. The third method uses depth information to detect exact hand patches with body part trajectories. We also trained a deep learning based recognition model 3 which empowered the framework to perform reliable recognitions. Results and Discussion: The framework is trained to recognize correct/incorrect performances. To have an objective decision on correctness of the gesture performances, clinicians annotated the data used for training the recognition algorithms. The utilized dataset was collected at the Institute Claude Pompidou (ICP) at Nice consisting of 14 dynamic and 15 static gestures selected by clinicians. The framework achieved 90% average accuracy on classifying gestures which is a reliable rate for diagnosis. Additionally, reaction and movement time of a subject are also detected. These two motor reflex criteria which measures responsive level of a subject are important factors in cognitive diagnosis. Motion descriptors are utilized to detect those quantities. All these types of information are illustrated in the user interface which provides clinicians with a detailed assessment of individual gesture and overall performance (Figure 1). Conclusion: We developed a user-friendly tool to help doctors in the diagnosis of cognitive disorders by providing a complete assessment of gestures performed by subjects. Future Work: We will conduct extensive evaluations on a larger population of patients with different levels of cognitive disorders. To improve gesture recognition task, more accurate deep models will be investigated.

Loading PDF

Similar Papers
  • Research Article
  • Citations55

Mirror Therapy Using Gesture Recognition for Upper Limb Function, Neck Discomfort, and Quality of Life After Chronic Stroke: A Single-Blind Randomized Controlled Trial.

  • May 03, 2019
  • Medical Science Monitor
  • Ho-Suk Choi +2
  • Research Article
  • Citations3

Gesture Object Detection and Recognition Based on YOLOv11

  • Jan 24, 2025
  • Applied and Computational Engineering
  • Jian Xu +4
  • Research Article
  • Citations74

Guideline Watch (October 2014): Practice Guideline for the Treatment of Patients With Alzheimer's Disease and Other Dementias.

  • Jan 01, 2017
  • Focus
  • Peter V Rabins +4
  • Abstract
  • Citations1

DIAGNOSING COGNITIVE DECLINE: COMPARING NIA-AA TO DSM-5 APPROACHES

  • Mar 13, 2020
  • The American Journal of Geriatric Psychiatry
  • Andrea Weinstein +12
  • PDF
  • Research Article

Non-Cognitive Symptoms in Alzheimer’s Disease and Their Likely Impact on Patient Outcomes. A Scoping Review

  • Jan 01, 2025
  • Current treatment options in neurology
  • Andrew Thaliath +1
  • Research Article
  • Citations2

Wearable gesture control design for unmanned aerial vehicle based on multi-sensor fusion

  • Jan 21, 2025
  • Robotica
  • Guang Liu +5
  • Book Chapter
  • Citations4

Research on Gesture Recognition of Surface EMG Based on Machine Learning

  • Jan 01, 2022
  • Linjie Liu +2
  • Research Article
  • Citations62

Homocysteine in neuropsychiatric disorders of the elderly.

  • Sep 01, 2002
  • International Journal of Geriatric Psychiatry
  • Sharon Reutens +1
  • Conference Article
  • Citations1

Application adaptation methods of gesture recognition based user interface

  • Jan 01, 2013
  • Jae-Ho Lee +3
  • Conference Article
  • Citations9

Design of Bionic Robotic Hand Gesture Recognition System Based on Machine Vision

  • May 20, 2022
  • Hui Li +1
  • Conference Article
  • Citations7

Interactive white board using gestures with KINECT

  • Mar 01, 2016
  • Ahtasham Ahsan +3
  • Research Article
  • Citations4

Psychometric Approbation of Screening Methods for the Diagnosis of Cognitive Status in a Sample of Ischemic Stroke Patients: an Observational Cohort Study

  • Aug 22, 2023
  • Bulletin of Rehabilitation Medicine
  • Anastasia V Kotelnikova +4
  • Research Article
  • Citations3

Analysis of neuroprotective medication in patients with neurocognitive disorders: The efficacy and tolerability of highly purified animal tissues extracts

  • Nov 01, 2022
  • Romanian Journal of Military Medicine
  • Octavian Vasiliu
  • Research Article
  • Citations7

Early changes in visuospatial episodic memory can help distinguish primary age-related tauopathy from Alzheimer's disease.

  • May 29, 2021
  • Neuropathology and Applied Neurobiology
  • Andrew C Robinson +8
  • Conference Article
  • Citations2

Channel-distribution Hybrid Deep Learning for sEMG-based Gesture Recognition

  • Dec 05, 2022
  • Keyi Lu +6
Cactus Communications logo

Copyright 2026 Cactus Communications. All rights reserved.