Facial emotion recognition via stationary wavelet entropy and Biogeography-based optimization

People living with Human Immunodeficiency Virus (PLHIV) have been reported to show poor facial emotion recognition. However, these studies presented participants with facial emotion photographs whereas in real life facial emotion recognition hardly involves inferring emotions from static faces. Moreover, emotion recognition from other sensory modalities, such as auditory, has hardly been explored. There’s also a dearth of studies examining emotion regulation difficulties in this group. The present study, thus, explored facial (using facial emotion videos) and auditory emotion recognition as well as difficulties in emotion regulation (using the Hindi version of Difficulties in Emotion Regulation Scale) in 60 PLHIV and 60 people without HIV (PWoHIV). Additionally, the association of HIV duration (duration since diagnosis of HIV), viral load, and Clusters of differentiation 4 (CD4) count with emotion recognition and regulation difficulties in PLHIV was explored. Findings from one-way ANCOVA (with education and socioeconomic status as covariates) revealed significantly impaired auditory emotion recognition (particularly for fear) among PLHIV than PWoHIV. The former also showed significantly poorer facial emotion recognition for surprise. PLHIV also self-reported significantly more emotion regulation difficulties than PWoHIV, specifically Nonacceptance of their response to negative emotions and limited access to emotion regulation Strategies. CD4 count was negatively correlated with emotion regulation difficulties, particularly for accomplishing goal-directed behaviour when experiencing negative emotions (Goals) and Strategies. Besides the novel addition to the literature regarding impaired auditory emotion recognition in PLHIV, these findings can help develop targeted interventions to improve emotion recognition and emotion regulation for PLHIV.

Facial expression recognition via ResNet-50

Automated facial emotion recognition (FER) is one of the important fields of human-computer interaction (HCI). FER remains challenging due to facial accessories, non-uniform illumination, pose variation, etc. Emotion detection exploiting conventional algorithms has the demerit of mutual optimization of classification and feature extraction. Artificial intelligence (AI) techniques can be employed to identify FER automatically. Deep learning (DL) driven FER models have recently allowed for designing an end-to-end learning process. Therefore, this study designs a Henry Gas Solubility Optimization with Deep Learning Based FER (HGSO-DLFER) technique for HCI. The HGSO-DLFER technique aims to recognize and identify various kinds of facial emotions. To accomplish this, the HGSO-DLFER technique employs adaptive fuzzy filtering (AFF) for noise removal. In addition, the MobileNet model is used for feature vector generation, and the HGSO algorithm optimally chooses its hyperparameter scan. For the recognition of facial emotions, the HGSO-DLFER technique uses an autoencoder (AE) classifier with a Nadam optimizer. A widespread experimental analysis is made to facilitate a better understanding of the FER results by the HGSO-DLFER technique. The comparative analysis showed the effective performance of the HGSO-DLFER technique over other FER techniques with maximum accuracy of 98.65%.

Previous studies that have assessed social cognition in Attention-Deficit/Hyperactivity Disorder (ADHD) have produced inconsistent findings. To summarize these data and shed light upon moderators that may explain observed inconsistencies, we conducted a systematic review and meta-analysis exploring social cognition (Theory of Mind (ToM), Empathy, Facial and Non-Facial Emotion Recognition) and Everyday Social Skills in children and adolescents with ADHD. The current meta-analysis involved 142 studies including 652 effect sizes. These studies compared children and adolescents with ADHD (n = 8,300) and with typical development (n = 7,983). Participants with ADHD exhibited moderate to very large deficits in ToM (SMD = 0.84, 95% CI = 0.68-0.99), Facial Emotion Recognition (SMD = 0.63, 95% CI = 0.46-0.81), and Everyday Social Skills (SMD = 1.23, 95% CI = 1.08-1.37). The magnitude of these impairments was similar when considering effect sizes adjusted for some covariates and the methodological quality of the studies. Few studies have investigated Empathy and Non-Facial Emotion Recognition, which precludes definitive conclusions. Children and adolescents with ADHD experience robust impairments in ToM, Facial Emotion Recognition and Everyday Social Skills. Future studies should explore whether these deficits are a consequence of difficulties in other areas of cognition (e.g., executive functioning). We have made all our raw data open access to facilitate the use of the present work by the community (e.g., clinicians looking for tools, assessing social impairments, or researchers designing new studies).

The ability to recognize emotion is important to wellbeing and building relationships with others, making this skill important in adolescence. Research investigating adolescents’ ability to recognize facial and vocal emotion expressions has reported differing conclusions about the pattern of emotion recognition across this developmental period. This systematic review aimed to clarify the pattern of recognition for facial and vocal emotion expressions, and the relationship of performance to different task and emotion expression characteristics. A comprehensive and systematic search of the literature was conducted using six databases. To be eligible for inclusion, studies had to report data for adolescents between 11 and 18 years of age and measure accuracy of the recognition of emotion cues in either the face or voice. A total of 2333 studies were identified and 47 met inclusion criteria. The majority of studies focused on facial emotion recognition. Overall, early, mid-, and late-adolescents showed a similar pattern of recognition for both facial and vocal emotion expressions with the exception of Sad facial expressions. Sex of the participant also had minimal impact on the overall recognition of different emotions. However, analysis showed considerable variability according to task and emotion expression characteristics. Future research needs to increase focus on recognition of complex emotions, and low-intensity emotion expressions as well as the influence of the inclusion of Neutral as a response option.

Sixty healthy women were included to the study. They were divided two group labeled women with PMS (n=33) and without PMS (n=27), which is accordance with the Premenstrual Assessment Form. Then, The Facial Emotion Recognition Test (56 mixed photos with happy, surprised, fearful, sad, angry, disgusted and neutral facial expressions from Ekman & Friesen's series) was performed on each group in both the luteal and follicular phases. The women with PMS were significantly worse in recognizing sad (p=0.003) and surprised (p=0.019) faces in the luteal phase compared to the follicular phase, whereas women without PMS were significantly worse in recognizing sad faces (p=0.008) in the luteal phase compared to the follicular phase. There were no significant differences between women with and without PMS in either the luteal phases or in the follicular phases according to facial emotion recognition (for each, p>0.05). Conclusıon: The women with PMS do not differ from women without PMS in recognizing facial emotions accurately. The low accuracy rate in the recognition of sad and surprised facial emotions in the luteal phase may lead PMS women to have more social problems.

The authors examine facial emotion recognition and unirhinal olfactory performance in 19 schizophrenia patients and 14 comparison subjects. In patients, right nostril odor identification performance was positively related to overall emotion recognition accuracy, specifically, sad facial expressions. Olfactory and emotion recognition abilities appear significantly linked in schizophrenia.

Purpose Various studies have examined the role of executive functions in autism, but there is a lack of research in the current literature on cognitive flexibility in autism spectrum disorders (ASD). The purpose of this study is to investigate whether cognitive flexibility deficits could be related to facial emotion recognition deficits in ASD. Design/methodology/approach In total, 20 children with ASD and 20 typically developing children, matched for intelligence quotient and gender, were examined both in facial emotion recognition tasks and in cognitive flexibility tasks through the dimensional change card sorting task. Findings Despite cognitive flexibility not being a core deficit in ASD, impaired cognitive flexibility is evident in the present research. Results show that cognitive flexibility is related to facial emotion recognition and support the hypothesis of an executive specific deficit in children with autism. Research limitations/implications One of the limit is the use of just one cognitive test to measure cognitive flexibility and facial recognition. This could be important to be taken into account in the new research. By increasing the number of common variables assessing cognitive flexibility, this will allow for a better comparison between studies to characterize impairment in cognitive flexibility in ASD. Practical implications Investigating impairment in cognitive flexibility may help to plan training intervention based on the induction of flexibility. Social implications If the authors implement cognitive flexibility people with ASD can have also an effect on their social behavior and overcome the typical and repetitive behaviors that are the hallmark of ASD. Originality/value The originality is to relate cognitive flexibility deficits to facial emotion.

BackgroundThe emotional state of individuals is difficult to identify and it is developing now a days because of vast interest in recognition. Many technologies have been developed to identify this emotional expression based on facial expressions, vocal expressions, physiological signals, and body expressions. Among these, facial emotion is very expressive for recognition using multimodalities. Understanding facial emotions has applications in mental well‐being, decision‐making, and even social change, as emotions play a crucial role in our lives. This recognition is complicated by the high dimensionality of data and non‐linear interactions across modalities. Moreover, the way emotion is expressed by people varies and these feature identification remains challenging, where these limitations are overcome by Deep learning models.MethodsThis research work aims at facial emotion recognition through the utilization of a deep learning model, named the proposed Residual Fused‐Graph Convolution Network (RF‐GCN). Here, multimodal data included is video as well as an Electroencephalogram (EEG) signal. Also, the Non‐Local Means (NLM) filter is used for pre‐processing input video frames. Here, the feature selection process is carried out using chi‐square, after feature extraction, which is done in both pre‐processed video frames and input EEG signals. Finally, facial emotion recognition and its types are determined by RF‐GCN, which is a combination of both the Deep Residual Network (DRN) and Graph Convolutional Network (GCN).ResultsFurther, RF‐GCN is evaluated for performance by metrics such as accuracy, recall, and precision, with superior values of 91.6%, 96.5%, and 94.7%.ConclusionsRF‐GCN captures the nuanced relationships between different emotional states and improves recognition accuracy. The model is trained and evaluated on the dataset and reflects real‐world conditions.

Objective: Clozapine and risperidone are used for treatment-resistant schizophrenia and known to improve the positive and negative symptoms. However, there are some conflicts about effects on social cognition, which is measured with facial emotion recognition ability. The impairments in facial emotion recognition ability have frequently been in different stages of the illness and might have negative influences on psychosocial functioning. In the present study, we aimed to examine clozapine and risperidone effects recognizing facial emotions in patient with treatment-resistant schizophrenia.Methods: Thirty-four patients were screened for the study, and 19 patients were included. All patients were evaluated with Positive and Negative Syndrome Scale (PANSS), Calgary Depression Scale for Schizophrenia, and Functional Remission of General Schizophrenia Scale at baseline and after 16–20 weeks of clozapine (n = 12) or risperidone (n = 7) treatment. Furthermore, the Facial Emotion Recognition Test was performed before and after treatment. The test included the photos of four male and four female models (totally 56 mixed photos) with happy, surprised, fearful, sad, angry, disgusted, and neutral facial expressions from Ekman and Friesen’s catalog.Results: The mean dose of the index drug in clozapine group was 295.83 ± 103.26 mg/day. The mean positive (p = .002), negative (p = .050) general psychopathology (p = .002), and total score (p = .002) according to the PANSS were significantly improved after treatment. The mean dose of the index drug in risperidone group was 6.86 ± 1.57 mg/day. The mean positive symptom (p = .018) and total score (p = .041) were significantly improved after treatment but negative symptom scale (p = .396) and general psychopathology (p = .149) scores did not change. There were no significant differences between baseline and after treatment in clozapine and risperidone group according to the accuracy rate of facial emotion recognition expressions (p > .05 for each). At baseline phase, the patients were significantly impaired in recognizing disgusted faces in risperidone than those in clozapine group (p = .032) and it was significantly poorer after treatment with risperidone than with clozapine (p = .031). The patients responded significantly faster after the treatment to all facial emotions except for fearful faces (p = .355).Conclusions: Clozapine and risperidone were not found to have extensive effects on the ability to recognize facial emotions because of ineffectiveness to negative symptoms as in our study. We speculated that the higher dopaminergic receptor occupancy rate of risperidone in insular cortex than that of clozapine might be related with hypo-activation of insula that was associated with particular deficit in ability to recognize expressions of disgust in patients with schizophrenia. Impaired facial emotion recognition ability is present even in first-episode psychosis, which might be a trait marker in schizophrenia.

Facial emotion recognition (FER) is the technology or process of identifying and interpreting human emotions based on the analysis of facial expressions. It involves using computer algorithms and machine learning techniques to detect and classify emotional states from images or videos of human faces. Further, FER plays a vital role in recognizing and understanding human emotions to better interpret someone’s feelings, intentions, and attitudes. In the present time, it is widely used in various fields such as healthcare, human–computer interaction, law enforcement, security, and beyond. FER has a wide range of practical applications across various industries including Emotion Monitoring, Adaptive Learning, and Virtual Assistants. This paper presents a comparative analysis of FER algorithms, focusing on deep learning approaches. The performance of different datasets, including FER2013, JAFFE, AffectNet, and Cohn–Kanade, is evaluated using convolutional neural networks (CNNs), deep face, attentional convolutional networks (ACNs), and deep belief networks (DBNs). Among the tested algorithms, DBNs outperformed other algorithms, reaching the highest accuracy of 98.82%. These results emphasize the effectiveness of deep learning techniques, particularly DBNs, in FER. Additionally, outlining the advantages and disadvantages of current research on facial emotion identification might direct future research efforts in the direction of the most profitable directions.

Facial emotion recognition (FER) is largely utilized to analyze human emotion in order to address the needs of many real-time applications such as computer-human interfaces, emotion detection, forensics, biometrics, and human-robot collaboration. Nonetheless, existing methods are mostly unable to offer correct predictions with a minimum error rate. In this paper, an innovative facial emotion recognition framework, termed extended walrus-based deep learning with Botox feature selection network (EWDL-BFSN), was designed to accurately detect facial emotions. The main goals of the EWDL-BFSN are to identify facial emotions automatically and effectively by choosing the optimal features and adjusting the hyperparameters of the classifier. The gradient wavelet anisotropic filter (GWAF) can be used for image pre-processing in the EWDL-BFSN model. Additionally, SqueezeNet is used to extract significant features. The improved Botox optimization algorithm (IBoA) is then used to choose the best features. Lastly, FER and classification are accomplished through the use of an enhanced optimization-based kernel residual 50 (EK-ResNet50) network. Meanwhile, a nature-inspired metaheuristic, walrus optimization algorithm (WOA) is utilized to pick the hyperparameters of EK-ResNet50 network model. The EWDL-BFSN model was trained and tested with publicly available CK+ and FER-2013 datasets. The Python platform was applied for implementation, and various performance metrics such as accuracy, sensitivity, specificity, and F1-score were analyzed with state-of-the-art methods. The proposed EWDL-BFSN model acquired an overall accuracy of 99.37 and 99.25% for both CK+ and FER-2013 datasets and proved its superiority in predicting facial emotions over state-of-the-art methods.

Mapping structural covariance networks of facial emotion recognition in early psychosis: A pilot study

Normal subjects use the right insula and bilateral anterior temporal and prefrontal cortices to recognize the emotion expressed in a human face. Mood disorder subjects have a selective deficit in recognizing human facial emotion. Brain imaging studies show that they fail to activate the right insula to the same degree as controls, even when accurately assessing facial emotion. Many issues remain, however, including whether the facial emotion recognition errors in mood disorder subjects are state dependent or persist during normal mood states (and, thus, reflect a trait abnormality). To probe this issue, we repeatedly studied a male bipolar II patient's ability to recognize faces' emotional content. This patient made significantly more errors in facial emotion recognition during the depressed state. He also demonstrated a significant negative bias when he was depressed compared with nondepressed states. This case study demonstrates the state dependency of the defect in human facial emotion recognition.

Association between video gaming time and cognitive functions: A cross-sectional study of Chinese children and adolescents.