HC-LSTM: A Nobel Hybrid CNN Long Short-Term Memory Module for Emotion Recognition using KDEF and JAFFE Dataset
Due to a lack of resources for diagnosing mental illnesses including depression and early treatment, millions of individuals suffer from mental illness.Anxiety disorders, bipolar disorder, sleep difficulties, depression, and in certain situations, self-harm or suicide, are frequently caused by mental health problems.Because of this, identifying individuals who are having difficulties and offering prompt treatment continue to be extremely difficult tasks.Traditionally, patient interviews and Patient Health Questionnaire (PHQ) scores were used to identify facial expressions; however, these techniques frequently lacked accuracy.In order to increase accuracy, this study presents a hybrid deep learning model for emotion identification that makes use of visual characteristics from patient answers.The "Japanese Female Facial Expression (JAFFE)" and "Karolinska Directed Emotional Faces (KDEF)" databases are used to identify the behavioural characteristics of emotions.To expand the original dataset, the Generative Adversarial Network (GAN) model generates synthetic data.The suggested hybrid model for feature extraction makes use of "Long Short-Term Memory (LSTM)" approaches and a Convolutional Neural Network (CNN)" model for emotional characteristics that have been developed.According to the results, deep learning is a more effective method of detecting emotion, with Hierarchical Convolutional (HC)-LSTM models attaining a 99.09% total accuracy.The results show the effectiveness of emotion data, with a "HC-LSTM" loss of 0.2.Compared to other models, "HC-LSTM" has a greater learning rate.Plots showing training loss, validation loss, training accuracy, and validation accuracy are also included in the findings.Additionally, confusion matrix analysis was used to compare predicted and real labels, offering HC-LSTM and LSTM models insights into emotion detection.
Read more